Aug 15 16:12:10 user nova-compute[72849]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 15 16:12:13 user nova-compute[72849]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72849) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72849) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72849) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 16:12:13 user nova-compute[72849]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:12:13 user nova-compute[72849]: INFO nova.virt.driver [None req-18d70068-bc5b-467f-a590-705011313633 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 15 16:12:13 user nova-compute[72849]: INFO nova.compute.provider_config [None req-18d70068-bc5b-467f-a590-705011313633 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-18d70068-bc5b-467f-a590-705011313633 None None] Acquiring lock "singleton_lock" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-18d70068-bc5b-467f-a590-705011313633 None None] Acquired lock "singleton_lock" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-18d70068-bc5b-467f-a590-705011313633 None None] Releasing lock "singleton_lock" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] Full set of CONF: {{(pid=72849) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ******************************************************************************** {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] Configuration options gathered from: {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ================================================================================ {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] allow_resize_to_same_host      = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] arq_binding_timeout            = 300 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] backdoor_port                  = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] backdoor_socket                = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] block_device_allocate_retries  = 300 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] block_device_allocate_retries_interval = 5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cert                           = self.pem {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] compute_monitors               = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] config_dir                     = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] config_drive_format            = iso9660 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] config_source                  = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] console_host                   = user {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] control_exchange               = nova {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cpu_allocation_ratio           = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] daemon                         = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] debug                          = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] default_access_ip_network_name = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] default_availability_zone      = nova {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] default_ephemeral_format       = ext4 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] default_schedule_zone          = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] disk_allocation_ratio          = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] enable_new_services            = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] enabled_ssl_apis               = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] flat_injected                  = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] force_config_drive             = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] force_raw_images               = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] graceful_shutdown_timeout      = 5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] heal_instance_info_cache_interval = 60 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] host                           = user {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] instance_build_timeout         = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] instance_delete_interval       = 300 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] instance_name_template         = instance-%08x {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] instance_usage_audit           = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] instance_usage_audit_period    = month {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] internal_service_availability_zone = internal {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] key                            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] live_migration_retry_count     = 30 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] log_config_append              = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] log_dir                        = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] log_file                       = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] log_options                    = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] log_rotate_interval            = 1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] log_rotate_interval_type       = days {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] log_rotation_type              = none {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] long_rpc_timeout               = 1800 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] max_concurrent_builds          = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] max_concurrent_live_migrations = 1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] max_concurrent_snapshots       = 5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] max_local_block_devices        = 3 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] max_logfile_count              = 30 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] max_logfile_size_mb            = 200 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] maximum_instance_delete_attempts = 5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] metadata_listen                = 0.0.0.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] metadata_listen_port           = 8775 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] metadata_workers               = 3 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] migrate_max_retries            = -1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] mkisofs_cmd                    = genisoimage {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] my_ip                          = 10.0.0.210 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] network_allocate_retries       = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] osapi_compute_listen_port      = 8774 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] osapi_compute_unique_server_name_scope =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] osapi_compute_workers          = 3 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] password_length                = 12 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] periodic_enable                = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] periodic_fuzzy_delay           = 60 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] pointer_model                  = ps2mouse {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] preallocate_images             = none {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] publish_errors                 = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] pybasedir                      = /opt/stack/nova {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ram_allocation_ratio           = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] rate_limit_burst               = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] rate_limit_except_level        = CRITICAL {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] rate_limit_interval            = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] reboot_timeout                 = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] reclaim_instance_interval      = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] record                         = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] reimage_timeout_per_gb         = 60 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] report_interval                = 120 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] rescue_timeout                 = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] reserved_host_cpus             = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] reserved_host_disk_mb          = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] reserved_host_memory_mb        = 512 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] reserved_huge_pages            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] resize_confirm_window          = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] resize_fs_using_block_device   = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] resume_guests_state_on_host_boot = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] rpc_response_timeout           = 60 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] run_external_periodic_tasks    = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] running_deleted_instance_action = reap {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] running_deleted_instance_timeout = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] scheduler_instance_sync_interval = 120 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] service_down_time              = 720 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] servicegroup_driver            = db {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] shelved_offload_time           = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] shelved_poll_interval          = 3600 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] shutdown_timeout               = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] source_is_ipv6                 = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ssl_only                       = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] state_path                     = /opt/stack/data/nova {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] sync_power_state_interval      = 600 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] sync_power_state_pool_size     = 1000 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] syslog_log_facility            = LOG_USER {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] tempdir                        = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] timeout_nbd                    = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] transport_url                  = **** {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] update_resources_interval      = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] use_cow_images                 = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] use_eventlog                   = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] use_journal                    = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] use_json                       = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] use_rootwrap_daemon            = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] use_stderr                     = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] use_syslog                     = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vcpu_pin_set                   = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vif_plugging_is_fatal          = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vif_plugging_timeout           = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] virt_mkfs                      = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] volume_usage_poll_interval     = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] watch_log_file                 = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] web                            = /usr/share/spice-html5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_concurrency.disable_process_locking = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.auth_strategy              = keystone {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.compute_link_prefix        = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.dhcp_domain                = novalocal {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.enable_instance_password   = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.glance_link_prefix         = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.instance_list_per_project_cells = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.list_records_by_skipping_down_cells = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.local_metadata_per_cell    = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.max_limit                  = 1000 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.metadata_cache_expiration  = 15 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.neutron_default_tenant_id  = default {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.use_forwarded_for          = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.use_neutron_default_nets   = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.vendordata_dynamic_targets = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.vendordata_jsonfile_path   = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.backend_argument         = **** {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.config_prefix            = cache.oslo {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.dead_timeout             = 60.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.debug_cache_backend      = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.enable_retry_client      = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.enable_socket_keepalive  = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.enabled                  = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.expiration_time          = 600 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.hashclient_retry_attempts = 2 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.memcache_dead_retry      = 300 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.memcache_password        =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.memcache_sasl_enabled    = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.memcache_username        =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.proxies                  = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.retry_attempts           = 2 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.retry_delay              = 0.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.socket_keepalive_count   = 1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.socket_keepalive_idle    = 1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.socket_keepalive_interval = 1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.tls_allowed_ciphers      = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.tls_cafile               = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.tls_certfile             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.tls_enabled              = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cache.tls_keyfile              = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cinder.auth_section            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cinder.auth_type               = password {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cinder.cafile                  = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cinder.certfile                = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cinder.collect_timing          = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cinder.cross_az_attach         = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cinder.debug                   = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cinder.endpoint_template       = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cinder.http_retries            = 3 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cinder.insecure                = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cinder.keyfile                 = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cinder.os_region_name          = RegionOne {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cinder.split_loggers           = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cinder.timeout                 = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] compute.cpu_dedicated_set      = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] compute.cpu_shared_set         = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] compute.image_type_exclude_list = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] compute.resource_provider_association_refresh = 300 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] compute.shutdown_retry_interval = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] conductor.workers              = 3 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] console.allowed_origins        = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] console.ssl_ciphers            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] console.ssl_minimum_version    = default {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] consoleauth.token_ttl          = 600 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.cafile                  = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.certfile                = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.collect_timing          = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.connect_retries         = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.connect_retry_delay     = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.endpoint_override       = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.insecure                = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.keyfile                 = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.max_version             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.min_version             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.region_name             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.service_name            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.service_type            = accelerator {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.split_loggers           = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.status_code_retries     = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.status_code_retry_delay = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.timeout                 = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] cyborg.version                 = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.backend               = sqlalchemy {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.connection            = **** {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.connection_debug      = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.connection_parameters =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.connection_recycle_time = 3600 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.connection_trace      = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.db_inc_retry_interval = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.db_max_retries        = 20 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.db_max_retry_interval = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.db_retry_interval     = 1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.max_overflow          = 50 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.max_pool_size         = 5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.max_retries           = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.mysql_enable_ndb      = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.mysql_wsrep_sync_wait = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.pool_timeout          = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.retry_interval        = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.slave_connection      = **** {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] database.sqlite_synchronous    = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.backend           = sqlalchemy {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.connection        = **** {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.connection_debug  = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.connection_parameters =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.connection_recycle_time = 3600 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.connection_trace  = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.db_inc_retry_interval = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.db_max_retries    = 20 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.db_max_retry_interval = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.db_retry_interval = 1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.max_overflow      = 50 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.max_pool_size     = 5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.max_retries       = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.mysql_enable_ndb  = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.pool_timeout      = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.retry_interval    = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.slave_connection  = **** {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] api_database.sqlite_synchronous = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] devices.enabled_mdev_types     = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ephemeral_storage_encryption.enabled = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.api_servers             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.cafile                  = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.certfile                = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.collect_timing          = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.connect_retries         = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.connect_retry_delay     = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.debug                   = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.default_trusted_certificate_ids = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.enable_certificate_validation = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.enable_rbd_download     = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.endpoint_override       = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.insecure                = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.keyfile                 = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.max_version             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.min_version             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.num_retries             = 3 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.rbd_ceph_conf           =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.rbd_connect_timeout     = 5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.rbd_pool                =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.rbd_user                =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.region_name             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.service_name            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.service_type            = image {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.split_loggers           = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.status_code_retries     = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.status_code_retry_delay = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.timeout                 = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.verify_glance_signatures = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] glance.version                 = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] guestfs.debug                  = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] hyperv.config_drive_cdrom      = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] hyperv.config_drive_inject_password = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] hyperv.enable_remotefx         = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] hyperv.instances_path_share    =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] hyperv.limit_cpu_features      = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] hyperv.use_multipath_io        = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] hyperv.vswitch_name            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] mks.enabled                    = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] image_cache.manager_interval   = 2400 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] image_cache.precache_concurrency = 1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] image_cache.remove_unused_base_images = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] image_cache.subdirectory_name  = _base {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.api_max_retries         = 60 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.api_retry_interval      = 2 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.auth_section            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.auth_type               = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.cafile                  = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.certfile                = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.collect_timing          = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.connect_retries         = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.connect_retry_delay     = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.endpoint_override       = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.insecure                = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.keyfile                 = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.max_version             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.min_version             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.partition_key           = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.peer_list               = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.region_name             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.serial_console_state_timeout = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.service_name            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.service_type            = baremetal {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.split_loggers           = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.status_code_retries     = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.status_code_retry_delay = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.timeout                 = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ironic.version                 = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] key_manager.fixed_key          = **** {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican.barbican_api_version  = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican.barbican_endpoint     = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican.barbican_endpoint_type = public {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican.barbican_region_name  = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican.cafile                = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican.certfile              = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican.collect_timing        = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican.insecure              = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican.keyfile               = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican.number_of_retries     = 60 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican.retry_delay           = 1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican.send_service_user_token = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican.split_loggers         = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican.timeout               = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican.verify_ssl            = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican.verify_ssl_path       = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican_service_user.auth_section = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican_service_user.auth_type = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican_service_user.cafile   = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican_service_user.certfile = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican_service_user.collect_timing = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican_service_user.insecure = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican_service_user.keyfile  = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican_service_user.split_loggers = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] barbican_service_user.timeout  = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vault.approle_role_id          = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vault.approle_secret_id        = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vault.cafile                   = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vault.certfile                 = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vault.collect_timing           = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vault.insecure                 = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vault.keyfile                  = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vault.kv_mountpoint            = secret {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vault.kv_version               = 2 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vault.namespace                = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vault.root_token_id            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vault.split_loggers            = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vault.ssl_ca_crt_file          = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vault.timeout                  = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vault.use_ssl                  = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.cafile                = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.certfile              = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.collect_timing        = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.connect_retries       = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.connect_retry_delay   = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.endpoint_override     = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.insecure              = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.keyfile               = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.max_version           = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.min_version           = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.region_name           = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.service_name          = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.service_type          = identity {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.split_loggers         = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.status_code_retries   = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.status_code_retry_delay = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.timeout               = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] keystone.version               = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.connection_uri         =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.cpu_mode               = custom {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: WARNING oslo_config.cfg [None req-18d70068-bc5b-467f-a590-705011313633 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.cpu_power_governor_high = performance {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.cpu_power_management   = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.device_detach_attempts = 8 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.device_detach_timeout  = 20 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.disk_cachemodes        = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.disk_prefix            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.enabled_perf_events    = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.file_backed_memory     = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.gid_maps               = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.hw_disk_discard        = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.hw_machine_type        = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.images_rbd_pool        = rbd {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.images_type            = default {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.images_volume_group    = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.inject_key             = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.inject_partition       = -2 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.inject_password        = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.iscsi_iface            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.iser_use_multipath     = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.live_migration_downtime = 500 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.live_migration_inbound_addr = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.live_migration_scheme  = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.live_migration_timeout_action = abort {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.live_migration_tunnelled = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: WARNING oslo_config.cfg [None req-18d70068-bc5b-467f-a590-705011313633 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 15 16:12:13 user nova-compute[72849]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 15 16:12:13 user nova-compute[72849]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 15 16:12:13 user nova-compute[72849]: and ``live_migration_inbound_addr`` respectively.
Aug 15 16:12:13 user nova-compute[72849]: ).  Its value may be silently ignored in the future.
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.live_migration_with_native_tls = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.max_queues             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.nfs_mount_options      = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.num_pcie_ports         = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.pmem_namespaces        = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.quobyte_client_cfg     = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.rbd_secret_uuid        = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.rbd_user               = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.rescue_image_id        = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.rescue_kernel_id       = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.rx_queue_size          = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.smbfs_mount_options    =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.snapshot_compression   = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.snapshot_image_format  = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.sparse_logical_volumes = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.swtpm_enabled          = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.swtpm_group            = tss {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.swtpm_user             = tss {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.sysinfo_serial         = unique {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.tb_cache_size          = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.tx_queue_size          = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.uid_maps               = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.use_virtio_for_bridges = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.virt_type              = kvm {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.volume_clear           = zero {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.volume_clear_size      = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.volume_use_multipath   = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.vzstorage_cache_path   = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.auth_section           = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.auth_type              = password {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.cafile                 = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.certfile               = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.collect_timing         = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.connect_retries        = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.connect_retry_delay    = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.default_floating_pool  = public {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.endpoint_override      = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.extension_sync_interval = 600 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.http_retries           = 3 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.insecure               = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.keyfile                = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.max_version            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.min_version            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.ovs_bridge             = br-int {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.physnets               = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.region_name            = RegionOne {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.service_metadata_proxy = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.service_name           = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.service_type           = network {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.split_loggers          = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.status_code_retries    = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.status_code_retry_delay = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.timeout                = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] neutron.version                = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] notifications.bdms_in_notifications = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] notifications.default_level    = INFO {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] notifications.notification_format = unversioned {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] notifications.notify_on_state_change = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] pci.alias                      = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] pci.device_spec                = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] pci.report_in_placement        = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.auth_section         = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.auth_type            = password {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.cafile               = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.certfile             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.collect_timing       = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.connect_retries      = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.connect_retry_delay  = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.default_domain_id    = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.default_domain_name  = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.domain_id            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.domain_name          = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.endpoint_override    = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.insecure             = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.keyfile              = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.max_version          = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.min_version          = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.password             = **** {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.project_domain_id    = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.project_domain_name  = Default {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.project_id           = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.project_name         = service {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.region_name          = RegionOne {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.service_name         = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.service_type         = placement {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.split_loggers        = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.status_code_retries  = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.status_code_retry_delay = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.system_scope         = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.timeout              = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.trust_id             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.user_domain_id       = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.user_domain_name     = Default {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.user_id              = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.username             = placement {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] placement.version              = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] quota.cores                    = 20 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] quota.count_usage_from_placement = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] quota.injected_file_content_bytes = 10240 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] quota.injected_file_path_length = 255 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] quota.injected_files           = 5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] quota.instances                = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] quota.key_pairs                = 100 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] quota.metadata_items           = 128 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] quota.ram                      = 51200 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] quota.recheck_quota            = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] quota.server_group_members     = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] quota.server_groups            = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] rdp.enabled                    = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] scheduler.image_metadata_prefilter = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] scheduler.max_attempts         = 3 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] scheduler.max_placement_results = 1000 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] scheduler.workers              = 3 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.host_subset_size = 1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.isolated_hosts = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.isolated_images = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.pci_in_placement = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.track_instance_changes = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] metrics.required               = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] metrics.weight_multiplier      = 1.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] metrics.weight_setting         = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] serial_console.enabled         = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] serial_console.port_range      = 10000:20000 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] serial_console.serialproxy_port = 6083 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] service_user.auth_section      = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] service_user.auth_type         = password {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] service_user.cafile            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] service_user.certfile          = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] service_user.collect_timing    = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] service_user.insecure          = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] service_user.keyfile           = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] service_user.send_service_user_token = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] service_user.split_loggers     = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] service_user.timeout           = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] spice.agent_enabled            = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] spice.enabled                  = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] spice.html5proxy_port          = 6082 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] spice.image_compression        = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] spice.jpeg_compression         = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] spice.playback_compression     = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] spice.server_listen            = 127.0.0.1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] spice.streaming_mode           = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] spice.zlib_compression         = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] upgrade_levels.baseapi         = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] upgrade_levels.cert            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] upgrade_levels.compute         = auto {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] upgrade_levels.conductor       = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] upgrade_levels.scheduler       = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vendordata_dynamic_auth.cafile = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vendordata_dynamic_auth.certfile = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vendordata_dynamic_auth.insecure = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vendordata_dynamic_auth.timeout = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.api_retry_count         = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.ca_file                 = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.cache_prefix            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.cluster_name            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.connection_pool_size    = 10 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.console_delay_seconds   = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.datastore_regex         = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.host_ip                 = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.host_password           = **** {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.host_port               = 443 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.host_username           = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.insecure                = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.integration_bridge      = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.maximum_objects         = 100 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.pbm_default_policy      = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.pbm_enabled             = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.pbm_wsdl_location       = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.serial_port_proxy_uri   = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.serial_port_service_uri = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.task_poll_interval      = 0.5 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.use_linked_clone        = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.vnc_keymap              = en-us {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.vnc_port                = 5900 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vmware.vnc_port_total          = 10000 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vnc.auth_schemes               = ['none'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vnc.enabled                    = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vnc.novncproxy_port            = 6080 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vnc.vencrypt_ca_certs          = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vnc.vencrypt_client_cert       = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vnc.vencrypt_client_key        = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.disable_rootwrap   = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.enable_numa_live_migration = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.libvirt_disable_apic = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] wsgi.client_socket_timeout     = 900 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] wsgi.default_pool_size         = 1000 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] wsgi.keep_alive                = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] wsgi.max_header_line           = 16384 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] wsgi.ssl_ca_file               = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] wsgi.ssl_cert_file             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] wsgi.ssl_key_file              = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] wsgi.tcp_keepidle              = 600 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] zvm.ca_file                    = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] zvm.cloud_connector_url        = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] zvm.reachable_timeout          = 300 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_policy.enforce_new_defaults = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_policy.enforce_scope      = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_policy.policy_default_rule = default {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] profiler.connection_string     = messaging:// {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] profiler.enabled               = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] profiler.es_doc_type           = notification {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] profiler.es_scroll_size        = 10000 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] profiler.es_scroll_time        = 2m {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] profiler.filter_error_trace    = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] profiler.hmac_keys             = **** {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] profiler.sentinel_service_name = mymaster {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] profiler.socket_timeout        = 0.1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] profiler.trace_requests        = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] profiler.trace_sqlalchemy      = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] profiler_jaeger.process_tags   = {} {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] profiler_jaeger.service_name_prefix = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] profiler_otlp.service_name_prefix = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] remote_debug.host              = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] remote_debug.port              = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_notifications.retry = -1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.auth_section        = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.auth_type           = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.cafile              = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.certfile            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.collect_timing      = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.connect_retries     = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.connect_retry_delay = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.endpoint_id         = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.endpoint_override   = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.insecure            = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.keyfile             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.max_version         = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.min_version         = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.region_name         = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.service_name        = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.service_type        = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.split_loggers       = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.status_code_retries = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.status_code_retry_delay = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.timeout             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.valid_interfaces    = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_limit.version             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_reports.file_event_handler = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] oslo_reports.log_dir           = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vif_plug_ovs_privileged.group  = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] vif_plug_ovs_privileged.user   = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] os_vif_ovs.isolate_vif         = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] os_brick.lock_path             = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] privsep_osbrick.capabilities   = [21] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] privsep_osbrick.group          = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] privsep_osbrick.helper_command = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] privsep_osbrick.user           = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] nova_sys_admin.group           = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] nova_sys_admin.helper_command  = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] nova_sys_admin.user            = None {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG oslo_service.service [None req-18d70068-bc5b-467f-a590-705011313633 None None] ******************************************************************************** {{(pid=72849) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 15 16:12:13 user nova-compute[72849]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 15 16:12:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Starting native event thread {{(pid=72849) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Starting green dispatch thread {{(pid=72849) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Starting connection event dispatch thread {{(pid=72849) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Connecting to libvirt: qemu:///system {{(pid=72849) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fc37c1c4d30> {{(pid=72849) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 15 16:12:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fc37c1c4d30> {{(pid=72849) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 15 16:12:13 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Connection event '1' reason 'None'
Aug 15 16:12:13 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 15 16:12:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.mount [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Initialising _HostMountState generation 0 {{(pid=72849) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 15 16:12:21 user nova-compute[72849]: INFO nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Libvirt host capabilities <capabilities>
Aug 15 16:12:21 user nova-compute[72849]:   <host>
Aug 15 16:12:21 user nova-compute[72849]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 15 16:12:21 user nova-compute[72849]:     <cpu>
Aug 15 16:12:21 user nova-compute[72849]:       <arch>x86_64</arch>
Aug 15 16:12:21 user nova-compute[72849]:       <model>IvyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <vendor>Intel</vendor>
Aug 15 16:12:21 user nova-compute[72849]:       <microcode version='1070'/>
Aug 15 16:12:21 user nova-compute[72849]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 15 16:12:21 user nova-compute[72849]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature name='ss'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature name='vmx'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature name='pcid'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature name='osxsave'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature name='hypervisor'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature name='arat'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature name='tsc_adjust'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature name='md-clear'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature name='stibp'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature name='arch-capabilities'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature name='ssbd'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature name='invtsc'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature name='rsba'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature name='skip-l1dfl-vmentry'/>
Aug 15 16:12:21 user nova-compute[72849]:       <pages unit='KiB' size='4'/>
Aug 15 16:12:21 user nova-compute[72849]:       <pages unit='KiB' size='2048'/>
Aug 15 16:12:21 user nova-compute[72849]:     </cpu>
Aug 15 16:12:21 user nova-compute[72849]:     <power_management>
Aug 15 16:12:21 user nova-compute[72849]:       <suspend_mem/>
Aug 15 16:12:21 user nova-compute[72849]:       <suspend_disk/>
Aug 15 16:12:21 user nova-compute[72849]:       <suspend_hybrid/>
Aug 15 16:12:21 user nova-compute[72849]:     </power_management>
Aug 15 16:12:21 user nova-compute[72849]:     <iommu support='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     <migration_features>
Aug 15 16:12:21 user nova-compute[72849]:       <live/>
Aug 15 16:12:21 user nova-compute[72849]:       <uri_transports>
Aug 15 16:12:21 user nova-compute[72849]:         <uri_transport>tcp</uri_transport>
Aug 15 16:12:21 user nova-compute[72849]:         <uri_transport>rdma</uri_transport>
Aug 15 16:12:21 user nova-compute[72849]:       </uri_transports>
Aug 15 16:12:21 user nova-compute[72849]:     </migration_features>
Aug 15 16:12:21 user nova-compute[72849]:     <topology>
Aug 15 16:12:21 user nova-compute[72849]:       <cells num='2'>
Aug 15 16:12:21 user nova-compute[72849]:         <cell id='0'>
Aug 15 16:12:21 user nova-compute[72849]:           <memory unit='KiB'>8189224</memory>
Aug 15 16:12:21 user nova-compute[72849]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 15 16:12:21 user nova-compute[72849]:           <pages unit='KiB' size='2048'>0</pages>
Aug 15 16:12:21 user nova-compute[72849]:           <distances>
Aug 15 16:12:21 user nova-compute[72849]:             <sibling id='0' value='10'/>
Aug 15 16:12:21 user nova-compute[72849]:             <sibling id='1' value='20'/>
Aug 15 16:12:21 user nova-compute[72849]:           </distances>
Aug 15 16:12:21 user nova-compute[72849]:           <cpus num='6'>
Aug 15 16:12:21 user nova-compute[72849]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 15 16:12:21 user nova-compute[72849]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 15 16:12:21 user nova-compute[72849]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 15 16:12:21 user nova-compute[72849]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 15 16:12:21 user nova-compute[72849]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 15 16:12:21 user nova-compute[72849]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 15 16:12:21 user nova-compute[72849]:           </cpus>
Aug 15 16:12:21 user nova-compute[72849]:         </cell>
Aug 15 16:12:21 user nova-compute[72849]:         <cell id='1'>
Aug 15 16:12:21 user nova-compute[72849]:           <memory unit='KiB'>8206460</memory>
Aug 15 16:12:21 user nova-compute[72849]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 15 16:12:21 user nova-compute[72849]:           <pages unit='KiB' size='2048'>0</pages>
Aug 15 16:12:21 user nova-compute[72849]:           <distances>
Aug 15 16:12:21 user nova-compute[72849]:             <sibling id='0' value='20'/>
Aug 15 16:12:21 user nova-compute[72849]:             <sibling id='1' value='10'/>
Aug 15 16:12:21 user nova-compute[72849]:           </distances>
Aug 15 16:12:21 user nova-compute[72849]:           <cpus num='6'>
Aug 15 16:12:21 user nova-compute[72849]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 15 16:12:21 user nova-compute[72849]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 15 16:12:21 user nova-compute[72849]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 15 16:12:21 user nova-compute[72849]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 15 16:12:21 user nova-compute[72849]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 15 16:12:21 user nova-compute[72849]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 15 16:12:21 user nova-compute[72849]:           </cpus>
Aug 15 16:12:21 user nova-compute[72849]:         </cell>
Aug 15 16:12:21 user nova-compute[72849]:       </cells>
Aug 15 16:12:21 user nova-compute[72849]:     </topology>
Aug 15 16:12:21 user nova-compute[72849]:     <cache>
Aug 15 16:12:21 user nova-compute[72849]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 15 16:12:21 user nova-compute[72849]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 15 16:12:21 user nova-compute[72849]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 15 16:12:21 user nova-compute[72849]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 15 16:12:21 user nova-compute[72849]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 15 16:12:21 user nova-compute[72849]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 15 16:12:21 user nova-compute[72849]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 15 16:12:21 user nova-compute[72849]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 15 16:12:21 user nova-compute[72849]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 15 16:12:21 user nova-compute[72849]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 15 16:12:21 user nova-compute[72849]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 15 16:12:21 user nova-compute[72849]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 15 16:12:21 user nova-compute[72849]:     </cache>
Aug 15 16:12:21 user nova-compute[72849]:     <secmodel>
Aug 15 16:12:21 user nova-compute[72849]:       <model>apparmor</model>
Aug 15 16:12:21 user nova-compute[72849]:       <doi>0</doi>
Aug 15 16:12:21 user nova-compute[72849]:     </secmodel>
Aug 15 16:12:21 user nova-compute[72849]:     <secmodel>
Aug 15 16:12:21 user nova-compute[72849]:       <model>dac</model>
Aug 15 16:12:21 user nova-compute[72849]:       <doi>0</doi>
Aug 15 16:12:21 user nova-compute[72849]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 15 16:12:21 user nova-compute[72849]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 15 16:12:21 user nova-compute[72849]:     </secmodel>
Aug 15 16:12:21 user nova-compute[72849]:   </host>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='alpha'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>64</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>clipper</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='armv6l'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>32</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>spitz</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>nuri</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>kzm</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>sx1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>z2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>tosa</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>n810</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>n800</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>terrier</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>midway</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>microbit</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>verdex</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>highbank</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>akita</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>connex</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>collie</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='armv7l'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>32</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>spitz</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>nuri</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>kzm</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>sx1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>z2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>tosa</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>n810</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>n800</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>terrier</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>midway</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>microbit</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>verdex</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>highbank</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>akita</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>connex</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>collie</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='aarch64'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>64</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>spitz</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>nuri</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>kzm</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>sx1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>z2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>tosa</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>n810</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>n800</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>terrier</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>midway</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>microbit</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>verdex</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>raspi3b</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>highbank</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>akita</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>connex</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>collie</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <acpi default='on' toggle='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='cris'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>32</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='i686'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>32</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>x-remote</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>isapc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>microvm</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='kvm'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <pae/>
Aug 15 16:12:21 user nova-compute[72849]:       <nonpae/>
Aug 15 16:12:21 user nova-compute[72849]:       <acpi default='on' toggle='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:       <apic default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='m68k'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>32</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>an5206</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>q800</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>next-cube</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='microblaze'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>32</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='microblazeel'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>32</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='mips'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>32</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='16'>malta</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='mipsel'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>32</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='16'>malta</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='mips64'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>64</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='16'>malta</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>pica61</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>magnum</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='mips64el'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>64</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='16'>malta</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>pica61</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>magnum</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='16'>boston</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='ppc'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>32</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mac99</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>40p</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>taihu</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='ppc64'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>64</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2048'>powernv9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>taihu</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2048'>powernv10</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>40p</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mac99</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2048'>powernv8</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='ppc64le'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>64</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2048'>powernv9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>taihu</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2048'>powernv10</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>40p</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>mac99</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2048'>powernv8</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='riscv32'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>32</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='8'>spike</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>opentitan</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='5'>sifive_u</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>sifive_e</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='8'>virt</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='riscv64'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>64</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='8'>spike</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='5'>sifive_u</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>shakti_c</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>sifive_e</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='8'>virt</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='s390x'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>64</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='sh4'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>32</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>shix</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>r2d</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='sh4eb'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>64</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>shix</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>r2d</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='sparc'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>32</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>SS-5</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>SS-20</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>LX</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>SS-4</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>SS-10</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>Voyager</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='sparc64'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>64</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>sun4u</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>niagara</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>sun4v</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='x86_64'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>64</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>x-remote</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='1'>isapc</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>microvm</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='kvm'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <acpi default='on' toggle='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:       <apic default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='xtensa'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>32</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>sim</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>kc705</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>ml605</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>virt</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>lx200</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>lx60</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]:   <guest>
Aug 15 16:12:21 user nova-compute[72849]:     <os_type>hvm</os_type>
Aug 15 16:12:21 user nova-compute[72849]:     <arch name='xtensaeb'>
Aug 15 16:12:21 user nova-compute[72849]:       <wordsize>32</wordsize>
Aug 15 16:12:21 user nova-compute[72849]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='4'>sim</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>kc705</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>ml605</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>virt</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>lx200</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>lx60</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 15 16:12:21 user nova-compute[72849]:       <domain type='qemu'/>
Aug 15 16:12:21 user nova-compute[72849]:     </arch>
Aug 15 16:12:21 user nova-compute[72849]:     <features>
Aug 15 16:12:21 user nova-compute[72849]:       <cpuselection/>
Aug 15 16:12:21 user nova-compute[72849]:       <deviceboot/>
Aug 15 16:12:21 user nova-compute[72849]:       <disksnapshot default='on' toggle='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     </features>
Aug 15 16:12:21 user nova-compute[72849]:   </guest>
Aug 15 16:12:21 user nova-compute[72849]: </capabilities>
Aug 15 16:12:21 user nova-compute[72849]: 
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 15 16:12:21 user nova-compute[72849]: <domainCapabilities>
Aug 15 16:12:21 user nova-compute[72849]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 16:12:21 user nova-compute[72849]:   <domain>kvm</domain>
Aug 15 16:12:21 user nova-compute[72849]:   <machine>pc-i440fx-jammy</machine>
Aug 15 16:12:21 user nova-compute[72849]:   <arch>i686</arch>
Aug 15 16:12:21 user nova-compute[72849]:   <vcpu max='255'/>
Aug 15 16:12:21 user nova-compute[72849]:   <iothreads supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:   <os supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:     <enum name='firmware'/>
Aug 15 16:12:21 user nova-compute[72849]:     <loader supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='type'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>rom</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>pflash</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='readonly'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>yes</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>no</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='secure'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>no</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </loader>
Aug 15 16:12:21 user nova-compute[72849]:   </os>
Aug 15 16:12:21 user nova-compute[72849]:   <cpu>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='host-passthrough' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='hostPassthroughMigratable'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>off</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='maximum' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='maximumMigratable'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>on</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>off</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='host-model' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <vendor>Intel</vendor>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ss'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='vmx'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='pcid'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='hypervisor'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='arat'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='umip'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='md-clear'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='stibp'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ssbd'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ibpb'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ibrs'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='amd-stibp'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='erms'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='lm'/>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='custom' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>qemu64</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>qemu32</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>phenom</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium3</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium2</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>n270</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>kvm64</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>kvm32</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>coreduo</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>core2duo</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>athlon</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Westmere</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Snowridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>SandyBridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Penryn</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G5</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G4</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G3</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G2</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G1</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Nehalem</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>IvyBridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Icelake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-Rome</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-Milan</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Dhyana</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cooperlake</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Conroe</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>486</model>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:   </cpu>
Aug 15 16:12:21 user nova-compute[72849]:   <memoryBacking supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:     <enum name='sourceType'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>file</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>anonymous</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>memfd</value>
Aug 15 16:12:21 user nova-compute[72849]:     </enum>
Aug 15 16:12:21 user nova-compute[72849]:   </memoryBacking>
Aug 15 16:12:21 user nova-compute[72849]:   <devices>
Aug 15 16:12:21 user nova-compute[72849]:     <disk supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='diskDevice'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>disk</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>cdrom</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>floppy</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>lun</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='bus'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>ide</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>fdc</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>scsi</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>usb</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>sata</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-non-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </disk>
Aug 15 16:12:21 user nova-compute[72849]:     <graphics supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='type'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>sdl</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vnc</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>spice</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>egl-headless</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </graphics>
Aug 15 16:12:21 user nova-compute[72849]:     <video supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='modelType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vga</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>cirrus</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vmvga</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>qxl</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>none</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>bochs</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>ramfb</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </video>
Aug 15 16:12:21 user nova-compute[72849]:     <hostdev supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='mode'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>subsystem</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='startupPolicy'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>default</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>mandatory</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>requisite</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>optional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='subsysType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>usb</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>pci</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>scsi</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='capsType'/>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='pciBackend'/>
Aug 15 16:12:21 user nova-compute[72849]:     </hostdev>
Aug 15 16:12:21 user nova-compute[72849]:     <rng supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-non-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='backendModel'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>random</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>egd</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>builtin</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </rng>
Aug 15 16:12:21 user nova-compute[72849]:     <filesystem supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='driverType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>path</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>handle</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtiofs</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </filesystem>
Aug 15 16:12:21 user nova-compute[72849]:     <tpm supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>tpm-tis</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>tpm-crb</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='backendModel'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>passthrough</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>emulator</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </tpm>
Aug 15 16:12:21 user nova-compute[72849]:   </devices>
Aug 15 16:12:21 user nova-compute[72849]:   <features>
Aug 15 16:12:21 user nova-compute[72849]:     <gic supported='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     <vmcoreinfo supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <genid supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <backingStoreInput supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <backup supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <sev supported='no'/>
Aug 15 16:12:21 user nova-compute[72849]:   </features>
Aug 15 16:12:21 user nova-compute[72849]: </domainCapabilities>
Aug 15 16:12:21 user nova-compute[72849]:  {{(pid=72849) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 15 16:12:21 user nova-compute[72849]: <domainCapabilities>
Aug 15 16:12:21 user nova-compute[72849]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 16:12:21 user nova-compute[72849]:   <domain>kvm</domain>
Aug 15 16:12:21 user nova-compute[72849]:   <machine>pc-q35-jammy</machine>
Aug 15 16:12:21 user nova-compute[72849]:   <arch>i686</arch>
Aug 15 16:12:21 user nova-compute[72849]:   <vcpu max='288'/>
Aug 15 16:12:21 user nova-compute[72849]:   <iothreads supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:   <os supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:     <enum name='firmware'/>
Aug 15 16:12:21 user nova-compute[72849]:     <loader supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='type'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>rom</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>pflash</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='readonly'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>yes</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>no</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='secure'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>no</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </loader>
Aug 15 16:12:21 user nova-compute[72849]:   </os>
Aug 15 16:12:21 user nova-compute[72849]:   <cpu>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='host-passthrough' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='hostPassthroughMigratable'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>off</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='maximum' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='maximumMigratable'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>on</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>off</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='host-model' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <vendor>Intel</vendor>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ss'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='vmx'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='pcid'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='hypervisor'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='arat'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='umip'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='md-clear'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='stibp'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ssbd'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ibpb'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ibrs'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='amd-stibp'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='erms'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='lm'/>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='custom' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>qemu64</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>qemu32</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>phenom</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium3</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium2</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>n270</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>kvm64</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>kvm32</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>coreduo</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>core2duo</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>athlon</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Westmere</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Snowridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>SandyBridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Penryn</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G5</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G4</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G3</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G2</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G1</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Nehalem</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>IvyBridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Icelake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-Rome</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-Milan</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Dhyana</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cooperlake</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Conroe</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>486</model>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:   </cpu>
Aug 15 16:12:21 user nova-compute[72849]:   <memoryBacking supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:     <enum name='sourceType'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>file</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>anonymous</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>memfd</value>
Aug 15 16:12:21 user nova-compute[72849]:     </enum>
Aug 15 16:12:21 user nova-compute[72849]:   </memoryBacking>
Aug 15 16:12:21 user nova-compute[72849]:   <devices>
Aug 15 16:12:21 user nova-compute[72849]:     <disk supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='diskDevice'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>disk</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>cdrom</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>floppy</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>lun</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='bus'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>fdc</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>scsi</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>usb</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>sata</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-non-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </disk>
Aug 15 16:12:21 user nova-compute[72849]:     <graphics supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='type'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>sdl</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vnc</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>spice</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>egl-headless</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </graphics>
Aug 15 16:12:21 user nova-compute[72849]:     <video supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='modelType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vga</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>cirrus</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vmvga</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>qxl</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>none</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>bochs</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>ramfb</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </video>
Aug 15 16:12:21 user nova-compute[72849]:     <hostdev supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='mode'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>subsystem</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='startupPolicy'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>default</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>mandatory</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>requisite</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>optional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='subsysType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>usb</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>pci</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>scsi</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='capsType'/>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='pciBackend'/>
Aug 15 16:12:21 user nova-compute[72849]:     </hostdev>
Aug 15 16:12:21 user nova-compute[72849]:     <rng supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-non-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='backendModel'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>random</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>egd</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>builtin</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </rng>
Aug 15 16:12:21 user nova-compute[72849]:     <filesystem supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='driverType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>path</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>handle</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtiofs</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </filesystem>
Aug 15 16:12:21 user nova-compute[72849]:     <tpm supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>tpm-tis</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>tpm-crb</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='backendModel'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>passthrough</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>emulator</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </tpm>
Aug 15 16:12:21 user nova-compute[72849]:   </devices>
Aug 15 16:12:21 user nova-compute[72849]:   <features>
Aug 15 16:12:21 user nova-compute[72849]:     <gic supported='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     <vmcoreinfo supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <genid supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <backingStoreInput supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <backup supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <sev supported='no'/>
Aug 15 16:12:21 user nova-compute[72849]:   </features>
Aug 15 16:12:21 user nova-compute[72849]: </domainCapabilities>
Aug 15 16:12:21 user nova-compute[72849]:  {{(pid=72849) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 15 16:12:21 user nova-compute[72849]: <domainCapabilities>
Aug 15 16:12:21 user nova-compute[72849]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 16:12:21 user nova-compute[72849]:   <domain>kvm</domain>
Aug 15 16:12:21 user nova-compute[72849]:   <machine>pc-i440fx-6.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:   <arch>i686</arch>
Aug 15 16:12:21 user nova-compute[72849]:   <vcpu max='255'/>
Aug 15 16:12:21 user nova-compute[72849]:   <iothreads supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:   <os supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:     <enum name='firmware'/>
Aug 15 16:12:21 user nova-compute[72849]:     <loader supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='type'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>rom</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>pflash</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='readonly'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>yes</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>no</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='secure'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>no</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </loader>
Aug 15 16:12:21 user nova-compute[72849]:   </os>
Aug 15 16:12:21 user nova-compute[72849]:   <cpu>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='host-passthrough' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='hostPassthroughMigratable'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>off</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='maximum' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='maximumMigratable'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>on</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>off</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='host-model' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <vendor>Intel</vendor>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ss'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='vmx'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='pcid'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='hypervisor'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='arat'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='umip'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='md-clear'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='stibp'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ssbd'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ibpb'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ibrs'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='amd-stibp'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='erms'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='lm'/>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='custom' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>qemu64</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>qemu32</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>phenom</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium3</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium2</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>n270</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>kvm64</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>kvm32</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>coreduo</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>core2duo</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>athlon</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Westmere</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Snowridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>SandyBridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Penryn</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G5</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G4</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G3</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G2</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G1</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Nehalem</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>IvyBridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Icelake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-Rome</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-Milan</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Dhyana</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cooperlake</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Conroe</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>486</model>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:   </cpu>
Aug 15 16:12:21 user nova-compute[72849]:   <memoryBacking supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:     <enum name='sourceType'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>file</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>anonymous</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>memfd</value>
Aug 15 16:12:21 user nova-compute[72849]:     </enum>
Aug 15 16:12:21 user nova-compute[72849]:   </memoryBacking>
Aug 15 16:12:21 user nova-compute[72849]:   <devices>
Aug 15 16:12:21 user nova-compute[72849]:     <disk supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='diskDevice'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>disk</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>cdrom</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>floppy</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>lun</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='bus'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>ide</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>fdc</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>scsi</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>usb</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>sata</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-non-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </disk>
Aug 15 16:12:21 user nova-compute[72849]:     <graphics supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='type'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>sdl</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vnc</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>spice</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>egl-headless</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </graphics>
Aug 15 16:12:21 user nova-compute[72849]:     <video supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='modelType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vga</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>cirrus</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vmvga</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>qxl</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>none</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>bochs</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>ramfb</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </video>
Aug 15 16:12:21 user nova-compute[72849]:     <hostdev supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='mode'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>subsystem</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='startupPolicy'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>default</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>mandatory</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>requisite</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>optional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='subsysType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>usb</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>pci</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>scsi</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='capsType'/>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='pciBackend'/>
Aug 15 16:12:21 user nova-compute[72849]:     </hostdev>
Aug 15 16:12:21 user nova-compute[72849]:     <rng supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-non-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='backendModel'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>random</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>egd</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>builtin</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </rng>
Aug 15 16:12:21 user nova-compute[72849]:     <filesystem supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='driverType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>path</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>handle</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtiofs</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </filesystem>
Aug 15 16:12:21 user nova-compute[72849]:     <tpm supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>tpm-tis</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>tpm-crb</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='backendModel'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>passthrough</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>emulator</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </tpm>
Aug 15 16:12:21 user nova-compute[72849]:   </devices>
Aug 15 16:12:21 user nova-compute[72849]:   <features>
Aug 15 16:12:21 user nova-compute[72849]:     <gic supported='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     <vmcoreinfo supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <genid supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <backingStoreInput supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <backup supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <sev supported='no'/>
Aug 15 16:12:21 user nova-compute[72849]:   </features>
Aug 15 16:12:21 user nova-compute[72849]: </domainCapabilities>
Aug 15 16:12:21 user nova-compute[72849]:  {{(pid=72849) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 15 16:12:21 user nova-compute[72849]: <domainCapabilities>
Aug 15 16:12:21 user nova-compute[72849]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 16:12:21 user nova-compute[72849]:   <domain>kvm</domain>
Aug 15 16:12:21 user nova-compute[72849]:   <machine>pc-q35-6.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:   <arch>i686</arch>
Aug 15 16:12:21 user nova-compute[72849]:   <vcpu max='288'/>
Aug 15 16:12:21 user nova-compute[72849]:   <iothreads supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:   <os supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:     <enum name='firmware'/>
Aug 15 16:12:21 user nova-compute[72849]:     <loader supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='type'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>rom</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>pflash</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='readonly'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>yes</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>no</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='secure'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>no</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </loader>
Aug 15 16:12:21 user nova-compute[72849]:   </os>
Aug 15 16:12:21 user nova-compute[72849]:   <cpu>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='host-passthrough' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='hostPassthroughMigratable'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>off</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='maximum' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='maximumMigratable'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>on</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>off</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='host-model' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <vendor>Intel</vendor>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ss'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='vmx'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='pcid'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='hypervisor'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='arat'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='umip'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='md-clear'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='stibp'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ssbd'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ibpb'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ibrs'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='amd-stibp'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='erms'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='lm'/>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='custom' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>qemu64</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>qemu32</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>phenom</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium3</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium2</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>n270</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>kvm64</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>kvm32</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>coreduo</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>core2duo</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>athlon</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Westmere</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Snowridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>SandyBridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Penryn</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G5</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G4</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G3</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G2</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G1</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Nehalem</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>IvyBridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Icelake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-Rome</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-Milan</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Dhyana</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cooperlake</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Conroe</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>486</model>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:   </cpu>
Aug 15 16:12:21 user nova-compute[72849]:   <memoryBacking supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:     <enum name='sourceType'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>file</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>anonymous</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>memfd</value>
Aug 15 16:12:21 user nova-compute[72849]:     </enum>
Aug 15 16:12:21 user nova-compute[72849]:   </memoryBacking>
Aug 15 16:12:21 user nova-compute[72849]:   <devices>
Aug 15 16:12:21 user nova-compute[72849]:     <disk supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='diskDevice'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>disk</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>cdrom</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>floppy</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>lun</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='bus'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>fdc</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>scsi</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>usb</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>sata</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-non-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </disk>
Aug 15 16:12:21 user nova-compute[72849]:     <graphics supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='type'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>sdl</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vnc</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>spice</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>egl-headless</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </graphics>
Aug 15 16:12:21 user nova-compute[72849]:     <video supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='modelType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vga</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>cirrus</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vmvga</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>qxl</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>none</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>bochs</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>ramfb</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </video>
Aug 15 16:12:21 user nova-compute[72849]:     <hostdev supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='mode'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>subsystem</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='startupPolicy'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>default</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>mandatory</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>requisite</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>optional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='subsysType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>usb</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>pci</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>scsi</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='capsType'/>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='pciBackend'/>
Aug 15 16:12:21 user nova-compute[72849]:     </hostdev>
Aug 15 16:12:21 user nova-compute[72849]:     <rng supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-non-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='backendModel'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>random</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>egd</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>builtin</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </rng>
Aug 15 16:12:21 user nova-compute[72849]:     <filesystem supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='driverType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>path</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>handle</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtiofs</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </filesystem>
Aug 15 16:12:21 user nova-compute[72849]:     <tpm supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>tpm-tis</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>tpm-crb</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='backendModel'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>passthrough</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>emulator</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </tpm>
Aug 15 16:12:21 user nova-compute[72849]:   </devices>
Aug 15 16:12:21 user nova-compute[72849]:   <features>
Aug 15 16:12:21 user nova-compute[72849]:     <gic supported='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     <vmcoreinfo supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <genid supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <backingStoreInput supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <backup supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <sev supported='no'/>
Aug 15 16:12:21 user nova-compute[72849]:   </features>
Aug 15 16:12:21 user nova-compute[72849]: </domainCapabilities>
Aug 15 16:12:21 user nova-compute[72849]:  {{(pid=72849) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 15 16:12:21 user nova-compute[72849]: <domainCapabilities>
Aug 15 16:12:21 user nova-compute[72849]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 16:12:21 user nova-compute[72849]:   <domain>kvm</domain>
Aug 15 16:12:21 user nova-compute[72849]:   <machine>pc-i440fx-jammy</machine>
Aug 15 16:12:21 user nova-compute[72849]:   <arch>x86_64</arch>
Aug 15 16:12:21 user nova-compute[72849]:   <vcpu max='255'/>
Aug 15 16:12:21 user nova-compute[72849]:   <iothreads supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:   <os supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:     <enum name='firmware'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>efi</value>
Aug 15 16:12:21 user nova-compute[72849]:     </enum>
Aug 15 16:12:21 user nova-compute[72849]:     <loader supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='type'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>rom</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>pflash</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='readonly'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>yes</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>no</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='secure'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>no</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </loader>
Aug 15 16:12:21 user nova-compute[72849]:   </os>
Aug 15 16:12:21 user nova-compute[72849]:   <cpu>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='host-passthrough' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='hostPassthroughMigratable'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>on</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>off</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='maximum' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='maximumMigratable'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>on</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>off</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='host-model' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <vendor>Intel</vendor>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ss'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='vmx'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='pcid'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='hypervisor'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='arat'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='umip'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='md-clear'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='stibp'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ssbd'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='invtsc'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ibpb'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ibrs'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='amd-stibp'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='rsba'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='erms'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='custom' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>qemu64</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>qemu32</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>phenom</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium3</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium2</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>n270</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>kvm64</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>kvm32</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>coreduo</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>core2duo</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>athlon</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Westmere</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Snowridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>SandyBridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Penryn</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G5</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G4</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G3</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G2</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Opteron_G1</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Nehalem</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>IvyBridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Icelake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-Rome</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-Milan</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Dhyana</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cooperlake</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Conroe</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>486</model>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:   </cpu>
Aug 15 16:12:21 user nova-compute[72849]:   <memoryBacking supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:     <enum name='sourceType'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>file</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>anonymous</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>memfd</value>
Aug 15 16:12:21 user nova-compute[72849]:     </enum>
Aug 15 16:12:21 user nova-compute[72849]:   </memoryBacking>
Aug 15 16:12:21 user nova-compute[72849]:   <devices>
Aug 15 16:12:21 user nova-compute[72849]:     <disk supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='diskDevice'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>disk</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>cdrom</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>floppy</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>lun</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='bus'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>ide</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>fdc</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>scsi</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>usb</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>sata</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-non-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </disk>
Aug 15 16:12:21 user nova-compute[72849]:     <graphics supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='type'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>sdl</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vnc</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>spice</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>egl-headless</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </graphics>
Aug 15 16:12:21 user nova-compute[72849]:     <video supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='modelType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vga</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>cirrus</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vmvga</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>qxl</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>none</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>bochs</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>ramfb</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </video>
Aug 15 16:12:21 user nova-compute[72849]:     <hostdev supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='mode'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>subsystem</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='startupPolicy'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>default</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>mandatory</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>requisite</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>optional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='subsysType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>usb</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>pci</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>scsi</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='capsType'/>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='pciBackend'/>
Aug 15 16:12:21 user nova-compute[72849]:     </hostdev>
Aug 15 16:12:21 user nova-compute[72849]:     <rng supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-non-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='backendModel'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>random</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>egd</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>builtin</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </rng>
Aug 15 16:12:21 user nova-compute[72849]:     <filesystem supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='driverType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>path</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>handle</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtiofs</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </filesystem>
Aug 15 16:12:21 user nova-compute[72849]:     <tpm supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>tpm-tis</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>tpm-crb</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='backendModel'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>passthrough</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>emulator</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </tpm>
Aug 15 16:12:21 user nova-compute[72849]:   </devices>
Aug 15 16:12:21 user nova-compute[72849]:   <features>
Aug 15 16:12:21 user nova-compute[72849]:     <gic supported='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     <vmcoreinfo supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <genid supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <backingStoreInput supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <backup supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <sev supported='no'/>
Aug 15 16:12:21 user nova-compute[72849]:   </features>
Aug 15 16:12:21 user nova-compute[72849]: </domainCapabilities>
Aug 15 16:12:21 user nova-compute[72849]:  {{(pid=72849) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 15 16:12:21 user nova-compute[72849]: <domainCapabilities>
Aug 15 16:12:21 user nova-compute[72849]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 16:12:21 user nova-compute[72849]:   <domain>kvm</domain>
Aug 15 16:12:21 user nova-compute[72849]:   <machine>pc-q35-jammy</machine>
Aug 15 16:12:21 user nova-compute[72849]:   <arch>x86_64</arch>
Aug 15 16:12:21 user nova-compute[72849]:   <vcpu max='288'/>
Aug 15 16:12:21 user nova-compute[72849]:   <iothreads supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:   <os supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:     <enum name='firmware'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>efi</value>
Aug 15 16:12:21 user nova-compute[72849]:     </enum>
Aug 15 16:12:21 user nova-compute[72849]:     <loader supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='type'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>rom</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>pflash</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='readonly'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>yes</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>no</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='secure'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>yes</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>no</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </loader>
Aug 15 16:12:21 user nova-compute[72849]:   </os>
Aug 15 16:12:21 user nova-compute[72849]:   <cpu>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='host-passthrough' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='hostPassthroughMigratable'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>on</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>off</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='maximum' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='maximumMigratable'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>on</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>off</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='host-model' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <vendor>Intel</vendor>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ss'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='vmx'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='pcid'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='hypervisor'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='arat'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='umip'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='md-clear'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='stibp'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ssbd'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='invtsc'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ibpb'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ibrs'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='amd-stibp'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='rsba'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='erms'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='custom' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>qemu64</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>qemu32</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>phenom</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium3</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium2</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>n270</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>kvm64</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>kvm32</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>coreduo</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>core2duo</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>athlon</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Westmere</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Snowridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>SandyBridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Penryn</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G5</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G4</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G3</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G2</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Opteron_G1</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Nehalem</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>IvyBridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Icelake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-Rome</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-Milan</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Dhyana</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cooperlake</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Conroe</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>486</model>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:   </cpu>
Aug 15 16:12:21 user nova-compute[72849]:   <memoryBacking supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:     <enum name='sourceType'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>file</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>anonymous</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>memfd</value>
Aug 15 16:12:21 user nova-compute[72849]:     </enum>
Aug 15 16:12:21 user nova-compute[72849]:   </memoryBacking>
Aug 15 16:12:21 user nova-compute[72849]:   <devices>
Aug 15 16:12:21 user nova-compute[72849]:     <disk supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='diskDevice'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>disk</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>cdrom</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>floppy</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>lun</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='bus'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>fdc</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>scsi</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>usb</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>sata</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-non-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </disk>
Aug 15 16:12:21 user nova-compute[72849]:     <graphics supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='type'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>sdl</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vnc</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>spice</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>egl-headless</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </graphics>
Aug 15 16:12:21 user nova-compute[72849]:     <video supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='modelType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vga</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>cirrus</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vmvga</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>qxl</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>none</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>bochs</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>ramfb</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </video>
Aug 15 16:12:21 user nova-compute[72849]:     <hostdev supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='mode'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>subsystem</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='startupPolicy'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>default</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>mandatory</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>requisite</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>optional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='subsysType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>usb</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>pci</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>scsi</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='capsType'/>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='pciBackend'/>
Aug 15 16:12:21 user nova-compute[72849]:     </hostdev>
Aug 15 16:12:21 user nova-compute[72849]:     <rng supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-non-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='backendModel'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>random</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>egd</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>builtin</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </rng>
Aug 15 16:12:21 user nova-compute[72849]:     <filesystem supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='driverType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>path</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>handle</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtiofs</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </filesystem>
Aug 15 16:12:21 user nova-compute[72849]:     <tpm supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>tpm-tis</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>tpm-crb</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='backendModel'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>passthrough</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>emulator</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </tpm>
Aug 15 16:12:21 user nova-compute[72849]:   </devices>
Aug 15 16:12:21 user nova-compute[72849]:   <features>
Aug 15 16:12:21 user nova-compute[72849]:     <gic supported='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     <vmcoreinfo supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <genid supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <backingStoreInput supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <backup supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <sev supported='no'/>
Aug 15 16:12:21 user nova-compute[72849]:   </features>
Aug 15 16:12:21 user nova-compute[72849]: </domainCapabilities>
Aug 15 16:12:21 user nova-compute[72849]:  {{(pid=72849) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 15 16:12:21 user nova-compute[72849]: <domainCapabilities>
Aug 15 16:12:21 user nova-compute[72849]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 16:12:21 user nova-compute[72849]:   <domain>kvm</domain>
Aug 15 16:12:21 user nova-compute[72849]:   <machine>pc-i440fx-6.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:   <arch>x86_64</arch>
Aug 15 16:12:21 user nova-compute[72849]:   <vcpu max='255'/>
Aug 15 16:12:21 user nova-compute[72849]:   <iothreads supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:   <os supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:     <enum name='firmware'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>efi</value>
Aug 15 16:12:21 user nova-compute[72849]:     </enum>
Aug 15 16:12:21 user nova-compute[72849]:     <loader supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='type'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>rom</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>pflash</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='readonly'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>yes</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>no</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='secure'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>no</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </loader>
Aug 15 16:12:21 user nova-compute[72849]:   </os>
Aug 15 16:12:21 user nova-compute[72849]:   <cpu>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='host-passthrough' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='hostPassthroughMigratable'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>on</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>off</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='maximum' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='maximumMigratable'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>on</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>off</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='host-model' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <vendor>Intel</vendor>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ss'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='vmx'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='pcid'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='hypervisor'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='arat'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='umip'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='md-clear'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='stibp'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ssbd'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='invtsc'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ibpb'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ibrs'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='amd-stibp'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='rsba'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='erms'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='custom' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>qemu64</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>qemu32</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>phenom</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium3</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium2</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>n270</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>kvm64</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>kvm32</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>coreduo</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>core2duo</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>athlon</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Westmere</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Snowridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>SandyBridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Penryn</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G5</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G4</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G3</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G2</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Opteron_G1</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Nehalem</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>IvyBridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Icelake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-Rome</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-Milan</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Dhyana</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cooperlake</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Conroe</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>486</model>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:   </cpu>
Aug 15 16:12:21 user nova-compute[72849]:   <memoryBacking supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:     <enum name='sourceType'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>file</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>anonymous</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>memfd</value>
Aug 15 16:12:21 user nova-compute[72849]:     </enum>
Aug 15 16:12:21 user nova-compute[72849]:   </memoryBacking>
Aug 15 16:12:21 user nova-compute[72849]:   <devices>
Aug 15 16:12:21 user nova-compute[72849]:     <disk supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='diskDevice'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>disk</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>cdrom</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>floppy</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>lun</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='bus'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>ide</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>fdc</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>scsi</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>usb</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>sata</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-non-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </disk>
Aug 15 16:12:21 user nova-compute[72849]:     <graphics supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='type'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>sdl</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vnc</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>spice</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>egl-headless</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </graphics>
Aug 15 16:12:21 user nova-compute[72849]:     <video supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='modelType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vga</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>cirrus</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vmvga</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>qxl</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>none</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>bochs</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>ramfb</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </video>
Aug 15 16:12:21 user nova-compute[72849]:     <hostdev supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='mode'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>subsystem</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='startupPolicy'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>default</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>mandatory</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>requisite</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>optional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='subsysType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>usb</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>pci</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>scsi</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='capsType'/>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='pciBackend'/>
Aug 15 16:12:21 user nova-compute[72849]:     </hostdev>
Aug 15 16:12:21 user nova-compute[72849]:     <rng supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-non-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='backendModel'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>random</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>egd</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>builtin</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </rng>
Aug 15 16:12:21 user nova-compute[72849]:     <filesystem supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='driverType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>path</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>handle</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtiofs</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </filesystem>
Aug 15 16:12:21 user nova-compute[72849]:     <tpm supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>tpm-tis</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>tpm-crb</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='backendModel'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>passthrough</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>emulator</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </tpm>
Aug 15 16:12:21 user nova-compute[72849]:   </devices>
Aug 15 16:12:21 user nova-compute[72849]:   <features>
Aug 15 16:12:21 user nova-compute[72849]:     <gic supported='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     <vmcoreinfo supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <genid supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <backingStoreInput supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <backup supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <sev supported='no'/>
Aug 15 16:12:21 user nova-compute[72849]:   </features>
Aug 15 16:12:21 user nova-compute[72849]: </domainCapabilities>
Aug 15 16:12:21 user nova-compute[72849]:  {{(pid=72849) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 15 16:12:21 user nova-compute[72849]: <domainCapabilities>
Aug 15 16:12:21 user nova-compute[72849]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 16:12:21 user nova-compute[72849]:   <domain>kvm</domain>
Aug 15 16:12:21 user nova-compute[72849]:   <machine>pc-q35-6.2</machine>
Aug 15 16:12:21 user nova-compute[72849]:   <arch>x86_64</arch>
Aug 15 16:12:21 user nova-compute[72849]:   <vcpu max='288'/>
Aug 15 16:12:21 user nova-compute[72849]:   <iothreads supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:   <os supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:     <enum name='firmware'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>efi</value>
Aug 15 16:12:21 user nova-compute[72849]:     </enum>
Aug 15 16:12:21 user nova-compute[72849]:     <loader supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='type'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>rom</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>pflash</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='readonly'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>yes</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>no</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='secure'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>yes</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>no</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </loader>
Aug 15 16:12:21 user nova-compute[72849]:   </os>
Aug 15 16:12:21 user nova-compute[72849]:   <cpu>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='host-passthrough' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='hostPassthroughMigratable'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>on</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>off</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='maximum' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='maximumMigratable'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>on</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>off</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='host-model' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <vendor>Intel</vendor>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ss'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='vmx'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='pcid'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='hypervisor'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='arat'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='umip'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='md-clear'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='stibp'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ssbd'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='invtsc'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ibpb'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='ibrs'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='amd-stibp'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='rsba'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='erms'/>
Aug 15 16:12:21 user nova-compute[72849]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:     <mode name='custom' supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>qemu64</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>qemu32</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>phenom</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium3</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium2</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>pentium</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>n270</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>kvm64</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>kvm32</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>coreduo</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>core2duo</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>athlon</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Westmere</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Snowridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Skylake-Client</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>SandyBridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Penryn</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G5</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G4</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G3</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Opteron_G2</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Opteron_G1</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Nehalem</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>IvyBridge</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Icelake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Haswell</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-Rome</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-Milan</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>EPYC</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Dhyana</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cooperlake</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>Conroe</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='no'>Broadwell</model>
Aug 15 16:12:21 user nova-compute[72849]:       <model usable='yes'>486</model>
Aug 15 16:12:21 user nova-compute[72849]:     </mode>
Aug 15 16:12:21 user nova-compute[72849]:   </cpu>
Aug 15 16:12:21 user nova-compute[72849]:   <memoryBacking supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:     <enum name='sourceType'>
Aug 15 16:12:21 user nova-compute[72849]:       <value>file</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>anonymous</value>
Aug 15 16:12:21 user nova-compute[72849]:       <value>memfd</value>
Aug 15 16:12:21 user nova-compute[72849]:     </enum>
Aug 15 16:12:21 user nova-compute[72849]:   </memoryBacking>
Aug 15 16:12:21 user nova-compute[72849]:   <devices>
Aug 15 16:12:21 user nova-compute[72849]:     <disk supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='diskDevice'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>disk</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>cdrom</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>floppy</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>lun</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='bus'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>fdc</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>scsi</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>usb</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>sata</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-non-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </disk>
Aug 15 16:12:21 user nova-compute[72849]:     <graphics supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='type'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>sdl</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vnc</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>spice</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>egl-headless</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </graphics>
Aug 15 16:12:21 user nova-compute[72849]:     <video supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='modelType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vga</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>cirrus</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>vmvga</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>qxl</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>none</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>bochs</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>ramfb</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </video>
Aug 15 16:12:21 user nova-compute[72849]:     <hostdev supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='mode'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>subsystem</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='startupPolicy'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>default</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>mandatory</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>requisite</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>optional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='subsysType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>usb</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>pci</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>scsi</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='capsType'/>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='pciBackend'/>
Aug 15 16:12:21 user nova-compute[72849]:     </hostdev>
Aug 15 16:12:21 user nova-compute[72849]:     <rng supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtio-non-transitional</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='backendModel'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>random</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>egd</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>builtin</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </rng>
Aug 15 16:12:21 user nova-compute[72849]:     <filesystem supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='driverType'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>path</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>handle</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>virtiofs</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </filesystem>
Aug 15 16:12:21 user nova-compute[72849]:     <tpm supported='yes'>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='model'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>tpm-tis</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>tpm-crb</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:       <enum name='backendModel'>
Aug 15 16:12:21 user nova-compute[72849]:         <value>passthrough</value>
Aug 15 16:12:21 user nova-compute[72849]:         <value>emulator</value>
Aug 15 16:12:21 user nova-compute[72849]:       </enum>
Aug 15 16:12:21 user nova-compute[72849]:     </tpm>
Aug 15 16:12:21 user nova-compute[72849]:   </devices>
Aug 15 16:12:21 user nova-compute[72849]:   <features>
Aug 15 16:12:21 user nova-compute[72849]:     <gic supported='no'/>
Aug 15 16:12:21 user nova-compute[72849]:     <vmcoreinfo supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <genid supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <backingStoreInput supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <backup supported='yes'/>
Aug 15 16:12:21 user nova-compute[72849]:     <sev supported='no'/>
Aug 15 16:12:21 user nova-compute[72849]:   </features>
Aug 15 16:12:21 user nova-compute[72849]: </domainCapabilities>
Aug 15 16:12:21 user nova-compute[72849]:  {{(pid=72849) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72849) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72849) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Checking secure boot support for host arch (x86_64) {{(pid=72849) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Checking secure boot support for host arch (x86_64) {{(pid=72849) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Checking secure boot support for host arch (x86_64) {{(pid=72849) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 16:12:21 user nova-compute[72849]: INFO nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Secure Boot support detected
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] cpu compare xml: <cpu match="exact">
Aug 15 16:12:21 user nova-compute[72849]:   <model>Nehalem</model>
Aug 15 16:12:21 user nova-compute[72849]: </cpu>
Aug 15 16:12:21 user nova-compute[72849]:  {{(pid=72849) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 15 16:12:21 user nova-compute[72849]: INFO nova.virt.node [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Generated node identity 2d8a3c24-a12f-4e34-9906-d3707a50726d
Aug 15 16:12:21 user nova-compute[72849]: INFO nova.virt.node [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Wrote node identity 2d8a3c24-a12f-4e34-9906-d3707a50726d to /opt/stack/data/nova/compute_id
Aug 15 16:12:21 user nova-compute[72849]: WARNING nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Compute nodes ['2d8a3c24-a12f-4e34-9906-d3707a50726d'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 15 16:12:21 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 15 16:12:21 user nova-compute[72849]: WARNING nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 15 16:12:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:12:21 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:12:21 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Hypervisor/Node resource view: name=user free_ram=10893MB free_disk=26.306865692138672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:12:21 user nova-compute[72849]: WARNING nova.compute.resource_tracker [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] No compute node record for user:2d8a3c24-a12f-4e34-9906-d3707a50726d: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 2d8a3c24-a12f-4e34-9906-d3707a50726d could not be found.
Aug 15 16:12:21 user nova-compute[72849]: INFO nova.compute.resource_tracker [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Compute node record created for user:user with uuid: 2d8a3c24-a12f-4e34-9906-d3707a50726d
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:12:21 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:12:22 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [req-c717f85d-f2fb-48f4-b556-deb4fbffaabe] Created resource provider record via placement API for resource provider with UUID 2d8a3c24-a12f-4e34-9906-d3707a50726d and name user.
Aug 15 16:12:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72849) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 15 16:12:22 user nova-compute[72849]: INFO nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] kernel doesn't support AMD SEV
Aug 15 16:12:22 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Updating inventory in ProviderTree for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 16:12:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:12:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Libvirt baseline CPU <cpu>
Aug 15 16:12:22 user nova-compute[72849]:   <arch>x86_64</arch>
Aug 15 16:12:22 user nova-compute[72849]:   <model>Nehalem</model>
Aug 15 16:12:22 user nova-compute[72849]:   <vendor>Intel</vendor>
Aug 15 16:12:22 user nova-compute[72849]:   <topology sockets="6" cores="1" threads="1"/>
Aug 15 16:12:22 user nova-compute[72849]: </cpu>
Aug 15 16:12:22 user nova-compute[72849]:  {{(pid=72849) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 15 16:12:22 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Updated inventory for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 15 16:12:22 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Updating resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d generation from 0 to 1 during operation: update_inventory {{(pid=72849) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 15 16:12:22 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Updating inventory in ProviderTree for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 16:12:22 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Updating resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d generation from 1 to 2 during operation: update_traits {{(pid=72849) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 15 16:12:22 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:12:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.617s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:12:22 user nova-compute[72849]: DEBUG nova.service [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Creating RPC server for service compute {{(pid=72849) start /opt/stack/nova/nova/service.py:182}}
Aug 15 16:12:22 user nova-compute[72849]: DEBUG nova.service [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Join ServiceGroup membership for this service compute {{(pid=72849) start /opt/stack/nova/nova/service.py:199}}
Aug 15 16:12:22 user nova-compute[72849]: DEBUG nova.servicegroup.drivers.db [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72849) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 15 16:12:35 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:12:35 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Didn't find any instances for network info cache update. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:13:13 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:13:13 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:13:13 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=10255MB free_disk=26.210586547851562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:13:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:14:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:14:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:14:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:14:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:14:14 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:14:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:14:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:14:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Didn't find any instances for network info cache update. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 16:14:14 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:14:14 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:14:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:14:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:14:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:14:14 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:14:14 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:14:14 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:14:14 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=10237MB free_disk=26.259437561035156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:14:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:14:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:14:14 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:14:14 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:14:14 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:14:14 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:14:14 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:14:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.097s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:14:15 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:14:15 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:14:15 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:14:15 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:15:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:15:14 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:15:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:15:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:15:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Didn't find any instances for network info cache update. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 16:15:14 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:15:15 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:15:15 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:15:16 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:15:16 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:15:16 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:15:16 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:15:16 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:15:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:15:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:15:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:15:16 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:15:16 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:15:16 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:15:16 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=10245MB free_disk=26.040889739990234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:15:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:15:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:15:16 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:15:16 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:15:16 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:15:16 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:15:16 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:15:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:14 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:16:15 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Didn't find any instances for network info cache update. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:16:16 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:16:16 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:16:16 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=9427MB free_disk=26.063953399658203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:16:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:17 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:16:17 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:16:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:16:18 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:16:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:16:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:26 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:16:26 user nova-compute[72849]: INFO nova.compute.claims [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Claim successful on node user
Aug 15 16:16:26 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:16:26 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:16:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:16:27 user nova-compute[72849]: DEBUG nova.compute.manager [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:16:27 user nova-compute[72849]: DEBUG nova.network.neutron [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:16:27 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:16:27 user nova-compute[72849]: DEBUG nova.compute.manager [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:16:27 user nova-compute[72849]: DEBUG nova.compute.manager [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:16:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:16:27 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Creating image(s)
Aug 15 16:16:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "/opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "/opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "/opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:27 user nova-compute[72849]: DEBUG nova.policy [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd6279423b7f43c4aac7956aec43efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51f800c0ca74e149a2f8ed9718b221f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:16:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374.part --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374.part --force-share --output=json" returned: 0 in 0.178s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:28 user nova-compute[72849]: DEBUG nova.virt.images [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] 59265a51-1c51-4986-ae25-4fec6807c20c was qcow2, converting to raw {{(pid=72849) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 16:16:28 user nova-compute[72849]: DEBUG nova.privsep.utils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72849) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 16:16:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374.part /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374.converted {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "388aa265-fc0a-4928-935e-5e04e65199f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "388aa265-fc0a-4928-935e-5e04e65199f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:16:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374.part /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374.converted" returned: 0 in 0.256s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374.converted --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:29 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:16:29 user nova-compute[72849]: INFO nova.compute.claims [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Claim successful on node user
Aug 15 16:16:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374.converted --force-share --output=json" returned: 0 in 0.224s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.902s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:29 user nova-compute[72849]: INFO oslo.privsep.daemon [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpx28_nu5u/privsep.sock']
Aug 15 16:16:29 user sudo[82083]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpx28_nu5u/privsep.sock
Aug 15 16:16:29 user sudo[82083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 16:16:29 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:16:29 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:16:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:29 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:16:29 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:16:29 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:16:29 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:16:29 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:16:29 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:16:29 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:16:29 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Creating image(s)
Aug 15 16:16:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "/opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "/opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "/opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:29 user nova-compute[72849]: DEBUG nova.policy [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60cbe30799ad4438b84251a254691b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a3a3412c95451db4dd0edc27f361cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:16:31 user sudo[82083]: pam_unix(sudo:session): session closed for user root
Aug 15 16:16:31 user nova-compute[72849]: INFO oslo.privsep.daemon [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Spawned new privsep daemon via rootwrap
Aug 15 16:16:31 user nova-compute[72849]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 16:16:31 user nova-compute[72849]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 16:16:31 user nova-compute[72849]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 15 16:16:31 user nova-compute[72849]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82086
Aug 15 16:16:31 user nova-compute[72849]: WARNING oslo_privsep.priv_context [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] privsep daemon already running
Aug 15 16:16:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:31 user nova-compute[72849]: DEBUG nova.network.neutron [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Successfully created port: 88628ea8-908b-47c2-bdfd-6e8525d88c0b {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:16:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.223s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.236s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.231s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk 1073741824" returned: 0 in 0.052s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.270s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.217s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:31 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:16:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Cannot resize image /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG nova.objects.instance [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'migration_context' on Instance uuid 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Ensure instance console log exists: /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.390s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk 1073741824" returned: 0 in 0.051s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.445s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.169s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Cannot resize image /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG nova.objects.instance [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'migration_context' on Instance uuid 388aa265-fc0a-4928-935e-5e04e65199f6 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Ensure instance console log exists: /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:33 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Successfully created port: 1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:16:33 user nova-compute[72849]: DEBUG nova.network.neutron [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Successfully updated port: 88628ea8-908b-47c2-bdfd-6e8525d88c0b {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:16:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "refresh_cache-56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:16:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquired lock "refresh_cache-56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:16:33 user nova-compute[72849]: DEBUG nova.network.neutron [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:16:33 user nova-compute[72849]: DEBUG nova.network.neutron [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:16:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-1ce9e7b1-11a4-4512-bf52-36bcd4277919 req-9c0c7d35-6ed5-4169-a860-f70405a71861 service nova] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Received event network-changed-88628ea8-908b-47c2-bdfd-6e8525d88c0b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:16:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-1ce9e7b1-11a4-4512-bf52-36bcd4277919 req-9c0c7d35-6ed5-4169-a860-f70405a71861 service nova] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Refreshing instance network info cache due to event network-changed-88628ea8-908b-47c2-bdfd-6e8525d88c0b. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:16:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1ce9e7b1-11a4-4512-bf52-36bcd4277919 req-9c0c7d35-6ed5-4169-a860-f70405a71861 service nova] Acquiring lock "refresh_cache-56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.network.neutron [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Updating instance_info_cache with network_info: [{"id": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "address": "fa:16:3e:18:f5:fe", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88628ea8-90", "ovs_interfaceid": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Releasing lock "refresh_cache-56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Instance network_info: |[{"id": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "address": "fa:16:3e:18:f5:fe", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88628ea8-90", "ovs_interfaceid": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1ce9e7b1-11a4-4512-bf52-36bcd4277919 req-9c0c7d35-6ed5-4169-a860-f70405a71861 service nova] Acquired lock "refresh_cache-56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.network.neutron [req-1ce9e7b1-11a4-4512-bf52-36bcd4277919 req-9c0c7d35-6ed5-4169-a860-f70405a71861 service nova] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Refreshing network info cache for port 88628ea8-908b-47c2-bdfd-6e8525d88c0b {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Start _get_guest_xml network_info=[{"id": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "address": "fa:16:3e:18:f5:fe", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88628ea8-90", "ovs_interfaceid": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:16:35 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:16:35 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.privsep.utils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72849) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-256210150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-256210150',id=1,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f51f800c0ca74e149a2f8ed9718b221f',ramdisk_id='',reservation_id='r-2nxyf40q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:16:27Z,user_data=None,user_id='cd6279423b7f43c4aac7956aec43efdd',uuid=56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "address": "fa:16:3e:18:f5:fe", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88628ea8-90", "ovs_interfaceid": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converting VIF {"id": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "address": "fa:16:3e:18:f5:fe", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88628ea8-90", "ovs_interfaceid": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:f5:fe,bridge_name='br-int',has_traffic_filtering=True,id=88628ea8-908b-47c2-bdfd-6e8525d88c0b,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88628ea8-90') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.objects.instance [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'pci_devices' on Instance uuid 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:16:35 user nova-compute[72849]:   <uuid>56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d</uuid>
Aug 15 16:16:35 user nova-compute[72849]:   <name>instance-00000001</name>
Aug 15 16:16:35 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:16:35 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:16:35 user nova-compute[72849]:   <metadata>
Aug 15 16:16:35 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:16:35 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:16:35 user nova-compute[72849]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-256210150</nova:name>
Aug 15 16:16:35 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:16:35</nova:creationTime>
Aug 15 16:16:35 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:16:35 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:16:35 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:16:35 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:16:35 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:16:35 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:16:35 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:16:35 user nova-compute[72849]:       <nova:owner>
Aug 15 16:16:35 user nova-compute[72849]:         <nova:user uuid="cd6279423b7f43c4aac7956aec43efdd">tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member</nova:user>
Aug 15 16:16:35 user nova-compute[72849]:         <nova:project uuid="f51f800c0ca74e149a2f8ed9718b221f">tempest-ServerBootFromVolumeStableRescueTest-1207284584</nova:project>
Aug 15 16:16:35 user nova-compute[72849]:       </nova:owner>
Aug 15 16:16:35 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:16:35 user nova-compute[72849]:       <nova:ports>
Aug 15 16:16:35 user nova-compute[72849]:         <nova:port uuid="88628ea8-908b-47c2-bdfd-6e8525d88c0b">
Aug 15 16:16:35 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 16:16:35 user nova-compute[72849]:         </nova:port>
Aug 15 16:16:35 user nova-compute[72849]:       </nova:ports>
Aug 15 16:16:35 user nova-compute[72849]:     </nova:instance>
Aug 15 16:16:35 user nova-compute[72849]:   </metadata>
Aug 15 16:16:35 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:16:35 user nova-compute[72849]:     <system>
Aug 15 16:16:35 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:16:35 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:16:35 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:16:35 user nova-compute[72849]:       <entry name="serial">56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d</entry>
Aug 15 16:16:35 user nova-compute[72849]:       <entry name="uuid">56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d</entry>
Aug 15 16:16:35 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:16:35 user nova-compute[72849]:     </system>
Aug 15 16:16:35 user nova-compute[72849]:   </sysinfo>
Aug 15 16:16:35 user nova-compute[72849]:   <os>
Aug 15 16:16:35 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:16:35 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:16:35 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:16:35 user nova-compute[72849]:   </os>
Aug 15 16:16:35 user nova-compute[72849]:   <features>
Aug 15 16:16:35 user nova-compute[72849]:     <acpi/>
Aug 15 16:16:35 user nova-compute[72849]:     <apic/>
Aug 15 16:16:35 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:16:35 user nova-compute[72849]:   </features>
Aug 15 16:16:35 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:16:35 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:16:35 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:16:35 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:16:35 user nova-compute[72849]:   </clock>
Aug 15 16:16:35 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:16:35 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:16:35 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:16:35 user nova-compute[72849]:   </cpu>
Aug 15 16:16:35 user nova-compute[72849]:   <devices>
Aug 15 16:16:35 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:16:35 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:16:35 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk"/>
Aug 15 16:16:35 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:16:35 user nova-compute[72849]:     </disk>
Aug 15 16:16:35 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:16:35 user nova-compute[72849]:       <mac address="fa:16:3e:18:f5:fe"/>
Aug 15 16:16:35 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:16:35 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:16:35 user nova-compute[72849]:       <target dev="tap88628ea8-90"/>
Aug 15 16:16:35 user nova-compute[72849]:     </interface>
Aug 15 16:16:35 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:16:35 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/console.log" append="off"/>
Aug 15 16:16:35 user nova-compute[72849]:     </serial>
Aug 15 16:16:35 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:16:35 user nova-compute[72849]:     <video>
Aug 15 16:16:35 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:16:35 user nova-compute[72849]:     </video>
Aug 15 16:16:35 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:16:35 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:16:35 user nova-compute[72849]:     </rng>
Aug 15 16:16:35 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:16:35 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:16:35 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:16:35 user nova-compute[72849]:     </memballoon>
Aug 15 16:16:35 user nova-compute[72849]:   </devices>
Aug 15 16:16:35 user nova-compute[72849]: </domain>
Aug 15 16:16:35 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-256210150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-256210150',id=1,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f51f800c0ca74e149a2f8ed9718b221f',ramdisk_id='',reservation_id='r-2nxyf40q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:16:27Z,user_data=None,user_id='cd6279423b7f43c4aac7956aec43efdd',uuid=56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "address": "fa:16:3e:18:f5:fe", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88628ea8-90", "ovs_interfaceid": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converting VIF {"id": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "address": "fa:16:3e:18:f5:fe", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88628ea8-90", "ovs_interfaceid": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:f5:fe,bridge_name='br-int',has_traffic_filtering=True,id=88628ea8-908b-47c2-bdfd-6e8525d88c0b,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88628ea8-90') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG os_vif [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:f5:fe,bridge_name='br-int',has_traffic_filtering=True,id=88628ea8-908b-47c2-bdfd-6e8525d88c0b,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88628ea8-90') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Created schema index Interface.name {{(pid=72849) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Created schema index Port.name {{(pid=72849) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Created schema index Bridge.name {{(pid=72849) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [POLLOUT] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:16:35 user nova-compute[72849]: INFO nova.compute.claims [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Claim successful on node user
Aug 15 16:16:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:16:35 user nova-compute[72849]: INFO oslo.privsep.daemon [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp9y1hlq3t/privsep.sock']
Aug 15 16:16:35 user sudo[82129]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp9y1hlq3t/privsep.sock
Aug 15 16:16:35 user sudo[82129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.network.neutron [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:16:35 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:16:35 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Creating image(s)
Aug 15 16:16:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "/opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "/opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.162s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.162s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk 1073741824" returned: 0 in 0.049s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG nova.policy [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90af38c3a2a64683a12871bb2a5e0a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b16b734f348e4d9ca7faba1f84f188a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.186s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Cannot resize image /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG nova.objects.instance [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lazy-loading 'migration_context' on Instance uuid b0a869eb-9ee8-4c31-9786-5b8be7d362a9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Ensure instance console log exists: /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Successfully updated port: 1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquired lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:16:36 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG nova.compute.manager [req-4e819bd9-467e-4854-984d-60549b7bfe0c req-82c1d43f-062e-4943-9830-5cfa35af9b68 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received event network-changed-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG nova.compute.manager [req-4e819bd9-467e-4854-984d-60549b7bfe0c req-82c1d43f-062e-4943-9830-5cfa35af9b68 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Refreshing instance network info cache due to event network-changed-1b0d74bc-a28a-4a88-80b2-377fc19f2c30. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4e819bd9-467e-4854-984d-60549b7bfe0c req-82c1d43f-062e-4943-9830-5cfa35af9b68 service nova] Acquiring lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:16:37 user sudo[82129]: pam_unix(sudo:session): session closed for user root
Aug 15 16:16:37 user nova-compute[72849]: INFO oslo.privsep.daemon [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Spawned new privsep daemon via rootwrap
Aug 15 16:16:37 user nova-compute[72849]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 16:16:37 user nova-compute[72849]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 16:16:37 user nova-compute[72849]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 15 16:16:37 user nova-compute[72849]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82201
Aug 15 16:16:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG nova.compute.manager [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG nova.network.neutron [req-1ce9e7b1-11a4-4512-bf52-36bcd4277919 req-9c0c7d35-6ed5-4169-a860-f70405a71861 service nova] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Updated VIF entry in instance network info cache for port 88628ea8-908b-47c2-bdfd-6e8525d88c0b. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG nova.network.neutron [req-1ce9e7b1-11a4-4512-bf52-36bcd4277919 req-9c0c7d35-6ed5-4169-a860-f70405a71861 service nova] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Updating instance_info_cache with network_info: [{"id": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "address": "fa:16:3e:18:f5:fe", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88628ea8-90", "ovs_interfaceid": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1ce9e7b1-11a4-4512-bf52-36bcd4277919 req-9c0c7d35-6ed5-4169-a860-f70405a71861 service nova] Releasing lock "refresh_cache-56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:16:37 user nova-compute[72849]: INFO nova.compute.claims [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Claim successful on node user
Aug 15 16:16:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88628ea8-90, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88628ea8-90, col_values=(('external_ids', {'iface-id': '88628ea8-908b-47c2-bdfd-6e8525d88c0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:f5:fe', 'vm-uuid': '56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:37 user nova-compute[72849]: INFO os_vif [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:f5:fe,bridge_name='br-int',has_traffic_filtering=True,id=88628ea8-908b-47c2-bdfd-6e8525d88c0b,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88628ea8-90')
Aug 15 16:16:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] No VIF found with MAC fa:16:3e:18:f5:fe, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG nova.compute.manager [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Updating instance_info_cache with network_info: [{"id": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "address": "fa:16:3e:15:be:6e", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d74bc-a2", "ovs_interfaceid": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Releasing lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Instance network_info: |[{"id": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "address": "fa:16:3e:15:be:6e", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d74bc-a2", "ovs_interfaceid": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4e819bd9-467e-4854-984d-60549b7bfe0c req-82c1d43f-062e-4943-9830-5cfa35af9b68 service nova] Acquired lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG nova.network.neutron [req-4e819bd9-467e-4854-984d-60549b7bfe0c req-82c1d43f-062e-4943-9830-5cfa35af9b68 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Refreshing network info cache for port 1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Start _get_guest_xml network_info=[{"id": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "address": "fa:16:3e:15:be:6e", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d74bc-a2", "ovs_interfaceid": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG nova.compute.manager [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:16:37 user nova-compute[72849]: DEBUG nova.network.neutron [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:16:37 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:16:37 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:16:37 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2125106153',display_name='tempest-ServerActionsTestOtherA-server-2125106153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2125106153',id=2,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFz77lNADA9bIEqsG+/0pmqytVknVJgn2QYVHLyikCb7OZcHj5oDk3lRMMWld0kQEG++u8j1QCo1UgVUz17EVZQY5cNigvtxWp2mZweLxgKV8OVoFjr81Ihq1bC8gLICA==',key_name='tempest-keypair-669870558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33a3a3412c95451db4dd0edc27f361cc',ramdisk_id='',reservation_id='r-hnpg3jas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-514064593',owner_user_name='tempest-ServerActionsTestOtherA-514064593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:16:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60cbe30799ad4438b84251a254691b70',uuid=388aa265-fc0a-4928-935e-5e04e65199f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "address": "fa:16:3e:15:be:6e", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d74bc-a2", "ovs_interfaceid": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converting VIF {"id": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "address": "fa:16:3e:15:be:6e", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d74bc-a2", "ovs_interfaceid": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:be:6e,bridge_name='br-int',has_traffic_filtering=True,id=1b0d74bc-a28a-4a88-80b2-377fc19f2c30,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0d74bc-a2') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.objects.instance [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'pci_devices' on Instance uuid 388aa265-fc0a-4928-935e-5e04e65199f6 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:16:38 user nova-compute[72849]:   <uuid>388aa265-fc0a-4928-935e-5e04e65199f6</uuid>
Aug 15 16:16:38 user nova-compute[72849]:   <name>instance-00000002</name>
Aug 15 16:16:38 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:16:38 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:16:38 user nova-compute[72849]:   <metadata>
Aug 15 16:16:38 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:16:38 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:16:38 user nova-compute[72849]:       <nova:name>tempest-ServerActionsTestOtherA-server-2125106153</nova:name>
Aug 15 16:16:38 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:16:37</nova:creationTime>
Aug 15 16:16:38 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:16:38 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:16:38 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:16:38 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:16:38 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:16:38 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:16:38 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:16:38 user nova-compute[72849]:       <nova:owner>
Aug 15 16:16:38 user nova-compute[72849]:         <nova:user uuid="60cbe30799ad4438b84251a254691b70">tempest-ServerActionsTestOtherA-514064593-project-member</nova:user>
Aug 15 16:16:38 user nova-compute[72849]:         <nova:project uuid="33a3a3412c95451db4dd0edc27f361cc">tempest-ServerActionsTestOtherA-514064593</nova:project>
Aug 15 16:16:38 user nova-compute[72849]:       </nova:owner>
Aug 15 16:16:38 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:16:38 user nova-compute[72849]:       <nova:ports>
Aug 15 16:16:38 user nova-compute[72849]:         <nova:port uuid="1b0d74bc-a28a-4a88-80b2-377fc19f2c30">
Aug 15 16:16:38 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 16:16:38 user nova-compute[72849]:         </nova:port>
Aug 15 16:16:38 user nova-compute[72849]:       </nova:ports>
Aug 15 16:16:38 user nova-compute[72849]:     </nova:instance>
Aug 15 16:16:38 user nova-compute[72849]:   </metadata>
Aug 15 16:16:38 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:16:38 user nova-compute[72849]:     <system>
Aug 15 16:16:38 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:16:38 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:16:38 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:16:38 user nova-compute[72849]:       <entry name="serial">388aa265-fc0a-4928-935e-5e04e65199f6</entry>
Aug 15 16:16:38 user nova-compute[72849]:       <entry name="uuid">388aa265-fc0a-4928-935e-5e04e65199f6</entry>
Aug 15 16:16:38 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:16:38 user nova-compute[72849]:     </system>
Aug 15 16:16:38 user nova-compute[72849]:   </sysinfo>
Aug 15 16:16:38 user nova-compute[72849]:   <os>
Aug 15 16:16:38 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:16:38 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:16:38 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:16:38 user nova-compute[72849]:   </os>
Aug 15 16:16:38 user nova-compute[72849]:   <features>
Aug 15 16:16:38 user nova-compute[72849]:     <acpi/>
Aug 15 16:16:38 user nova-compute[72849]:     <apic/>
Aug 15 16:16:38 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:16:38 user nova-compute[72849]:   </features>
Aug 15 16:16:38 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:16:38 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:16:38 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:16:38 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:16:38 user nova-compute[72849]:   </clock>
Aug 15 16:16:38 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:16:38 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:16:38 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:16:38 user nova-compute[72849]:   </cpu>
Aug 15 16:16:38 user nova-compute[72849]:   <devices>
Aug 15 16:16:38 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:16:38 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:16:38 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk"/>
Aug 15 16:16:38 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:16:38 user nova-compute[72849]:     </disk>
Aug 15 16:16:38 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:16:38 user nova-compute[72849]:       <mac address="fa:16:3e:15:be:6e"/>
Aug 15 16:16:38 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:16:38 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:16:38 user nova-compute[72849]:       <target dev="tap1b0d74bc-a2"/>
Aug 15 16:16:38 user nova-compute[72849]:     </interface>
Aug 15 16:16:38 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:16:38 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/console.log" append="off"/>
Aug 15 16:16:38 user nova-compute[72849]:     </serial>
Aug 15 16:16:38 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:16:38 user nova-compute[72849]:     <video>
Aug 15 16:16:38 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:16:38 user nova-compute[72849]:     </video>
Aug 15 16:16:38 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:16:38 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:16:38 user nova-compute[72849]:     </rng>
Aug 15 16:16:38 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:16:38 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:16:38 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:16:38 user nova-compute[72849]:     </memballoon>
Aug 15 16:16:38 user nova-compute[72849]:   </devices>
Aug 15 16:16:38 user nova-compute[72849]: </domain>
Aug 15 16:16:38 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2125106153',display_name='tempest-ServerActionsTestOtherA-server-2125106153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2125106153',id=2,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFz77lNADA9bIEqsG+/0pmqytVknVJgn2QYVHLyikCb7OZcHj5oDk3lRMMWld0kQEG++u8j1QCo1UgVUz17EVZQY5cNigvtxWp2mZweLxgKV8OVoFjr81Ihq1bC8gLICA==',key_name='tempest-keypair-669870558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33a3a3412c95451db4dd0edc27f361cc',ramdisk_id='',reservation_id='r-hnpg3jas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-514064593',owner_user_name='tempest-ServerActionsTestOtherA-514064593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:16:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60cbe30799ad4438b84251a254691b70',uuid=388aa265-fc0a-4928-935e-5e04e65199f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "address": "fa:16:3e:15:be:6e", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d74bc-a2", "ovs_interfaceid": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converting VIF {"id": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "address": "fa:16:3e:15:be:6e", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d74bc-a2", "ovs_interfaceid": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:be:6e,bridge_name='br-int',has_traffic_filtering=True,id=1b0d74bc-a28a-4a88-80b2-377fc19f2c30,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0d74bc-a2') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG os_vif [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:be:6e,bridge_name='br-int',has_traffic_filtering=True,id=1b0d74bc-a28a-4a88-80b2-377fc19f2c30,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0d74bc-a2') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b0d74bc-a2, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1b0d74bc-a2, col_values=(('external_ids', {'iface-id': '1b0d74bc-a28a-4a88-80b2-377fc19f2c30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:be:6e', 'vm-uuid': '388aa265-fc0a-4928-935e-5e04e65199f6'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:38 user nova-compute[72849]: INFO os_vif [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:be:6e,bridge_name='br-int',has_traffic_filtering=True,id=1b0d74bc-a28a-4a88-80b2-377fc19f2c30,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0d74bc-a2')
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] No VIF found with MAC fa:16:3e:15:be:6e, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:16:38 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Creating image(s)
Aug 15 16:16:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "/opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "/opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.192s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.184s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.policy [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0ab3fef694144f39a31c1a17c854bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f8316b45f4418583171fa8691dfe66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk 1073741824" returned: 0 in 0.043s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.173s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:16:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:39 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Cannot resize image /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:16:39 user nova-compute[72849]: DEBUG nova.objects.instance [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lazy-loading 'migration_context' on Instance uuid 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:16:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:16:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Ensure instance console log exists: /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:16:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-4e819bd9-467e-4854-984d-60549b7bfe0c req-82c1d43f-062e-4943-9830-5cfa35af9b68 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Updated VIF entry in instance network info cache for port 1b0d74bc-a28a-4a88-80b2-377fc19f2c30. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:16:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-4e819bd9-467e-4854-984d-60549b7bfe0c req-82c1d43f-062e-4943-9830-5cfa35af9b68 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Updating instance_info_cache with network_info: [{"id": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "address": "fa:16:3e:15:be:6e", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d74bc-a2", "ovs_interfaceid": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:16:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4e819bd9-467e-4854-984d-60549b7bfe0c req-82c1d43f-062e-4943-9830-5cfa35af9b68 service nova] Releasing lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:16:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:40 user nova-compute[72849]: DEBUG nova.network.neutron [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Successfully created port: 25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:16:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:41 user nova-compute[72849]: DEBUG nova.network.neutron [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Successfully created port: fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116202.291945, 388aa265-fc0a-4928-935e-5e04e65199f6 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:16:42 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] VM Resumed (Lifecycle Event)
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:16:42 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Instance spawned successfully.
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:16:42 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Instance spawned successfully.
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:16:42 user nova-compute[72849]: INFO nova.compute.manager [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Took 12.86 seconds to spawn the instance on the hypervisor.
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:42 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116202.292317, 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:16:42 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] VM Resumed (Lifecycle Event)
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:16:42 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116202.29249, 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:16:42 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] VM Started (Lifecycle Event)
Aug 15 16:16:42 user nova-compute[72849]: INFO nova.compute.manager [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Took 15.50 seconds to spawn the instance on the hypervisor.
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:16:42 user nova-compute[72849]: INFO nova.compute.manager [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Took 13.81 seconds to build instance.
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:16:42 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116202.2926178, 388aa265-fc0a-4928-935e-5e04e65199f6 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:16:42 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] VM Started (Lifecycle Event)
Aug 15 16:16:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c9c6a122-97e2-4ace-af95-e1295a84dc7e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "388aa265-fc0a-4928-935e-5e04e65199f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.030s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:42 user nova-compute[72849]: INFO nova.compute.manager [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Took 16.33 seconds to build instance.
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:16:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-10a4181c-9af3-4150-a791-8df7de0a3d88 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.688s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:43 user nova-compute[72849]: DEBUG nova.network.neutron [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Successfully updated port: 25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:16:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:16:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquired lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:16:43 user nova-compute[72849]: DEBUG nova.network.neutron [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:16:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-d38ed8b3-2654-470a-a393-b0ea4e541656 req-53f104c0-0e99-41b2-b916-8ee70cfa6474 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received event network-changed-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:16:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-d38ed8b3-2654-470a-a393-b0ea4e541656 req-53f104c0-0e99-41b2-b916-8ee70cfa6474 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Refreshing instance network info cache due to event network-changed-25a67315-9859-4077-8f36-23635b760770. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:16:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d38ed8b3-2654-470a-a393-b0ea4e541656 req-53f104c0-0e99-41b2-b916-8ee70cfa6474 service nova] Acquiring lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:16:43 user nova-compute[72849]: DEBUG nova.network.neutron [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.network.neutron [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updating instance_info_cache with network_info: [{"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Releasing lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Instance network_info: |[{"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d38ed8b3-2654-470a-a393-b0ea4e541656 req-53f104c0-0e99-41b2-b916-8ee70cfa6474 service nova] Acquired lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.network.neutron [req-d38ed8b3-2654-470a-a393-b0ea4e541656 req-53f104c0-0e99-41b2-b916-8ee70cfa6474 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Refreshing network info cache for port 25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Start _get_guest_xml network_info=[{"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:16:44 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:16:44 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1690114442',display_name='tempest-ServerActionsTestOtherB-server-1690114442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1690114442',id=3,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+hh3mOCKtCImu1/lg7z7Mltoc1di1aJCPq0550JQzfICBVP48YFxiWhHNSQqhuSWVzxUKF+hNAtXneGjvrY/qA0OutpYd9sLJegliqP2OTf5sqdDZP815XUZAuWEPAcQ==',key_name='tempest-keypair-493994408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b16b734f348e4d9ca7faba1f84f188a8',ramdisk_id='',reservation_id='r-43bap4gi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1970367935',owner_user_name='tempest-ServerActionsTestOtherB-1970367935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:16:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90af38c3a2a64683a12871bb2a5e0a0f',uuid=b0a869eb-9ee8-4c31-9786-5b8be7d362a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Converting VIF {"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.objects.instance [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lazy-loading 'pci_devices' on Instance uuid b0a869eb-9ee8-4c31-9786-5b8be7d362a9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.network.neutron [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Successfully updated port: fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:16:44 user nova-compute[72849]:   <uuid>b0a869eb-9ee8-4c31-9786-5b8be7d362a9</uuid>
Aug 15 16:16:44 user nova-compute[72849]:   <name>instance-00000003</name>
Aug 15 16:16:44 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:16:44 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:16:44 user nova-compute[72849]:   <metadata>
Aug 15 16:16:44 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:16:44 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:16:44 user nova-compute[72849]:       <nova:name>tempest-ServerActionsTestOtherB-server-1690114442</nova:name>
Aug 15 16:16:44 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:16:44</nova:creationTime>
Aug 15 16:16:44 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:16:44 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:16:44 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:16:44 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:16:44 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:16:44 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:16:44 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:16:44 user nova-compute[72849]:       <nova:owner>
Aug 15 16:16:44 user nova-compute[72849]:         <nova:user uuid="90af38c3a2a64683a12871bb2a5e0a0f">tempest-ServerActionsTestOtherB-1970367935-project-member</nova:user>
Aug 15 16:16:44 user nova-compute[72849]:         <nova:project uuid="b16b734f348e4d9ca7faba1f84f188a8">tempest-ServerActionsTestOtherB-1970367935</nova:project>
Aug 15 16:16:44 user nova-compute[72849]:       </nova:owner>
Aug 15 16:16:44 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:16:44 user nova-compute[72849]:       <nova:ports>
Aug 15 16:16:44 user nova-compute[72849]:         <nova:port uuid="25a67315-9859-4077-8f36-23635b760770">
Aug 15 16:16:44 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 16:16:44 user nova-compute[72849]:         </nova:port>
Aug 15 16:16:44 user nova-compute[72849]:       </nova:ports>
Aug 15 16:16:44 user nova-compute[72849]:     </nova:instance>
Aug 15 16:16:44 user nova-compute[72849]:   </metadata>
Aug 15 16:16:44 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:16:44 user nova-compute[72849]:     <system>
Aug 15 16:16:44 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:16:44 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:16:44 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:16:44 user nova-compute[72849]:       <entry name="serial">b0a869eb-9ee8-4c31-9786-5b8be7d362a9</entry>
Aug 15 16:16:44 user nova-compute[72849]:       <entry name="uuid">b0a869eb-9ee8-4c31-9786-5b8be7d362a9</entry>
Aug 15 16:16:44 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:16:44 user nova-compute[72849]:     </system>
Aug 15 16:16:44 user nova-compute[72849]:   </sysinfo>
Aug 15 16:16:44 user nova-compute[72849]:   <os>
Aug 15 16:16:44 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:16:44 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:16:44 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:16:44 user nova-compute[72849]:   </os>
Aug 15 16:16:44 user nova-compute[72849]:   <features>
Aug 15 16:16:44 user nova-compute[72849]:     <acpi/>
Aug 15 16:16:44 user nova-compute[72849]:     <apic/>
Aug 15 16:16:44 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:16:44 user nova-compute[72849]:   </features>
Aug 15 16:16:44 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:16:44 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:16:44 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:16:44 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:16:44 user nova-compute[72849]:   </clock>
Aug 15 16:16:44 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:16:44 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:16:44 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:16:44 user nova-compute[72849]:   </cpu>
Aug 15 16:16:44 user nova-compute[72849]:   <devices>
Aug 15 16:16:44 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:16:44 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:16:44 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk"/>
Aug 15 16:16:44 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:16:44 user nova-compute[72849]:     </disk>
Aug 15 16:16:44 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:16:44 user nova-compute[72849]:       <mac address="fa:16:3e:32:86:b5"/>
Aug 15 16:16:44 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:16:44 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:16:44 user nova-compute[72849]:       <target dev="tap25a67315-98"/>
Aug 15 16:16:44 user nova-compute[72849]:     </interface>
Aug 15 16:16:44 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:16:44 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/console.log" append="off"/>
Aug 15 16:16:44 user nova-compute[72849]:     </serial>
Aug 15 16:16:44 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:16:44 user nova-compute[72849]:     <video>
Aug 15 16:16:44 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:16:44 user nova-compute[72849]:     </video>
Aug 15 16:16:44 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:16:44 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:16:44 user nova-compute[72849]:     </rng>
Aug 15 16:16:44 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:16:44 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:16:44 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:16:44 user nova-compute[72849]:     </memballoon>
Aug 15 16:16:44 user nova-compute[72849]:   </devices>
Aug 15 16:16:44 user nova-compute[72849]: </domain>
Aug 15 16:16:44 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1690114442',display_name='tempest-ServerActionsTestOtherB-server-1690114442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1690114442',id=3,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+hh3mOCKtCImu1/lg7z7Mltoc1di1aJCPq0550JQzfICBVP48YFxiWhHNSQqhuSWVzxUKF+hNAtXneGjvrY/qA0OutpYd9sLJegliqP2OTf5sqdDZP815XUZAuWEPAcQ==',key_name='tempest-keypair-493994408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b16b734f348e4d9ca7faba1f84f188a8',ramdisk_id='',reservation_id='r-43bap4gi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1970367935',owner_user_name='tempest-ServerActionsTestOtherB-1970367935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:16:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90af38c3a2a64683a12871bb2a5e0a0f',uuid=b0a869eb-9ee8-4c31-9786-5b8be7d362a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Converting VIF {"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG os_vif [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquired lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.network.neutron [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25a67315-98, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25a67315-98, col_values=(('external_ids', {'iface-id': '25a67315-9859-4077-8f36-23635b760770', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:86:b5', 'vm-uuid': 'b0a869eb-9ee8-4c31-9786-5b8be7d362a9'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:16:44 user nova-compute[72849]: INFO os_vif [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98')
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] No VIF found with MAC fa:16:3e:32:86:b5, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:16:44 user nova-compute[72849]: DEBUG nova.network.neutron [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:16:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-318f5d6b-94b6-4ea5-bc9d-328920669005 req-44757967-7987-42f3-84bc-b391e45819c7 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received event network-changed-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:16:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-318f5d6b-94b6-4ea5-bc9d-328920669005 req-44757967-7987-42f3-84bc-b391e45819c7 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Refreshing instance network info cache due to event network-changed-fc17db49-50e4-4186-af46-e3cbd2dd7677. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:16:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-318f5d6b-94b6-4ea5-bc9d-328920669005 req-44757967-7987-42f3-84bc-b391e45819c7 service nova] Acquiring lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.network.neutron [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Updating instance_info_cache with network_info: [{"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Releasing lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Instance network_info: |[{"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-318f5d6b-94b6-4ea5-bc9d-328920669005 req-44757967-7987-42f3-84bc-b391e45819c7 service nova] Acquired lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.network.neutron [req-318f5d6b-94b6-4ea5-bc9d-328920669005 req-44757967-7987-42f3-84bc-b391e45819c7 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Refreshing network info cache for port fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Start _get_guest_xml network_info=[{"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:16:46 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:16:46 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:16:46 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-918445447',display_name='tempest-ServerStableDeviceRescueTest-server-918445447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-918445447',id=4,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlOvfVfqg+jJ0bzYqLK8rxyT7IxbPiXMZf2towszTNT8nSCk0Uoj/ulcw2jeQ97uYI95SkThbUeiHUFFMo9IWaJZbAIkib3lSXB42nBCTEgR439byBh1S5hepErtyn5ug==',key_name='tempest-keypair-676744820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45f8316b45f4418583171fa8691dfe66',ramdisk_id='',reservation_id='r-0l0s337g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-839484866',owner_user_name='tempest-ServerStableDeviceRescueTest-839484866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:16:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0ab3fef694144f39a31c1a17c854bb2',uuid=0c3852fa-b6ac-440f-ae2d-3f482c83b3f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Converting VIF {"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:ca:d5,bridge_name='br-int',has_traffic_filtering=True,id=fc17db49-50e4-4186-af46-e3cbd2dd7677,network=Network(550e2e81-51b2-436e-819b-42379e48b495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc17db49-50') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG nova.objects.instance [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:16:47 user nova-compute[72849]:   <uuid>0c3852fa-b6ac-440f-ae2d-3f482c83b3f5</uuid>
Aug 15 16:16:47 user nova-compute[72849]:   <name>instance-00000004</name>
Aug 15 16:16:47 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:16:47 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:16:47 user nova-compute[72849]:   <metadata>
Aug 15 16:16:47 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:16:47 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:16:47 user nova-compute[72849]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-918445447</nova:name>
Aug 15 16:16:47 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:16:46</nova:creationTime>
Aug 15 16:16:47 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:16:47 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:16:47 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:16:47 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:16:47 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:16:47 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:16:47 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:16:47 user nova-compute[72849]:       <nova:owner>
Aug 15 16:16:47 user nova-compute[72849]:         <nova:user uuid="e0ab3fef694144f39a31c1a17c854bb2">tempest-ServerStableDeviceRescueTest-839484866-project-member</nova:user>
Aug 15 16:16:47 user nova-compute[72849]:         <nova:project uuid="45f8316b45f4418583171fa8691dfe66">tempest-ServerStableDeviceRescueTest-839484866</nova:project>
Aug 15 16:16:47 user nova-compute[72849]:       </nova:owner>
Aug 15 16:16:47 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:16:47 user nova-compute[72849]:       <nova:ports>
Aug 15 16:16:47 user nova-compute[72849]:         <nova:port uuid="fc17db49-50e4-4186-af46-e3cbd2dd7677">
Aug 15 16:16:47 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 16:16:47 user nova-compute[72849]:         </nova:port>
Aug 15 16:16:47 user nova-compute[72849]:       </nova:ports>
Aug 15 16:16:47 user nova-compute[72849]:     </nova:instance>
Aug 15 16:16:47 user nova-compute[72849]:   </metadata>
Aug 15 16:16:47 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:16:47 user nova-compute[72849]:     <system>
Aug 15 16:16:47 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:16:47 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:16:47 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:16:47 user nova-compute[72849]:       <entry name="serial">0c3852fa-b6ac-440f-ae2d-3f482c83b3f5</entry>
Aug 15 16:16:47 user nova-compute[72849]:       <entry name="uuid">0c3852fa-b6ac-440f-ae2d-3f482c83b3f5</entry>
Aug 15 16:16:47 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:16:47 user nova-compute[72849]:     </system>
Aug 15 16:16:47 user nova-compute[72849]:   </sysinfo>
Aug 15 16:16:47 user nova-compute[72849]:   <os>
Aug 15 16:16:47 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:16:47 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:16:47 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:16:47 user nova-compute[72849]:   </os>
Aug 15 16:16:47 user nova-compute[72849]:   <features>
Aug 15 16:16:47 user nova-compute[72849]:     <acpi/>
Aug 15 16:16:47 user nova-compute[72849]:     <apic/>
Aug 15 16:16:47 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:16:47 user nova-compute[72849]:   </features>
Aug 15 16:16:47 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:16:47 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:16:47 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:16:47 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:16:47 user nova-compute[72849]:   </clock>
Aug 15 16:16:47 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:16:47 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:16:47 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:16:47 user nova-compute[72849]:   </cpu>
Aug 15 16:16:47 user nova-compute[72849]:   <devices>
Aug 15 16:16:47 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:16:47 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:16:47 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk"/>
Aug 15 16:16:47 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:16:47 user nova-compute[72849]:     </disk>
Aug 15 16:16:47 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:16:47 user nova-compute[72849]:       <mac address="fa:16:3e:04:ca:d5"/>
Aug 15 16:16:47 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:16:47 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:16:47 user nova-compute[72849]:       <target dev="tapfc17db49-50"/>
Aug 15 16:16:47 user nova-compute[72849]:     </interface>
Aug 15 16:16:47 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:16:47 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/console.log" append="off"/>
Aug 15 16:16:47 user nova-compute[72849]:     </serial>
Aug 15 16:16:47 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:16:47 user nova-compute[72849]:     <video>
Aug 15 16:16:47 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:16:47 user nova-compute[72849]:     </video>
Aug 15 16:16:47 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:16:47 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:16:47 user nova-compute[72849]:     </rng>
Aug 15 16:16:47 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:16:47 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:16:47 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:16:47 user nova-compute[72849]:     </memballoon>
Aug 15 16:16:47 user nova-compute[72849]:   </devices>
Aug 15 16:16:47 user nova-compute[72849]: </domain>
Aug 15 16:16:47 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-918445447',display_name='tempest-ServerStableDeviceRescueTest-server-918445447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-918445447',id=4,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlOvfVfqg+jJ0bzYqLK8rxyT7IxbPiXMZf2towszTNT8nSCk0Uoj/ulcw2jeQ97uYI95SkThbUeiHUFFMo9IWaJZbAIkib3lSXB42nBCTEgR439byBh1S5hepErtyn5ug==',key_name='tempest-keypair-676744820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45f8316b45f4418583171fa8691dfe66',ramdisk_id='',reservation_id='r-0l0s337g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-839484866',owner_user_name='tempest-ServerStableDeviceRescueTest-839484866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:16:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0ab3fef694144f39a31c1a17c854bb2',uuid=0c3852fa-b6ac-440f-ae2d-3f482c83b3f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Converting VIF {"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:ca:d5,bridge_name='br-int',has_traffic_filtering=True,id=fc17db49-50e4-4186-af46-e3cbd2dd7677,network=Network(550e2e81-51b2-436e-819b-42379e48b495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc17db49-50') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG os_vif [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:ca:d5,bridge_name='br-int',has_traffic_filtering=True,id=fc17db49-50e4-4186-af46-e3cbd2dd7677,network=Network(550e2e81-51b2-436e-819b-42379e48b495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc17db49-50') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc17db49-50, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc17db49-50, col_values=(('external_ids', {'iface-id': 'fc17db49-50e4-4186-af46-e3cbd2dd7677', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:ca:d5', 'vm-uuid': '0c3852fa-b6ac-440f-ae2d-3f482c83b3f5'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:47 user nova-compute[72849]: INFO os_vif [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:ca:d5,bridge_name='br-int',has_traffic_filtering=True,id=fc17db49-50e4-4186-af46-e3cbd2dd7677,network=Network(550e2e81-51b2-436e-819b-42379e48b495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc17db49-50')
Aug 15 16:16:47 user nova-compute[72849]: DEBUG nova.network.neutron [req-d38ed8b3-2654-470a-a393-b0ea4e541656 req-53f104c0-0e99-41b2-b916-8ee70cfa6474 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updated VIF entry in instance network info cache for port 25a67315-9859-4077-8f36-23635b760770. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG nova.network.neutron [req-d38ed8b3-2654-470a-a393-b0ea4e541656 req-53f104c0-0e99-41b2-b916-8ee70cfa6474 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updating instance_info_cache with network_info: [{"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d38ed8b3-2654-470a-a393-b0ea4e541656 req-53f104c0-0e99-41b2-b916-8ee70cfa6474 service nova] Releasing lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] No VIF found with MAC fa:16:3e:04:ca:d5, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:49 user nova-compute[72849]: DEBUG nova.network.neutron [req-318f5d6b-94b6-4ea5-bc9d-328920669005 req-44757967-7987-42f3-84bc-b391e45819c7 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Updated VIF entry in instance network info cache for port fc17db49-50e4-4186-af46-e3cbd2dd7677. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:16:49 user nova-compute[72849]: DEBUG nova.network.neutron [req-318f5d6b-94b6-4ea5-bc9d-328920669005 req-44757967-7987-42f3-84bc-b391e45819c7 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Updating instance_info_cache with network_info: [{"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:16:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-318f5d6b-94b6-4ea5-bc9d-328920669005 req-44757967-7987-42f3-84bc-b391e45819c7 service nova] Releasing lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:16:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "341edacc-b44b-4d92-9fcd-982c252fcdd6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:16:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:50 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:16:50 user nova-compute[72849]: INFO nova.compute.claims [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Claim successful on node user
Aug 15 16:16:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:50 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:16:50 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:16:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.654s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:50 user nova-compute[72849]: DEBUG nova.compute.manager [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:16:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:50 user nova-compute[72849]: DEBUG nova.compute.manager [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:16:50 user nova-compute[72849]: DEBUG nova.network.neutron [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:16:50 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:16:50 user nova-compute[72849]: DEBUG nova.compute.manager [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:16:50 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:16:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:16:50 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116210.9915023, b0a869eb-9ee8-4c31-9786-5b8be7d362a9 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:16:50 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] VM Resumed (Lifecycle Event)
Aug 15 16:16:51 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Instance spawned successfully.
Aug 15 16:16:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG nova.policy [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8365a9dd961144a2b2cb303bb7854a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279e48c00f91440082b8bfe112af9091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:16:51 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Creating image(s)
Aug 15 16:16:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "/opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "/opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "/opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:51 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:16:51 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116210.9950128, b0a869eb-9ee8-4c31-9786-5b8be7d362a9 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:16:51 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] VM Started (Lifecycle Event)
Aug 15 16:16:51 user nova-compute[72849]: INFO nova.compute.manager [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Took 15.54 seconds to spawn the instance on the hypervisor.
Aug 15 16:16:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:16:51 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:16:51 user nova-compute[72849]: DEBUG nova.compute.manager [req-9b274af6-e82c-48cf-9d48-bfeedfe21e4d req-d43979f0-5c40-4189-9e19-af9c11f5f725 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received event network-vif-plugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9b274af6-e82c-48cf-9d48-bfeedfe21e4d req-d43979f0-5c40-4189-9e19-af9c11f5f725 service nova] Acquiring lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9b274af6-e82c-48cf-9d48-bfeedfe21e4d req-d43979f0-5c40-4189-9e19-af9c11f5f725 service nova] Lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9b274af6-e82c-48cf-9d48-bfeedfe21e4d req-d43979f0-5c40-4189-9e19-af9c11f5f725 service nova] Lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG nova.compute.manager [req-9b274af6-e82c-48cf-9d48-bfeedfe21e4d req-d43979f0-5c40-4189-9e19-af9c11f5f725 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] No waiting events found dispatching network-vif-plugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:16:51 user nova-compute[72849]: WARNING nova.compute.manager [req-9b274af6-e82c-48cf-9d48-bfeedfe21e4d req-d43979f0-5c40-4189-9e19-af9c11f5f725 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received unexpected event network-vif-plugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 for instance with vm_state active and task_state None.
Aug 15 16:16:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.564s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:52 user nova-compute[72849]: INFO nova.compute.manager [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Took 16.84 seconds to build instance.
Aug 15 16:16:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116212.1363292, 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:16:52 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] VM Resumed (Lifecycle Event)
Aug 15 16:16:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3a5aa78f-2520-4a7e-a658-b064648093d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.128s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:16:52 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Instance spawned successfully.
Aug 15 16:16:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:16:52 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:16:52 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116212.14572, 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:16:52 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] VM Started (Lifecycle Event)
Aug 15 16:16:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.508s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk 1073741824" returned: 0 in 0.099s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.706s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:16:52 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:16:52 user nova-compute[72849]: INFO nova.compute.manager [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Took 14.73 seconds to spawn the instance on the hypervisor.
Aug 15 16:16:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:16:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.338s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:53 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Checking if we can resize image /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:16:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:16:53 user nova-compute[72849]: DEBUG nova.network.neutron [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Successfully created port: c605963e-3827-4ad6-ab40-665c92c252b1 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:16:53 user nova-compute[72849]: INFO nova.compute.manager [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Took 15.59 seconds to build instance.
Aug 15 16:16:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-69c978c4-b7e3-4310-946e-2e8c8f430f8a tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.728s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json" returned: 0 in 0.324s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:16:53 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Cannot resize image /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:16:53 user nova-compute[72849]: DEBUG nova.objects.instance [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lazy-loading 'migration_context' on Instance uuid 341edacc-b44b-4d92-9fcd-982c252fcdd6 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:16:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:16:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Ensure instance console log exists: /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:16:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-28a20b2d-f9d4-4063-85f3-c1ad11d2a3ce req-e40864d1-d056-4221-81ac-9f74bab97e50 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received event network-vif-plugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:16:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-28a20b2d-f9d4-4063-85f3-c1ad11d2a3ce req-e40864d1-d056-4221-81ac-9f74bab97e50 service nova] Acquiring lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:16:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-28a20b2d-f9d4-4063-85f3-c1ad11d2a3ce req-e40864d1-d056-4221-81ac-9f74bab97e50 service nova] Lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:16:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-28a20b2d-f9d4-4063-85f3-c1ad11d2a3ce req-e40864d1-d056-4221-81ac-9f74bab97e50 service nova] Lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:16:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-28a20b2d-f9d4-4063-85f3-c1ad11d2a3ce req-e40864d1-d056-4221-81ac-9f74bab97e50 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] No waiting events found dispatching network-vif-plugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:16:53 user nova-compute[72849]: WARNING nova.compute.manager [req-28a20b2d-f9d4-4063-85f3-c1ad11d2a3ce req-e40864d1-d056-4221-81ac-9f74bab97e50 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received unexpected event network-vif-plugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 for instance with vm_state active and task_state None.
Aug 15 16:16:54 user nova-compute[72849]: DEBUG nova.network.neutron [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Successfully updated port: c605963e-3827-4ad6-ab40-665c92c252b1 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:16:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "refresh_cache-341edacc-b44b-4d92-9fcd-982c252fcdd6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:16:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquired lock "refresh_cache-341edacc-b44b-4d92-9fcd-982c252fcdd6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:16:54 user nova-compute[72849]: DEBUG nova.network.neutron [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:16:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-b7f256fe-67d0-41da-8703-507026e28b33 req-032893a8-89a4-4151-9f94-403a19d58efe service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Received event network-changed-c605963e-3827-4ad6-ab40-665c92c252b1 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:16:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-b7f256fe-67d0-41da-8703-507026e28b33 req-032893a8-89a4-4151-9f94-403a19d58efe service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Refreshing instance network info cache due to event network-changed-c605963e-3827-4ad6-ab40-665c92c252b1. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:16:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b7f256fe-67d0-41da-8703-507026e28b33 req-032893a8-89a4-4151-9f94-403a19d58efe service nova] Acquiring lock "refresh_cache-341edacc-b44b-4d92-9fcd-982c252fcdd6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:16:54 user nova-compute[72849]: DEBUG nova.network.neutron [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.network.neutron [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Updating instance_info_cache with network_info: [{"id": "c605963e-3827-4ad6-ab40-665c92c252b1", "address": "fa:16:3e:0a:d9:a5", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605963e-38", "ovs_interfaceid": "c605963e-3827-4ad6-ab40-665c92c252b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Releasing lock "refresh_cache-341edacc-b44b-4d92-9fcd-982c252fcdd6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.compute.manager [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Instance network_info: |[{"id": "c605963e-3827-4ad6-ab40-665c92c252b1", "address": "fa:16:3e:0a:d9:a5", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605963e-38", "ovs_interfaceid": "c605963e-3827-4ad6-ab40-665c92c252b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b7f256fe-67d0-41da-8703-507026e28b33 req-032893a8-89a4-4151-9f94-403a19d58efe service nova] Acquired lock "refresh_cache-341edacc-b44b-4d92-9fcd-982c252fcdd6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.network.neutron [req-b7f256fe-67d0-41da-8703-507026e28b33 req-032893a8-89a4-4151-9f94-403a19d58efe service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Refreshing network info cache for port c605963e-3827-4ad6-ab40-665c92c252b1 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Start _get_guest_xml network_info=[{"id": "c605963e-3827-4ad6-ab40-665c92c252b1", "address": "fa:16:3e:0a:d9:a5", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605963e-38", "ovs_interfaceid": "c605963e-3827-4ad6-ab40-665c92c252b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:16:55 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:16:55 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2019744280',display_name='tempest-VolumesAdminNegativeTest-server-2019744280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2019744280',id=5,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIh4ux07h/0R5+g46sQRbNMw3iBqjprs8fZH70Eoqy8r9mMfiYTpH1vobXzu1H2NUG93m9fnNq6a9nTKLOqhb0pfk2n8b3WxEfv5J/WXt8sezZRjPg2dFQxoFQg8TaTGeQ==',key_name='tempest-keypair-992049436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='279e48c00f91440082b8bfe112af9091',ramdisk_id='',reservation_id='r-jngi2uvb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-879284905',owner_user_name='tempest-VolumesAdminNegativeTest-879284905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:16:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8365a9dd961144a2b2cb303bb7854a45',uuid=341edacc-b44b-4d92-9fcd-982c252fcdd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c605963e-3827-4ad6-ab40-665c92c252b1", "address": "fa:16:3e:0a:d9:a5", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605963e-38", "ovs_interfaceid": "c605963e-3827-4ad6-ab40-665c92c252b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Converting VIF {"id": "c605963e-3827-4ad6-ab40-665c92c252b1", "address": "fa:16:3e:0a:d9:a5", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605963e-38", "ovs_interfaceid": "c605963e-3827-4ad6-ab40-665c92c252b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d9:a5,bridge_name='br-int',has_traffic_filtering=True,id=c605963e-3827-4ad6-ab40-665c92c252b1,network=Network(181b9566-bc94-42e7-b80e-1b78111cce19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605963e-38') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.objects.instance [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lazy-loading 'pci_devices' on Instance uuid 341edacc-b44b-4d92-9fcd-982c252fcdd6 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:16:55 user nova-compute[72849]:   <uuid>341edacc-b44b-4d92-9fcd-982c252fcdd6</uuid>
Aug 15 16:16:55 user nova-compute[72849]:   <name>instance-00000005</name>
Aug 15 16:16:55 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:16:55 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:16:55 user nova-compute[72849]:   <metadata>
Aug 15 16:16:55 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:16:55 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:16:55 user nova-compute[72849]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2019744280</nova:name>
Aug 15 16:16:55 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:16:55</nova:creationTime>
Aug 15 16:16:55 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:16:55 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:16:55 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:16:55 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:16:55 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:16:55 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:16:55 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:16:55 user nova-compute[72849]:       <nova:owner>
Aug 15 16:16:55 user nova-compute[72849]:         <nova:user uuid="8365a9dd961144a2b2cb303bb7854a45">tempest-VolumesAdminNegativeTest-879284905-project-member</nova:user>
Aug 15 16:16:55 user nova-compute[72849]:         <nova:project uuid="279e48c00f91440082b8bfe112af9091">tempest-VolumesAdminNegativeTest-879284905</nova:project>
Aug 15 16:16:55 user nova-compute[72849]:       </nova:owner>
Aug 15 16:16:55 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:16:55 user nova-compute[72849]:       <nova:ports>
Aug 15 16:16:55 user nova-compute[72849]:         <nova:port uuid="c605963e-3827-4ad6-ab40-665c92c252b1">
Aug 15 16:16:55 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 16:16:55 user nova-compute[72849]:         </nova:port>
Aug 15 16:16:55 user nova-compute[72849]:       </nova:ports>
Aug 15 16:16:55 user nova-compute[72849]:     </nova:instance>
Aug 15 16:16:55 user nova-compute[72849]:   </metadata>
Aug 15 16:16:55 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:16:55 user nova-compute[72849]:     <system>
Aug 15 16:16:55 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:16:55 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:16:55 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:16:55 user nova-compute[72849]:       <entry name="serial">341edacc-b44b-4d92-9fcd-982c252fcdd6</entry>
Aug 15 16:16:55 user nova-compute[72849]:       <entry name="uuid">341edacc-b44b-4d92-9fcd-982c252fcdd6</entry>
Aug 15 16:16:55 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:16:55 user nova-compute[72849]:     </system>
Aug 15 16:16:55 user nova-compute[72849]:   </sysinfo>
Aug 15 16:16:55 user nova-compute[72849]:   <os>
Aug 15 16:16:55 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:16:55 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:16:55 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:16:55 user nova-compute[72849]:   </os>
Aug 15 16:16:55 user nova-compute[72849]:   <features>
Aug 15 16:16:55 user nova-compute[72849]:     <acpi/>
Aug 15 16:16:55 user nova-compute[72849]:     <apic/>
Aug 15 16:16:55 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:16:55 user nova-compute[72849]:   </features>
Aug 15 16:16:55 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:16:55 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:16:55 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:16:55 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:16:55 user nova-compute[72849]:   </clock>
Aug 15 16:16:55 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:16:55 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:16:55 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:16:55 user nova-compute[72849]:   </cpu>
Aug 15 16:16:55 user nova-compute[72849]:   <devices>
Aug 15 16:16:55 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:16:55 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:16:55 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk"/>
Aug 15 16:16:55 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:16:55 user nova-compute[72849]:     </disk>
Aug 15 16:16:55 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:16:55 user nova-compute[72849]:       <mac address="fa:16:3e:0a:d9:a5"/>
Aug 15 16:16:55 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:16:55 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:16:55 user nova-compute[72849]:       <target dev="tapc605963e-38"/>
Aug 15 16:16:55 user nova-compute[72849]:     </interface>
Aug 15 16:16:55 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:16:55 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/console.log" append="off"/>
Aug 15 16:16:55 user nova-compute[72849]:     </serial>
Aug 15 16:16:55 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:16:55 user nova-compute[72849]:     <video>
Aug 15 16:16:55 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:16:55 user nova-compute[72849]:     </video>
Aug 15 16:16:55 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:16:55 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:16:55 user nova-compute[72849]:     </rng>
Aug 15 16:16:55 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:16:55 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:16:55 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:16:55 user nova-compute[72849]:     </memballoon>
Aug 15 16:16:55 user nova-compute[72849]:   </devices>
Aug 15 16:16:55 user nova-compute[72849]: </domain>
Aug 15 16:16:55 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2019744280',display_name='tempest-VolumesAdminNegativeTest-server-2019744280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2019744280',id=5,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIh4ux07h/0R5+g46sQRbNMw3iBqjprs8fZH70Eoqy8r9mMfiYTpH1vobXzu1H2NUG93m9fnNq6a9nTKLOqhb0pfk2n8b3WxEfv5J/WXt8sezZRjPg2dFQxoFQg8TaTGeQ==',key_name='tempest-keypair-992049436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='279e48c00f91440082b8bfe112af9091',ramdisk_id='',reservation_id='r-jngi2uvb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-879284905',owner_user_name='tempest-VolumesAdminNegativeTest-879284905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:16:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8365a9dd961144a2b2cb303bb7854a45',uuid=341edacc-b44b-4d92-9fcd-982c252fcdd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c605963e-3827-4ad6-ab40-665c92c252b1", "address": "fa:16:3e:0a:d9:a5", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605963e-38", "ovs_interfaceid": "c605963e-3827-4ad6-ab40-665c92c252b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Converting VIF {"id": "c605963e-3827-4ad6-ab40-665c92c252b1", "address": "fa:16:3e:0a:d9:a5", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605963e-38", "ovs_interfaceid": "c605963e-3827-4ad6-ab40-665c92c252b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d9:a5,bridge_name='br-int',has_traffic_filtering=True,id=c605963e-3827-4ad6-ab40-665c92c252b1,network=Network(181b9566-bc94-42e7-b80e-1b78111cce19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605963e-38') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG os_vif [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d9:a5,bridge_name='br-int',has_traffic_filtering=True,id=c605963e-3827-4ad6-ab40-665c92c252b1,network=Network(181b9566-bc94-42e7-b80e-1b78111cce19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605963e-38') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc605963e-38, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc605963e-38, col_values=(('external_ids', {'iface-id': 'c605963e-3827-4ad6-ab40-665c92c252b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:d9:a5', 'vm-uuid': '341edacc-b44b-4d92-9fcd-982c252fcdd6'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:55 user nova-compute[72849]: INFO os_vif [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d9:a5,bridge_name='br-int',has_traffic_filtering=True,id=c605963e-3827-4ad6-ab40-665c92c252b1,network=Network(181b9566-bc94-42e7-b80e-1b78111cce19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605963e-38')
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:16:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] No VIF found with MAC fa:16:3e:0a:d9:a5, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:16:56 user nova-compute[72849]: DEBUG nova.network.neutron [req-b7f256fe-67d0-41da-8703-507026e28b33 req-032893a8-89a4-4151-9f94-403a19d58efe service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Updated VIF entry in instance network info cache for port c605963e-3827-4ad6-ab40-665c92c252b1. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:16:56 user nova-compute[72849]: DEBUG nova.network.neutron [req-b7f256fe-67d0-41da-8703-507026e28b33 req-032893a8-89a4-4151-9f94-403a19d58efe service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Updating instance_info_cache with network_info: [{"id": "c605963e-3827-4ad6-ab40-665c92c252b1", "address": "fa:16:3e:0a:d9:a5", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605963e-38", "ovs_interfaceid": "c605963e-3827-4ad6-ab40-665c92c252b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:16:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b7f256fe-67d0-41da-8703-507026e28b33 req-032893a8-89a4-4151-9f94-403a19d58efe service nova] Releasing lock "refresh_cache-341edacc-b44b-4d92-9fcd-982c252fcdd6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:16:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:16:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:00 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116220.8810182, 341edacc-b44b-4d92-9fcd-982c252fcdd6 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:17:00 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] VM Resumed (Lifecycle Event)
Aug 15 16:17:00 user nova-compute[72849]: DEBUG nova.compute.manager [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:17:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:17:00 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Instance spawned successfully.
Aug 15 16:17:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:17:00 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:17:00 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:17:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:00 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:17:00 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116220.8841884, 341edacc-b44b-4d92-9fcd-982c252fcdd6 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:17:00 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] VM Started (Lifecycle Event)
Aug 15 16:17:00 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:17:01 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:17:01 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:17:01 user nova-compute[72849]: INFO nova.compute.manager [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Took 9.75 seconds to spawn the instance on the hypervisor.
Aug 15 16:17:01 user nova-compute[72849]: DEBUG nova.compute.manager [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:17:01 user nova-compute[72849]: INFO nova.compute.manager [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Took 11.29 seconds to build instance.
Aug 15 16:17:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e252c70-844d-453c-bcb4-ebebfc78a2a0 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.483s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Acquiring lock "c47e8572-bf45-4f91-9ca7-2dbee7972113" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:02 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:17:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:02 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:17:02 user nova-compute[72849]: INFO nova.compute.claims [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Claim successful on node user
Aug 15 16:17:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:02 user nova-compute[72849]: DEBUG nova.compute.manager [req-5914a9ed-bed3-4fbc-b88a-ca54bb322f17 req-7634ca98-3b8b-45b8-8b94-aed48ed33838 service nova] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Received event network-vif-plugged-88628ea8-908b-47c2-bdfd-6e8525d88c0b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5914a9ed-bed3-4fbc-b88a-ca54bb322f17 req-7634ca98-3b8b-45b8-8b94-aed48ed33838 service nova] Acquiring lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5914a9ed-bed3-4fbc-b88a-ca54bb322f17 req-7634ca98-3b8b-45b8-8b94-aed48ed33838 service nova] Lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5914a9ed-bed3-4fbc-b88a-ca54bb322f17 req-7634ca98-3b8b-45b8-8b94-aed48ed33838 service nova] Lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:02 user nova-compute[72849]: DEBUG nova.compute.manager [req-5914a9ed-bed3-4fbc-b88a-ca54bb322f17 req-7634ca98-3b8b-45b8-8b94-aed48ed33838 service nova] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] No waiting events found dispatching network-vif-plugged-88628ea8-908b-47c2-bdfd-6e8525d88c0b {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:17:02 user nova-compute[72849]: WARNING nova.compute.manager [req-5914a9ed-bed3-4fbc-b88a-ca54bb322f17 req-7634ca98-3b8b-45b8-8b94-aed48ed33838 service nova] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Received unexpected event network-vif-plugged-88628ea8-908b-47c2-bdfd-6e8525d88c0b for instance with vm_state active and task_state None.
Aug 15 16:17:03 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.763s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG nova.network.neutron [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "7d843493-eda8-46a9-bb1b-3cc80eed7488" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Acquiring lock "3954da38-0292-40f7-8ace-6987d0248a44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lock "3954da38-0292-40f7-8ace-6987d0248a44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:03 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 15 16:17:03 user nova-compute[72849]: DEBUG nova.compute.manager [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG nova.compute.manager [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG nova.policy [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f60d32b341f4e3c9add19af0d2a4e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc588100f2fa46a0b57d24b0708a625e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:17:03 user nova-compute[72849]: INFO nova.compute.claims [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Claim successful on node user
Aug 15 16:17:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:17:03 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Creating image(s)
Aug 15 16:17:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Acquiring lock "/opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "/opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "/opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Acquiring lock "4accd05796863797750940347dc9da9e7d064b67" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "4accd05796863797750940347dc9da9e7d064b67" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67.part --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67.part --force-share --output=json" returned: 0 in 0.225s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:04 user nova-compute[72849]: DEBUG nova.virt.images [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] 75000139-9517-47c6-8da4-a7356e8a0e71 was qcow2, converting to raw {{(pid=72849) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 16:17:04 user nova-compute[72849]: DEBUG nova.privsep.utils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72849) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 16:17:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67.part /opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67.converted {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67.part /opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67.converted" returned: 0 in 0.202s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67.converted --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:04 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:17:04 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:17:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.245s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:17:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.229s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:17:04 user nova-compute[72849]: INFO nova.compute.claims [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Claim successful on node user
Aug 15 16:17:05 user nova-compute[72849]: DEBUG nova.network.neutron [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Successfully created port: 4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG nova.compute.manager [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG nova.network.neutron [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-5f189bdd-b245-4413-8b7b-146cb096dbc1 req-20b34c0f-212a-4df4-adec-d718241ab544 service nova] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Received event network-vif-plugged-88628ea8-908b-47c2-bdfd-6e8525d88c0b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5f189bdd-b245-4413-8b7b-146cb096dbc1 req-20b34c0f-212a-4df4-adec-d718241ab544 service nova] Acquiring lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5f189bdd-b245-4413-8b7b-146cb096dbc1 req-20b34c0f-212a-4df4-adec-d718241ab544 service nova] Lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5f189bdd-b245-4413-8b7b-146cb096dbc1 req-20b34c0f-212a-4df4-adec-d718241ab544 service nova] Lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-5f189bdd-b245-4413-8b7b-146cb096dbc1 req-20b34c0f-212a-4df4-adec-d718241ab544 service nova] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] No waiting events found dispatching network-vif-plugged-88628ea8-908b-47c2-bdfd-6e8525d88c0b {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:17:05 user nova-compute[72849]: WARNING nova.compute.manager [req-5f189bdd-b245-4413-8b7b-146cb096dbc1 req-20b34c0f-212a-4df4-adec-d718241ab544 service nova] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Received unexpected event network-vif-plugged-88628ea8-908b-47c2-bdfd-6e8525d88c0b for instance with vm_state active and task_state None.
Aug 15 16:17:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-5f189bdd-b245-4413-8b7b-146cb096dbc1 req-20b34c0f-212a-4df4-adec-d718241ab544 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received event network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5f189bdd-b245-4413-8b7b-146cb096dbc1 req-20b34c0f-212a-4df4-adec-d718241ab544 service nova] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5f189bdd-b245-4413-8b7b-146cb096dbc1 req-20b34c0f-212a-4df4-adec-d718241ab544 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5f189bdd-b245-4413-8b7b-146cb096dbc1 req-20b34c0f-212a-4df4-adec-d718241ab544 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-5f189bdd-b245-4413-8b7b-146cb096dbc1 req-20b34c0f-212a-4df4-adec-d718241ab544 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] No waiting events found dispatching network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:17:05 user nova-compute[72849]: WARNING nova.compute.manager [req-5f189bdd-b245-4413-8b7b-146cb096dbc1 req-20b34c0f-212a-4df4-adec-d718241ab544 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received unexpected event network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 for instance with vm_state active and task_state None.
Aug 15 16:17:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-5f189bdd-b245-4413-8b7b-146cb096dbc1 req-20b34c0f-212a-4df4-adec-d718241ab544 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received event network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5f189bdd-b245-4413-8b7b-146cb096dbc1 req-20b34c0f-212a-4df4-adec-d718241ab544 service nova] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5f189bdd-b245-4413-8b7b-146cb096dbc1 req-20b34c0f-212a-4df4-adec-d718241ab544 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5f189bdd-b245-4413-8b7b-146cb096dbc1 req-20b34c0f-212a-4df4-adec-d718241ab544 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-5f189bdd-b245-4413-8b7b-146cb096dbc1 req-20b34c0f-212a-4df4-adec-d718241ab544 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] No waiting events found dispatching network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:17:05 user nova-compute[72849]: WARNING nova.compute.manager [req-5f189bdd-b245-4413-8b7b-146cb096dbc1 req-20b34c0f-212a-4df4-adec-d718241ab544 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received unexpected event network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 for instance with vm_state active and task_state None.
Aug 15 16:17:05 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67.converted --force-share --output=json" returned: 0 in 0.320s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "4accd05796863797750940347dc9da9e7d064b67" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.312s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG nova.compute.manager [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67 --force-share --output=json" returned: 0 in 0.257s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Acquiring lock "4accd05796863797750940347dc9da9e7d064b67" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "4accd05796863797750940347dc9da9e7d064b67" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG nova.policy [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9695ab1e4507498eb7216e616f536c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '574b067543464efcbb6701547c90a91f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG nova.compute.manager [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:17:05 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Creating image(s)
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Acquiring lock "/opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lock "/opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lock "/opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67 --force-share --output=json" returned: 0 in 0.262s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67,backing_fmt=raw /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67,backing_fmt=raw /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk 1073741824" returned: 0 in 0.064s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "4accd05796863797750940347dc9da9e7d064b67" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.290s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.935s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG nova.compute.manager [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67 --force-share --output=json" returned: 0 in 0.237s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:17:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.252s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG nova.network.neutron [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:06 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk 1073741824" returned: 0 in 0.067s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Cannot resize image /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG nova.objects.instance [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lazy-loading 'migration_context' on Instance uuid c47e8572-bf45-4f91-9ca7-2dbee7972113 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Ensure instance console log exists: /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG nova.policy [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a442003f0164870905327b6b5f1a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de78e6bddce4402d9829b94e9bd6cf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:17:06 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Creating image(s)
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.309s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.269s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Cannot resize image /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG nova.objects.instance [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lazy-loading 'migration_context' on Instance uuid 3954da38-0292-40f7-8ace-6987d0248a44 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Ensure instance console log exists: /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.230s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk 1073741824" returned: 0 in 0.054s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.272s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Cannot resize image /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG nova.objects.instance [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lazy-loading 'migration_context' on Instance uuid 7d843493-eda8-46a9-bb1b-3cc80eed7488 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Ensure instance console log exists: /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG nova.network.neutron [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Successfully updated port: 4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Acquiring lock "refresh_cache-c47e8572-bf45-4f91-9ca7-2dbee7972113" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Acquired lock "refresh_cache-c47e8572-bf45-4f91-9ca7-2dbee7972113" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG nova.network.neutron [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-e280a435-d5f2-44ad-ab07-3d33094ab89c req-994f948c-ca7c-41a9-8318-6ad5681edf2a service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Received event network-changed-4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-e280a435-d5f2-44ad-ab07-3d33094ab89c req-994f948c-ca7c-41a9-8318-6ad5681edf2a service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Refreshing instance network info cache due to event network-changed-4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e280a435-d5f2-44ad-ab07-3d33094ab89c req-994f948c-ca7c-41a9-8318-6ad5681edf2a service nova] Acquiring lock "refresh_cache-c47e8572-bf45-4f91-9ca7-2dbee7972113" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG nova.network.neutron [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:17:07 user nova-compute[72849]: DEBUG nova.network.neutron [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Successfully created port: 9312a7dc-cae1-498e-8151-5dea468286d0 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.network.neutron [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Updating instance_info_cache with network_info: [{"id": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "address": "fa:16:3e:10:4d:2c", "network": {"id": "a6cd3415-3bb0-4caf-85a3-e9090d778c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531227145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc588100f2fa46a0b57d24b0708a625e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7fb39b-6b", "ovs_interfaceid": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.network.neutron [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Successfully created port: 888d8da9-c8a5-40fd-a421-1a8ec1890f25 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Releasing lock "refresh_cache-c47e8572-bf45-4f91-9ca7-2dbee7972113" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Instance network_info: |[{"id": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "address": "fa:16:3e:10:4d:2c", "network": {"id": "a6cd3415-3bb0-4caf-85a3-e9090d778c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531227145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc588100f2fa46a0b57d24b0708a625e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7fb39b-6b", "ovs_interfaceid": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e280a435-d5f2-44ad-ab07-3d33094ab89c req-994f948c-ca7c-41a9-8318-6ad5681edf2a service nova] Acquired lock "refresh_cache-c47e8572-bf45-4f91-9ca7-2dbee7972113" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.network.neutron [req-e280a435-d5f2-44ad-ab07-3d33094ab89c req-994f948c-ca7c-41a9-8318-6ad5681edf2a service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Refreshing network info cache for port 4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Start _get_guest_xml network_info=[{"id": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "address": "fa:16:3e:10:4d:2c", "network": {"id": "a6cd3415-3bb0-4caf-85a3-e9090d778c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531227145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc588100f2fa46a0b57d24b0708a625e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7fb39b-6b", "ovs_interfaceid": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:16:52Z,direct_url=<?>,disk_format='qcow2',id=75000139-9517-47c6-8da4-a7356e8a0e71,min_disk=0,min_ram=0,name='',owner='9939906729ca4ff887d15fdd07b792ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:16:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'scsi', 'encrypted': False, 'image_id': '75000139-9517-47c6-8da4-a7356e8a0e71'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:17:08 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:17:08 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:16:52Z,direct_url=<?>,disk_format='qcow2',id=75000139-9517-47c6-8da4-a7356e8a0e71,min_disk=0,min_ram=0,name='',owner='9939906729ca4ff887d15fdd07b792ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:16:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1204643519',display_name='tempest-AttachSCSIVolumeTestJSON-server-1204643519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1204643519',id=6,image_ref='75000139-9517-47c6-8da4-a7356e8a0e71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7nC9mdVdXDpufcb5elFqWYO79JYEWAuMaKMurScp2UeDSh5MEDjA0U14425I+qO1C/M3mvK0NhWw+i0jh3IBdG2j92gPQ4SS2/oIotm/TY4AMZsjX84SQYoP1oXgc7Zw==',key_name='tempest-keypair-7359329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc588100f2fa46a0b57d24b0708a625e',ramdisk_id='',reservation_id='r-wd27upr3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='75000139-9517-47c6-8da4-a7356e8a0e71',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1692749068',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1692749068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f60d32b341f4e3c9add19af0d2a4e5f',uuid=c47e8572-bf45-4f91-9ca7-2dbee7972113,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "address": "fa:16:3e:10:4d:2c", "network": {"id": "a6cd3415-3bb0-4caf-85a3-e9090d778c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531227145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc588100f2fa46a0b57d24b0708a625e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7fb39b-6b", "ovs_interfaceid": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Converting VIF {"id": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "address": "fa:16:3e:10:4d:2c", "network": {"id": "a6cd3415-3bb0-4caf-85a3-e9090d778c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531227145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc588100f2fa46a0b57d24b0708a625e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7fb39b-6b", "ovs_interfaceid": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:4d:2c,bridge_name='br-int',has_traffic_filtering=True,id=4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e,network=Network(a6cd3415-3bb0-4caf-85a3-e9090d778c17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7fb39b-6b') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.objects.instance [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lazy-loading 'pci_devices' on Instance uuid c47e8572-bf45-4f91-9ca7-2dbee7972113 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:17:08 user nova-compute[72849]:   <uuid>c47e8572-bf45-4f91-9ca7-2dbee7972113</uuid>
Aug 15 16:17:08 user nova-compute[72849]:   <name>instance-00000006</name>
Aug 15 16:17:08 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:17:08 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:17:08 user nova-compute[72849]:   <metadata>
Aug 15 16:17:08 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:17:08 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:17:08 user nova-compute[72849]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1204643519</nova:name>
Aug 15 16:17:08 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:17:08</nova:creationTime>
Aug 15 16:17:08 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:17:08 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:17:08 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:17:08 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:17:08 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:17:08 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:17:08 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:17:08 user nova-compute[72849]:       <nova:owner>
Aug 15 16:17:08 user nova-compute[72849]:         <nova:user uuid="3f60d32b341f4e3c9add19af0d2a4e5f">tempest-AttachSCSIVolumeTestJSON-1692749068-project-member</nova:user>
Aug 15 16:17:08 user nova-compute[72849]:         <nova:project uuid="bc588100f2fa46a0b57d24b0708a625e">tempest-AttachSCSIVolumeTestJSON-1692749068</nova:project>
Aug 15 16:17:08 user nova-compute[72849]:       </nova:owner>
Aug 15 16:17:08 user nova-compute[72849]:       <nova:root type="image" uuid="75000139-9517-47c6-8da4-a7356e8a0e71"/>
Aug 15 16:17:08 user nova-compute[72849]:       <nova:ports>
Aug 15 16:17:08 user nova-compute[72849]:         <nova:port uuid="4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e">
Aug 15 16:17:08 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:17:08 user nova-compute[72849]:         </nova:port>
Aug 15 16:17:08 user nova-compute[72849]:       </nova:ports>
Aug 15 16:17:08 user nova-compute[72849]:     </nova:instance>
Aug 15 16:17:08 user nova-compute[72849]:   </metadata>
Aug 15 16:17:08 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:17:08 user nova-compute[72849]:     <system>
Aug 15 16:17:08 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:17:08 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:17:08 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:17:08 user nova-compute[72849]:       <entry name="serial">c47e8572-bf45-4f91-9ca7-2dbee7972113</entry>
Aug 15 16:17:08 user nova-compute[72849]:       <entry name="uuid">c47e8572-bf45-4f91-9ca7-2dbee7972113</entry>
Aug 15 16:17:08 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:17:08 user nova-compute[72849]:     </system>
Aug 15 16:17:08 user nova-compute[72849]:   </sysinfo>
Aug 15 16:17:08 user nova-compute[72849]:   <os>
Aug 15 16:17:08 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:17:08 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:17:08 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:17:08 user nova-compute[72849]:   </os>
Aug 15 16:17:08 user nova-compute[72849]:   <features>
Aug 15 16:17:08 user nova-compute[72849]:     <acpi/>
Aug 15 16:17:08 user nova-compute[72849]:     <apic/>
Aug 15 16:17:08 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:17:08 user nova-compute[72849]:   </features>
Aug 15 16:17:08 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:17:08 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:17:08 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:17:08 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:17:08 user nova-compute[72849]:   </clock>
Aug 15 16:17:08 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:17:08 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:17:08 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:17:08 user nova-compute[72849]:   </cpu>
Aug 15 16:17:08 user nova-compute[72849]:   <devices>
Aug 15 16:17:08 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:17:08 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:17:08 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk"/>
Aug 15 16:17:08 user nova-compute[72849]:       <target dev="sda" bus="scsi"/>
Aug 15 16:17:08 user nova-compute[72849]:       <address type="drive" controller="0" unit="0"/>
Aug 15 16:17:08 user nova-compute[72849]:     </disk>
Aug 15 16:17:08 user nova-compute[72849]:     <disk type="file" device="cdrom">
Aug 15 16:17:08 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 16:17:08 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk.config"/>
Aug 15 16:17:08 user nova-compute[72849]:       <target dev="sdb" bus="scsi"/>
Aug 15 16:17:08 user nova-compute[72849]:       <address type="drive" controller="0" unit="1"/>
Aug 15 16:17:08 user nova-compute[72849]:     </disk>
Aug 15 16:17:08 user nova-compute[72849]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 15 16:17:08 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:17:08 user nova-compute[72849]:       <mac address="fa:16:3e:10:4d:2c"/>
Aug 15 16:17:08 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:17:08 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:17:08 user nova-compute[72849]:       <target dev="tap4e7fb39b-6b"/>
Aug 15 16:17:08 user nova-compute[72849]:     </interface>
Aug 15 16:17:08 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:17:08 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/console.log" append="off"/>
Aug 15 16:17:08 user nova-compute[72849]:     </serial>
Aug 15 16:17:08 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:17:08 user nova-compute[72849]:     <video>
Aug 15 16:17:08 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:17:08 user nova-compute[72849]:     </video>
Aug 15 16:17:08 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:17:08 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:17:08 user nova-compute[72849]:     </rng>
Aug 15 16:17:08 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:17:08 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:17:08 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:17:08 user nova-compute[72849]:     </memballoon>
Aug 15 16:17:08 user nova-compute[72849]:   </devices>
Aug 15 16:17:08 user nova-compute[72849]: </domain>
Aug 15 16:17:08 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1204643519',display_name='tempest-AttachSCSIVolumeTestJSON-server-1204643519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1204643519',id=6,image_ref='75000139-9517-47c6-8da4-a7356e8a0e71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7nC9mdVdXDpufcb5elFqWYO79JYEWAuMaKMurScp2UeDSh5MEDjA0U14425I+qO1C/M3mvK0NhWw+i0jh3IBdG2j92gPQ4SS2/oIotm/TY4AMZsjX84SQYoP1oXgc7Zw==',key_name='tempest-keypair-7359329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc588100f2fa46a0b57d24b0708a625e',ramdisk_id='',reservation_id='r-wd27upr3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='75000139-9517-47c6-8da4-a7356e8a0e71',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1692749068',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1692749068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f60d32b341f4e3c9add19af0d2a4e5f',uuid=c47e8572-bf45-4f91-9ca7-2dbee7972113,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "address": "fa:16:3e:10:4d:2c", "network": {"id": "a6cd3415-3bb0-4caf-85a3-e9090d778c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531227145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc588100f2fa46a0b57d24b0708a625e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7fb39b-6b", "ovs_interfaceid": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Converting VIF {"id": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "address": "fa:16:3e:10:4d:2c", "network": {"id": "a6cd3415-3bb0-4caf-85a3-e9090d778c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531227145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc588100f2fa46a0b57d24b0708a625e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7fb39b-6b", "ovs_interfaceid": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:4d:2c,bridge_name='br-int',has_traffic_filtering=True,id=4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e,network=Network(a6cd3415-3bb0-4caf-85a3-e9090d778c17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7fb39b-6b') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG os_vif [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:4d:2c,bridge_name='br-int',has_traffic_filtering=True,id=4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e,network=Network(a6cd3415-3bb0-4caf-85a3-e9090d778c17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7fb39b-6b') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Acquiring lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e7fb39b-6b, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4e7fb39b-6b, col_values=(('external_ids', {'iface-id': '4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:4d:2c', 'vm-uuid': 'c47e8572-bf45-4f91-9ca7-2dbee7972113'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:08 user nova-compute[72849]: INFO os_vif [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:4d:2c,bridge_name='br-int',has_traffic_filtering=True,id=4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e,network=Network(a6cd3415-3bb0-4caf-85a3-e9090d778c17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7fb39b-6b')
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.compute.manager [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] No BDM found with device name sda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] No VIF found with MAC fa:16:3e:10:4d:2c, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:17:08 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Using config drive
Aug 15 16:17:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:17:08 user nova-compute[72849]: INFO nova.compute.claims [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Claim successful on node user
Aug 15 16:17:09 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Creating config drive at /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk.config
Aug 15 16:17:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjwm4sl5d {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjwm4sl5d" returned: 0 in 0.077s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:09 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:17:09 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:17:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.938s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:09 user nova-compute[72849]: DEBUG nova.compute.manager [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:17:09 user nova-compute[72849]: DEBUG nova.network.neutron [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Successfully updated port: 888d8da9-c8a5-40fd-a421-1a8ec1890f25 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:17:09 user nova-compute[72849]: DEBUG nova.network.neutron [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Successfully updated port: 9312a7dc-cae1-498e-8151-5dea468286d0 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:17:09 user nova-compute[72849]: DEBUG nova.compute.manager [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:17:09 user nova-compute[72849]: DEBUG nova.network.neutron [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "refresh_cache-7d843493-eda8-46a9-bb1b-3cc80eed7488" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquired lock "refresh_cache-7d843493-eda8-46a9-bb1b-3cc80eed7488" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG nova.network.neutron [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG nova.network.neutron [req-e280a435-d5f2-44ad-ab07-3d33094ab89c req-994f948c-ca7c-41a9-8318-6ad5681edf2a service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Updated VIF entry in instance network info cache for port 4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG nova.network.neutron [req-e280a435-d5f2-44ad-ab07-3d33094ab89c req-994f948c-ca7c-41a9-8318-6ad5681edf2a service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Updating instance_info_cache with network_info: [{"id": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "address": "fa:16:3e:10:4d:2c", "network": {"id": "a6cd3415-3bb0-4caf-85a3-e9090d778c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531227145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc588100f2fa46a0b57d24b0708a625e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7fb39b-6b", "ovs_interfaceid": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-039a909c-c41c-45d7-871d-8eaad35278ce req-260609b2-2b44-475d-a993-ab427e72d847 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received event network-changed-888d8da9-c8a5-40fd-a421-1a8ec1890f25 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-039a909c-c41c-45d7-871d-8eaad35278ce req-260609b2-2b44-475d-a993-ab427e72d847 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Refreshing instance network info cache due to event network-changed-888d8da9-c8a5-40fd-a421-1a8ec1890f25. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-039a909c-c41c-45d7-871d-8eaad35278ce req-260609b2-2b44-475d-a993-ab427e72d847 service nova] Acquiring lock "refresh_cache-7d843493-eda8-46a9-bb1b-3cc80eed7488" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Acquiring lock "refresh_cache-3954da38-0292-40f7-8ace-6987d0248a44" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Acquired lock "refresh_cache-3954da38-0292-40f7-8ace-6987d0248a44" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG nova.network.neutron [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-1d653716-3419-48a3-bbb4-2e43b352441b req-6b62bcca-17e2-472a-9f57-17fdca350a16 service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Received event network-changed-9312a7dc-cae1-498e-8151-5dea468286d0 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-1d653716-3419-48a3-bbb4-2e43b352441b req-6b62bcca-17e2-472a-9f57-17fdca350a16 service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Refreshing instance network info cache due to event network-changed-9312a7dc-cae1-498e-8151-5dea468286d0. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1d653716-3419-48a3-bbb4-2e43b352441b req-6b62bcca-17e2-472a-9f57-17fdca350a16 service nova] Acquiring lock "refresh_cache-3954da38-0292-40f7-8ace-6987d0248a44" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:17:10 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:17:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e280a435-d5f2-44ad-ab07-3d33094ab89c req-994f948c-ca7c-41a9-8318-6ad5681edf2a service nova] Releasing lock "refresh_cache-c47e8572-bf45-4f91-9ca7-2dbee7972113" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG nova.network.neutron [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG nova.network.neutron [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG nova.policy [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5b056f1b3934edabf209f63a331b71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f1c82bdf46429a93a6dd2973b7f919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:17:10 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Creating image(s)
Aug 15 16:17:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "/opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "/opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.313s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.207s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk 1073741824" returned: 0 in 0.060s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.network.neutron [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Updating instance_info_cache with network_info: [{"id": "9312a7dc-cae1-498e-8151-5dea468286d0", "address": "fa:16:3e:be:cc:d8", "network": {"id": "343457d5-3929-410d-a486-16e7ca4ef8f2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-695787955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "574b067543464efcbb6701547c90a91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9312a7dc-ca", "ovs_interfaceid": "9312a7dc-cae1-498e-8151-5dea468286d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.network.neutron [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Updating instance_info_cache with network_info: [{"id": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "address": "fa:16:3e:7d:a6:b4", "network": {"id": "2d0a7c86-1e60-4ea6-93d7-c66b552d95e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1960989403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888d8da9-c8", "ovs_interfaceid": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Releasing lock "refresh_cache-3954da38-0292-40f7-8ace-6987d0248a44" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Instance network_info: |[{"id": "9312a7dc-cae1-498e-8151-5dea468286d0", "address": "fa:16:3e:be:cc:d8", "network": {"id": "343457d5-3929-410d-a486-16e7ca4ef8f2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-695787955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "574b067543464efcbb6701547c90a91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9312a7dc-ca", "ovs_interfaceid": "9312a7dc-cae1-498e-8151-5dea468286d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1d653716-3419-48a3-bbb4-2e43b352441b req-6b62bcca-17e2-472a-9f57-17fdca350a16 service nova] Acquired lock "refresh_cache-3954da38-0292-40f7-8ace-6987d0248a44" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.network.neutron [req-1d653716-3419-48a3-bbb4-2e43b352441b req-6b62bcca-17e2-472a-9f57-17fdca350a16 service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Refreshing network info cache for port 9312a7dc-cae1-498e-8151-5dea468286d0 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Start _get_guest_xml network_info=[{"id": "9312a7dc-cae1-498e-8151-5dea468286d0", "address": "fa:16:3e:be:cc:d8", "network": {"id": "343457d5-3929-410d-a486-16e7ca4ef8f2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-695787955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "574b067543464efcbb6701547c90a91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9312a7dc-ca", "ovs_interfaceid": "9312a7dc-cae1-498e-8151-5dea468286d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Releasing lock "refresh_cache-7d843493-eda8-46a9-bb1b-3cc80eed7488" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Instance network_info: |[{"id": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "address": "fa:16:3e:7d:a6:b4", "network": {"id": "2d0a7c86-1e60-4ea6-93d7-c66b552d95e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1960989403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888d8da9-c8", "ovs_interfaceid": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-039a909c-c41c-45d7-871d-8eaad35278ce req-260609b2-2b44-475d-a993-ab427e72d847 service nova] Acquired lock "refresh_cache-7d843493-eda8-46a9-bb1b-3cc80eed7488" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.network.neutron [req-039a909c-c41c-45d7-871d-8eaad35278ce req-260609b2-2b44-475d-a993-ab427e72d847 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Refreshing network info cache for port 888d8da9-c8a5-40fd-a421-1a8ec1890f25 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Start _get_guest_xml network_info=[{"id": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "address": "fa:16:3e:7d:a6:b4", "network": {"id": "2d0a7c86-1e60-4ea6-93d7-c66b552d95e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1960989403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888d8da9-c8", "ovs_interfaceid": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:17:11 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:17:11 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:17:11 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:17:11 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1390546721',display_name='tempest-VolumesAssistedSnapshotsTest-server-1390546721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1390546721',id=8,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEc021U9xL6F+lzSp7FwDJkLyIKhbhsVVwQFQBeE5kd/4MXhf5DaQr3E2+3eWMtz+JFny48gBByr9d0rv3mX7Arg0pRMATw/8WoY/4PC2LQUaXQqARtE6N4I68AZMCSARg==',key_name='tempest-keypair-2101886699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='574b067543464efcbb6701547c90a91f',ramdisk_id='',reservation_id='r-k7surjy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-585822675',owner_user_name='tempest-VolumesAssistedSnapshotsTest-585822675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9695ab1e4507498eb7216e616f536c68',uuid=3954da38-0292-40f7-8ace-6987d0248a44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9312a7dc-cae1-498e-8151-5dea468286d0", "address": "fa:16:3e:be:cc:d8", "network": {"id": "343457d5-3929-410d-a486-16e7ca4ef8f2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-695787955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "574b067543464efcbb6701547c90a91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9312a7dc-ca", "ovs_interfaceid": "9312a7dc-cae1-498e-8151-5dea468286d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Converting VIF {"id": "9312a7dc-cae1-498e-8151-5dea468286d0", "address": "fa:16:3e:be:cc:d8", "network": {"id": "343457d5-3929-410d-a486-16e7ca4ef8f2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-695787955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "574b067543464efcbb6701547c90a91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9312a7dc-ca", "ovs_interfaceid": "9312a7dc-cae1-498e-8151-5dea468286d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:cc:d8,bridge_name='br-int',has_traffic_filtering=True,id=9312a7dc-cae1-498e-8151-5dea468286d0,network=Network(343457d5-3929-410d-a486-16e7ca4ef8f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9312a7dc-ca') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.objects.instance [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lazy-loading 'pci_devices' on Instance uuid 3954da38-0292-40f7-8ace-6987d0248a44 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.374s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:17:11 user nova-compute[72849]:   <uuid>3954da38-0292-40f7-8ace-6987d0248a44</uuid>
Aug 15 16:17:11 user nova-compute[72849]:   <name>instance-00000008</name>
Aug 15 16:17:11 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:17:11 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:17:11 user nova-compute[72849]:   <metadata>
Aug 15 16:17:11 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:17:11 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:17:11 user nova-compute[72849]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1390546721</nova:name>
Aug 15 16:17:11 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:17:11</nova:creationTime>
Aug 15 16:17:11 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:17:11 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:17:11 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:17:11 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:17:11 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:17:11 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:17:11 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:17:11 user nova-compute[72849]:       <nova:owner>
Aug 15 16:17:11 user nova-compute[72849]:         <nova:user uuid="9695ab1e4507498eb7216e616f536c68">tempest-VolumesAssistedSnapshotsTest-585822675-project-member</nova:user>
Aug 15 16:17:11 user nova-compute[72849]:         <nova:project uuid="574b067543464efcbb6701547c90a91f">tempest-VolumesAssistedSnapshotsTest-585822675</nova:project>
Aug 15 16:17:11 user nova-compute[72849]:       </nova:owner>
Aug 15 16:17:11 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:17:11 user nova-compute[72849]:       <nova:ports>
Aug 15 16:17:11 user nova-compute[72849]:         <nova:port uuid="9312a7dc-cae1-498e-8151-5dea468286d0">
Aug 15 16:17:11 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 16:17:11 user nova-compute[72849]:         </nova:port>
Aug 15 16:17:11 user nova-compute[72849]:       </nova:ports>
Aug 15 16:17:11 user nova-compute[72849]:     </nova:instance>
Aug 15 16:17:11 user nova-compute[72849]:   </metadata>
Aug 15 16:17:11 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:17:11 user nova-compute[72849]:     <system>
Aug 15 16:17:11 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:17:11 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:17:11 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:17:11 user nova-compute[72849]:       <entry name="serial">3954da38-0292-40f7-8ace-6987d0248a44</entry>
Aug 15 16:17:11 user nova-compute[72849]:       <entry name="uuid">3954da38-0292-40f7-8ace-6987d0248a44</entry>
Aug 15 16:17:11 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:17:11 user nova-compute[72849]:     </system>
Aug 15 16:17:11 user nova-compute[72849]:   </sysinfo>
Aug 15 16:17:11 user nova-compute[72849]:   <os>
Aug 15 16:17:11 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:17:11 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:17:11 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:17:11 user nova-compute[72849]:   </os>
Aug 15 16:17:11 user nova-compute[72849]:   <features>
Aug 15 16:17:11 user nova-compute[72849]:     <acpi/>
Aug 15 16:17:11 user nova-compute[72849]:     <apic/>
Aug 15 16:17:11 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:17:11 user nova-compute[72849]:   </features>
Aug 15 16:17:11 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:17:11 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:17:11 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:17:11 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:17:11 user nova-compute[72849]:   </clock>
Aug 15 16:17:11 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:17:11 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:17:11 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:17:11 user nova-compute[72849]:   </cpu>
Aug 15 16:17:11 user nova-compute[72849]:   <devices>
Aug 15 16:17:11 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:17:11 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:17:11 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk"/>
Aug 15 16:17:11 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:17:11 user nova-compute[72849]:     </disk>
Aug 15 16:17:11 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:17:11 user nova-compute[72849]:       <mac address="fa:16:3e:be:cc:d8"/>
Aug 15 16:17:11 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:17:11 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:17:11 user nova-compute[72849]:       <target dev="tap9312a7dc-ca"/>
Aug 15 16:17:11 user nova-compute[72849]:     </interface>
Aug 15 16:17:11 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:17:11 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/console.log" append="off"/>
Aug 15 16:17:11 user nova-compute[72849]:     </serial>
Aug 15 16:17:11 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:17:11 user nova-compute[72849]:     <video>
Aug 15 16:17:11 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:17:11 user nova-compute[72849]:     </video>
Aug 15 16:17:11 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:17:11 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:17:11 user nova-compute[72849]:     </rng>
Aug 15 16:17:11 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:17:11 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:17:11 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:17:11 user nova-compute[72849]:     </memballoon>
Aug 15 16:17:11 user nova-compute[72849]:   </devices>
Aug 15 16:17:11 user nova-compute[72849]: </domain>
Aug 15 16:17:11 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1390546721',display_name='tempest-VolumesAssistedSnapshotsTest-server-1390546721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1390546721',id=8,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEc021U9xL6F+lzSp7FwDJkLyIKhbhsVVwQFQBeE5kd/4MXhf5DaQr3E2+3eWMtz+JFny48gBByr9d0rv3mX7Arg0pRMATw/8WoY/4PC2LQUaXQqARtE6N4I68AZMCSARg==',key_name='tempest-keypair-2101886699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='574b067543464efcbb6701547c90a91f',ramdisk_id='',reservation_id='r-k7surjy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-585822675',owner_user_name='tempest-VolumesAssistedSnapshotsTest-585822675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9695ab1e4507498eb7216e616f536c68',uuid=3954da38-0292-40f7-8ace-6987d0248a44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9312a7dc-cae1-498e-8151-5dea468286d0", "address": "fa:16:3e:be:cc:d8", "network": {"id": "343457d5-3929-410d-a486-16e7ca4ef8f2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-695787955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "574b067543464efcbb6701547c90a91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9312a7dc-ca", "ovs_interfaceid": "9312a7dc-cae1-498e-8151-5dea468286d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Converting VIF {"id": "9312a7dc-cae1-498e-8151-5dea468286d0", "address": "fa:16:3e:be:cc:d8", "network": {"id": "343457d5-3929-410d-a486-16e7ca4ef8f2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-695787955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "574b067543464efcbb6701547c90a91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9312a7dc-ca", "ovs_interfaceid": "9312a7dc-cae1-498e-8151-5dea468286d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:cc:d8,bridge_name='br-int',has_traffic_filtering=True,id=9312a7dc-cae1-498e-8151-5dea468286d0,network=Network(343457d5-3929-410d-a486-16e7ca4ef8f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9312a7dc-ca') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG os_vif [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:cc:d8,bridge_name='br-int',has_traffic_filtering=True,id=9312a7dc-cae1-498e-8151-5dea468286d0,network=Network(343457d5-3929-410d-a486-16e7ca4ef8f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9312a7dc-ca') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9312a7dc-ca, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9312a7dc-ca, col_values=(('external_ids', {'iface-id': '9312a7dc-cae1-498e-8151-5dea468286d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:cc:d8', 'vm-uuid': '3954da38-0292-40f7-8ace-6987d0248a44'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-215597638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-215597638',id=7,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdbWakgm9rkhjBkOdQBASg9y5tRST/eN38nlLPxQcgrQZwoqRDKC9b5dSss1Yo4J4gifxLRY6ThnnWU08v57v9/fZXdXuUr1hxB2yLXnfesqIyRH5q7Iz1U8TLWUXIMbw==',key_name='tempest-keypair-627680743',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de78e6bddce4402d9829b94e9bd6cf05',ramdisk_id='',reservation_id='r-aag6oo7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-415257394',owner_user_name='tempest-TaggedAttachmentsTest-415257394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a442003f0164870905327b6b5f1a0b2',uuid=7d843493-eda8-46a9-bb1b-3cc80eed7488,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "address": "fa:16:3e:7d:a6:b4", "network": {"id": "2d0a7c86-1e60-4ea6-93d7-c66b552d95e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1960989403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888d8da9-c8", "ovs_interfaceid": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Converting VIF {"id": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "address": "fa:16:3e:7d:a6:b4", "network": {"id": "2d0a7c86-1e60-4ea6-93d7-c66b552d95e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1960989403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888d8da9-c8", "ovs_interfaceid": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:a6:b4,bridge_name='br-int',has_traffic_filtering=True,id=888d8da9-c8a5-40fd-a421-1a8ec1890f25,network=Network(2d0a7c86-1e60-4ea6-93d7-c66b552d95e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888d8da9-c8') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.objects.instance [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d843493-eda8-46a9-bb1b-3cc80eed7488 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:11 user nova-compute[72849]: INFO os_vif [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:cc:d8,bridge_name='br-int',has_traffic_filtering=True,id=9312a7dc-cae1-498e-8151-5dea468286d0,network=Network(343457d5-3929-410d-a486-16e7ca4ef8f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9312a7dc-ca')
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:17:11 user nova-compute[72849]:   <uuid>7d843493-eda8-46a9-bb1b-3cc80eed7488</uuid>
Aug 15 16:17:11 user nova-compute[72849]:   <name>instance-00000007</name>
Aug 15 16:17:11 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:17:11 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:17:11 user nova-compute[72849]:   <metadata>
Aug 15 16:17:11 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:17:11 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:17:11 user nova-compute[72849]:       <nova:name>tempest-device-tagging-server-215597638</nova:name>
Aug 15 16:17:11 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:17:11</nova:creationTime>
Aug 15 16:17:11 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:17:11 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:17:11 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:17:11 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:17:11 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:17:11 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:17:11 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:17:11 user nova-compute[72849]:       <nova:owner>
Aug 15 16:17:11 user nova-compute[72849]:         <nova:user uuid="9a442003f0164870905327b6b5f1a0b2">tempest-TaggedAttachmentsTest-415257394-project-member</nova:user>
Aug 15 16:17:11 user nova-compute[72849]:         <nova:project uuid="de78e6bddce4402d9829b94e9bd6cf05">tempest-TaggedAttachmentsTest-415257394</nova:project>
Aug 15 16:17:11 user nova-compute[72849]:       </nova:owner>
Aug 15 16:17:11 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:17:11 user nova-compute[72849]:       <nova:ports>
Aug 15 16:17:11 user nova-compute[72849]:         <nova:port uuid="888d8da9-c8a5-40fd-a421-1a8ec1890f25">
Aug 15 16:17:11 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:17:11 user nova-compute[72849]:         </nova:port>
Aug 15 16:17:11 user nova-compute[72849]:       </nova:ports>
Aug 15 16:17:11 user nova-compute[72849]:     </nova:instance>
Aug 15 16:17:11 user nova-compute[72849]:   </metadata>
Aug 15 16:17:11 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:17:11 user nova-compute[72849]:     <system>
Aug 15 16:17:11 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:17:11 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:17:11 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:17:11 user nova-compute[72849]:       <entry name="serial">7d843493-eda8-46a9-bb1b-3cc80eed7488</entry>
Aug 15 16:17:11 user nova-compute[72849]:       <entry name="uuid">7d843493-eda8-46a9-bb1b-3cc80eed7488</entry>
Aug 15 16:17:11 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:17:11 user nova-compute[72849]:     </system>
Aug 15 16:17:11 user nova-compute[72849]:   </sysinfo>
Aug 15 16:17:11 user nova-compute[72849]:   <os>
Aug 15 16:17:11 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:17:11 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:17:11 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:17:11 user nova-compute[72849]:   </os>
Aug 15 16:17:11 user nova-compute[72849]:   <features>
Aug 15 16:17:11 user nova-compute[72849]:     <acpi/>
Aug 15 16:17:11 user nova-compute[72849]:     <apic/>
Aug 15 16:17:11 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:17:11 user nova-compute[72849]:   </features>
Aug 15 16:17:11 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:17:11 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:17:11 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:17:11 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:17:11 user nova-compute[72849]:   </clock>
Aug 15 16:17:11 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:17:11 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:17:11 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:17:11 user nova-compute[72849]:   </cpu>
Aug 15 16:17:11 user nova-compute[72849]:   <devices>
Aug 15 16:17:11 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:17:11 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:17:11 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk"/>
Aug 15 16:17:11 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:17:11 user nova-compute[72849]:     </disk>
Aug 15 16:17:11 user nova-compute[72849]:     <disk type="file" device="cdrom">
Aug 15 16:17:11 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 16:17:11 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk.config"/>
Aug 15 16:17:11 user nova-compute[72849]:       <target dev="hda" bus="ide"/>
Aug 15 16:17:11 user nova-compute[72849]:     </disk>
Aug 15 16:17:11 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:17:11 user nova-compute[72849]:       <mac address="fa:16:3e:7d:a6:b4"/>
Aug 15 16:17:11 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:17:11 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:17:11 user nova-compute[72849]:       <target dev="tap888d8da9-c8"/>
Aug 15 16:17:11 user nova-compute[72849]:     </interface>
Aug 15 16:17:11 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:17:11 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/console.log" append="off"/>
Aug 15 16:17:11 user nova-compute[72849]:     </serial>
Aug 15 16:17:11 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:17:11 user nova-compute[72849]:     <video>
Aug 15 16:17:11 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:17:11 user nova-compute[72849]:     </video>
Aug 15 16:17:11 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:17:11 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:17:11 user nova-compute[72849]:     </rng>
Aug 15 16:17:11 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:17:11 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:17:11 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:17:11 user nova-compute[72849]:     </memballoon>
Aug 15 16:17:11 user nova-compute[72849]:   </devices>
Aug 15 16:17:11 user nova-compute[72849]: </domain>
Aug 15 16:17:11 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-215597638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-215597638',id=7,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdbWakgm9rkhjBkOdQBASg9y5tRST/eN38nlLPxQcgrQZwoqRDKC9b5dSss1Yo4J4gifxLRY6ThnnWU08v57v9/fZXdXuUr1hxB2yLXnfesqIyRH5q7Iz1U8TLWUXIMbw==',key_name='tempest-keypair-627680743',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de78e6bddce4402d9829b94e9bd6cf05',ramdisk_id='',reservation_id='r-aag6oo7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-415257394',owner_user_name='tempest-TaggedAttachmentsTest-415257394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a442003f0164870905327b6b5f1a0b2',uuid=7d843493-eda8-46a9-bb1b-3cc80eed7488,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "address": "fa:16:3e:7d:a6:b4", "network": {"id": "2d0a7c86-1e60-4ea6-93d7-c66b552d95e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1960989403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888d8da9-c8", "ovs_interfaceid": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Converting VIF {"id": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "address": "fa:16:3e:7d:a6:b4", "network": {"id": "2d0a7c86-1e60-4ea6-93d7-c66b552d95e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1960989403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888d8da9-c8", "ovs_interfaceid": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:a6:b4,bridge_name='br-int',has_traffic_filtering=True,id=888d8da9-c8a5-40fd-a421-1a8ec1890f25,network=Network(2d0a7c86-1e60-4ea6-93d7-c66b552d95e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888d8da9-c8') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG os_vif [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:a6:b4,bridge_name='br-int',has_traffic_filtering=True,id=888d8da9-c8a5-40fd-a421-1a8ec1890f25,network=Network(2d0a7c86-1e60-4ea6-93d7-c66b552d95e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888d8da9-c8') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap888d8da9-c8, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap888d8da9-c8, col_values=(('external_ids', {'iface-id': '888d8da9-c8a5-40fd-a421-1a8ec1890f25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:a6:b4', 'vm-uuid': '7d843493-eda8-46a9-bb1b-3cc80eed7488'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Cannot resize image /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.objects.instance [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lazy-loading 'migration_context' on Instance uuid 5c64c95c-74b3-4883-94d2-ee99ff27434e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Ensure instance console log exists: /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:11 user nova-compute[72849]: INFO os_vif [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:a6:b4,bridge_name='br-int',has_traffic_filtering=True,id=888d8da9-c8a5-40fd-a421-1a8ec1890f25,network=Network(2d0a7c86-1e60-4ea6-93d7-c66b552d95e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888d8da9-c8')
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] No VIF found with MAC fa:16:3e:be:cc:d8, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] No BDM found with device name hda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] No VIF found with MAC fa:16:3e:7d:a6:b4, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:17:11 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Using config drive
Aug 15 16:17:11 user nova-compute[72849]: DEBUG nova.network.neutron [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Successfully created port: 9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:12 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Creating config drive at /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk.config
Aug 15 16:17:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpaesc5d7o {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG nova.network.neutron [req-1d653716-3419-48a3-bbb4-2e43b352441b req-6b62bcca-17e2-472a-9f57-17fdca350a16 service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Updated VIF entry in instance network info cache for port 9312a7dc-cae1-498e-8151-5dea468286d0. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG nova.network.neutron [req-1d653716-3419-48a3-bbb4-2e43b352441b req-6b62bcca-17e2-472a-9f57-17fdca350a16 service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Updating instance_info_cache with network_info: [{"id": "9312a7dc-cae1-498e-8151-5dea468286d0", "address": "fa:16:3e:be:cc:d8", "network": {"id": "343457d5-3929-410d-a486-16e7ca4ef8f2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-695787955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "574b067543464efcbb6701547c90a91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9312a7dc-ca", "ovs_interfaceid": "9312a7dc-cae1-498e-8151-5dea468286d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpaesc5d7o" returned: 0 in 0.074s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1d653716-3419-48a3-bbb4-2e43b352441b req-6b62bcca-17e2-472a-9f57-17fdca350a16 service nova] Releasing lock "refresh_cache-3954da38-0292-40f7-8ace-6987d0248a44" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG nova.network.neutron [req-039a909c-c41c-45d7-871d-8eaad35278ce req-260609b2-2b44-475d-a993-ab427e72d847 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Updated VIF entry in instance network info cache for port 888d8da9-c8a5-40fd-a421-1a8ec1890f25. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG nova.network.neutron [req-039a909c-c41c-45d7-871d-8eaad35278ce req-260609b2-2b44-475d-a993-ab427e72d847 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Updating instance_info_cache with network_info: [{"id": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "address": "fa:16:3e:7d:a6:b4", "network": {"id": "2d0a7c86-1e60-4ea6-93d7-c66b552d95e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1960989403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888d8da9-c8", "ovs_interfaceid": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-039a909c-c41c-45d7-871d-8eaad35278ce req-260609b2-2b44-475d-a993-ab427e72d847 service nova] Releasing lock "refresh_cache-7d843493-eda8-46a9-bb1b-3cc80eed7488" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG nova.network.neutron [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Successfully updated port: 9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Acquiring lock "refresh_cache-5c64c95c-74b3-4883-94d2-ee99ff27434e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Acquired lock "refresh_cache-5c64c95c-74b3-4883-94d2-ee99ff27434e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG nova.network.neutron [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-d082f458-1b8d-4d30-ab77-30b4baa20b0f req-417828c0-cda1-4711-b836-61b0df92d053 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received event network-changed-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-d082f458-1b8d-4d30-ab77-30b4baa20b0f req-417828c0-cda1-4711-b836-61b0df92d053 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Refreshing instance network info cache due to event network-changed-9c27980b-1f4d-4a61-9648-9ed67abcb551. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:17:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d082f458-1b8d-4d30-ab77-30b4baa20b0f req-417828c0-cda1-4711-b836-61b0df92d053 service nova] Acquiring lock "refresh_cache-5c64c95c-74b3-4883-94d2-ee99ff27434e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.network.neutron [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] There are 0 instances to clean {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72849) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.network.neutron [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Updating instance_info_cache with network_info: [{"id": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "address": "fa:16:3e:64:08:de", "network": {"id": "367bc2da-ca51-4fa8-a4f9-70a3344f28b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-621548180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8f1c82bdf46429a93a6dd2973b7f919", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c27980b-1f", "ovs_interfaceid": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Releasing lock "refresh_cache-5c64c95c-74b3-4883-94d2-ee99ff27434e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Instance network_info: |[{"id": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "address": "fa:16:3e:64:08:de", "network": {"id": "367bc2da-ca51-4fa8-a4f9-70a3344f28b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-621548180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8f1c82bdf46429a93a6dd2973b7f919", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c27980b-1f", "ovs_interfaceid": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d082f458-1b8d-4d30-ab77-30b4baa20b0f req-417828c0-cda1-4711-b836-61b0df92d053 service nova] Acquired lock "refresh_cache-5c64c95c-74b3-4883-94d2-ee99ff27434e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.network.neutron [req-d082f458-1b8d-4d30-ab77-30b4baa20b0f req-417828c0-cda1-4711-b836-61b0df92d053 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Refreshing network info cache for port 9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Start _get_guest_xml network_info=[{"id": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "address": "fa:16:3e:64:08:de", "network": {"id": "367bc2da-ca51-4fa8-a4f9-70a3344f28b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-621548180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8f1c82bdf46429a93a6dd2973b7f919", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c27980b-1f", "ovs_interfaceid": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:17:13 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:17:13 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1404482482',display_name='tempest-TestVolumeSwap-server-1404482482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1404482482',id=9,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLaBHKDX+X3fd1RTY+ja/SKlxlHanevj0RHqdFc1OVmkWXiPM+/hoqM/lyYZhJ4KEks7QfJHAf83BSbwkksZMlHSgx9w9SchF+XrBveDvyGVK/80gerpyDJZL7Q3QQTtw==',key_name='tempest-keypair-1595369339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8f1c82bdf46429a93a6dd2973b7f919',ramdisk_id='',reservation_id='r-obt89w0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1560445128',owner_user_name='tempest-TestVolumeSwap-1560445128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5b056f1b3934edabf209f63a331b71c',uuid=5c64c95c-74b3-4883-94d2-ee99ff27434e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "address": "fa:16:3e:64:08:de", "network": {"id": "367bc2da-ca51-4fa8-a4f9-70a3344f28b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-621548180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8f1c82bdf46429a93a6dd2973b7f919", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c27980b-1f", "ovs_interfaceid": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Converting VIF {"id": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "address": "fa:16:3e:64:08:de", "network": {"id": "367bc2da-ca51-4fa8-a4f9-70a3344f28b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-621548180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8f1c82bdf46429a93a6dd2973b7f919", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c27980b-1f", "ovs_interfaceid": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:08:de,bridge_name='br-int',has_traffic_filtering=True,id=9c27980b-1f4d-4a61-9648-9ed67abcb551,network=Network(367bc2da-ca51-4fa8-a4f9-70a3344f28b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c27980b-1f') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.objects.instance [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c64c95c-74b3-4883-94d2-ee99ff27434e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:17:13 user nova-compute[72849]:   <uuid>5c64c95c-74b3-4883-94d2-ee99ff27434e</uuid>
Aug 15 16:17:13 user nova-compute[72849]:   <name>instance-00000009</name>
Aug 15 16:17:13 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:17:13 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:17:13 user nova-compute[72849]:   <metadata>
Aug 15 16:17:13 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:17:13 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:17:13 user nova-compute[72849]:       <nova:name>tempest-TestVolumeSwap-server-1404482482</nova:name>
Aug 15 16:17:13 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:17:13</nova:creationTime>
Aug 15 16:17:13 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:17:13 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:17:13 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:17:13 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:17:13 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:17:13 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:17:13 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:17:13 user nova-compute[72849]:       <nova:owner>
Aug 15 16:17:13 user nova-compute[72849]:         <nova:user uuid="b5b056f1b3934edabf209f63a331b71c">tempest-TestVolumeSwap-1560445128-project-member</nova:user>
Aug 15 16:17:13 user nova-compute[72849]:         <nova:project uuid="e8f1c82bdf46429a93a6dd2973b7f919">tempest-TestVolumeSwap-1560445128</nova:project>
Aug 15 16:17:13 user nova-compute[72849]:       </nova:owner>
Aug 15 16:17:13 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:17:13 user nova-compute[72849]:       <nova:ports>
Aug 15 16:17:13 user nova-compute[72849]:         <nova:port uuid="9c27980b-1f4d-4a61-9648-9ed67abcb551">
Aug 15 16:17:13 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:17:13 user nova-compute[72849]:         </nova:port>
Aug 15 16:17:13 user nova-compute[72849]:       </nova:ports>
Aug 15 16:17:13 user nova-compute[72849]:     </nova:instance>
Aug 15 16:17:13 user nova-compute[72849]:   </metadata>
Aug 15 16:17:13 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:17:13 user nova-compute[72849]:     <system>
Aug 15 16:17:13 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:17:13 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:17:13 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:17:13 user nova-compute[72849]:       <entry name="serial">5c64c95c-74b3-4883-94d2-ee99ff27434e</entry>
Aug 15 16:17:13 user nova-compute[72849]:       <entry name="uuid">5c64c95c-74b3-4883-94d2-ee99ff27434e</entry>
Aug 15 16:17:13 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:17:13 user nova-compute[72849]:     </system>
Aug 15 16:17:13 user nova-compute[72849]:   </sysinfo>
Aug 15 16:17:13 user nova-compute[72849]:   <os>
Aug 15 16:17:13 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:17:13 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:17:13 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:17:13 user nova-compute[72849]:   </os>
Aug 15 16:17:13 user nova-compute[72849]:   <features>
Aug 15 16:17:13 user nova-compute[72849]:     <acpi/>
Aug 15 16:17:13 user nova-compute[72849]:     <apic/>
Aug 15 16:17:13 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:17:13 user nova-compute[72849]:   </features>
Aug 15 16:17:13 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:17:13 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:17:13 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:17:13 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:17:13 user nova-compute[72849]:   </clock>
Aug 15 16:17:13 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:17:13 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:17:13 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:17:13 user nova-compute[72849]:   </cpu>
Aug 15 16:17:13 user nova-compute[72849]:   <devices>
Aug 15 16:17:13 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:17:13 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:17:13 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk"/>
Aug 15 16:17:13 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:17:13 user nova-compute[72849]:     </disk>
Aug 15 16:17:13 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:17:13 user nova-compute[72849]:       <mac address="fa:16:3e:64:08:de"/>
Aug 15 16:17:13 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:17:13 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:17:13 user nova-compute[72849]:       <target dev="tap9c27980b-1f"/>
Aug 15 16:17:13 user nova-compute[72849]:     </interface>
Aug 15 16:17:13 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:17:13 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/console.log" append="off"/>
Aug 15 16:17:13 user nova-compute[72849]:     </serial>
Aug 15 16:17:13 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:17:13 user nova-compute[72849]:     <video>
Aug 15 16:17:13 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:17:13 user nova-compute[72849]:     </video>
Aug 15 16:17:13 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:17:13 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:17:13 user nova-compute[72849]:     </rng>
Aug 15 16:17:13 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:17:13 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:17:13 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:17:13 user nova-compute[72849]:     </memballoon>
Aug 15 16:17:13 user nova-compute[72849]:   </devices>
Aug 15 16:17:13 user nova-compute[72849]: </domain>
Aug 15 16:17:13 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1404482482',display_name='tempest-TestVolumeSwap-server-1404482482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1404482482',id=9,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLaBHKDX+X3fd1RTY+ja/SKlxlHanevj0RHqdFc1OVmkWXiPM+/hoqM/lyYZhJ4KEks7QfJHAf83BSbwkksZMlHSgx9w9SchF+XrBveDvyGVK/80gerpyDJZL7Q3QQTtw==',key_name='tempest-keypair-1595369339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8f1c82bdf46429a93a6dd2973b7f919',ramdisk_id='',reservation_id='r-obt89w0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1560445128',owner_user_name='tempest-TestVolumeSwap-1560445128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5b056f1b3934edabf209f63a331b71c',uuid=5c64c95c-74b3-4883-94d2-ee99ff27434e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "address": "fa:16:3e:64:08:de", "network": {"id": "367bc2da-ca51-4fa8-a4f9-70a3344f28b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-621548180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8f1c82bdf46429a93a6dd2973b7f919", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c27980b-1f", "ovs_interfaceid": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Converting VIF {"id": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "address": "fa:16:3e:64:08:de", "network": {"id": "367bc2da-ca51-4fa8-a4f9-70a3344f28b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-621548180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8f1c82bdf46429a93a6dd2973b7f919", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c27980b-1f", "ovs_interfaceid": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:08:de,bridge_name='br-int',has_traffic_filtering=True,id=9c27980b-1f4d-4a61-9648-9ed67abcb551,network=Network(367bc2da-ca51-4fa8-a4f9-70a3344f28b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c27980b-1f') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG os_vif [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:08:de,bridge_name='br-int',has_traffic_filtering=True,id=9c27980b-1f4d-4a61-9648-9ed67abcb551,network=Network(367bc2da-ca51-4fa8-a4f9-70a3344f28b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c27980b-1f') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c27980b-1f, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c27980b-1f, col_values=(('external_ids', {'iface-id': '9c27980b-1f4d-4a61-9648-9ed67abcb551', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:08:de', 'vm-uuid': '5c64c95c-74b3-4883-94d2-ee99ff27434e'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:13 user nova-compute[72849]: INFO os_vif [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:08:de,bridge_name='br-int',has_traffic_filtering=True,id=9c27980b-1f4d-4a61-9648-9ed67abcb551,network=Network(367bc2da-ca51-4fa8-a4f9-70a3344f28b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c27980b-1f')
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116233.923354, c47e8572-bf45-4f91-9ca7-2dbee7972113 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:17:13 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] VM Resumed (Lifecycle Event)
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] No VIF found with MAC fa:16:3e:64:08:de, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:17:13 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Instance spawned successfully.
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:17:14 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:17:14 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116233.9254503, c47e8572-bf45-4f91-9ca7-2dbee7972113 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:17:14 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] VM Started (Lifecycle Event)
Aug 15 16:17:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:17:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:17:14 user nova-compute[72849]: INFO nova.compute.manager [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Took 10.26 seconds to spawn the instance on the hypervisor.
Aug 15 16:17:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:17:14 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:17:14 user nova-compute[72849]: INFO nova.compute.manager [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Took 11.67 seconds to build instance.
Aug 15 16:17:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2340fd8b-2855-46c3-8755-33f43b4a56ed tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.820s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:14 user nova-compute[72849]: DEBUG nova.network.neutron [req-d082f458-1b8d-4d30-ab77-30b4baa20b0f req-417828c0-cda1-4711-b836-61b0df92d053 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Updated VIF entry in instance network info cache for port 9c27980b-1f4d-4a61-9648-9ed67abcb551. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:17:14 user nova-compute[72849]: DEBUG nova.network.neutron [req-d082f458-1b8d-4d30-ab77-30b4baa20b0f req-417828c0-cda1-4711-b836-61b0df92d053 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Updating instance_info_cache with network_info: [{"id": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "address": "fa:16:3e:64:08:de", "network": {"id": "367bc2da-ca51-4fa8-a4f9-70a3344f28b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-621548180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8f1c82bdf46429a93a6dd2973b7f919", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c27980b-1f", "ovs_interfaceid": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:17:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d082f458-1b8d-4d30-ab77-30b4baa20b0f req-417828c0-cda1-4711-b836-61b0df92d053 service nova] Releasing lock "refresh_cache-5c64c95c-74b3-4883-94d2-ee99ff27434e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:17:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:16 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:17:16 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:17:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:17 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:17:17 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:17:17 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:17:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:17:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:18 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:17:18 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:17:18 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:17:18 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Skipping network cache update for instance because it is Building. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 16:17:18 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Skipping network cache update for instance because it is Building. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 16:17:18 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Skipping network cache update for instance because it is Building. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 16:17:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:17:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:17:18 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:17:18 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:17:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-8c076806-98a7-4cf1-9bdf-31b58588a5cd req-08819b66-3734-4331-b59b-729b532d0ef5 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received event network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8c076806-98a7-4cf1-9bdf-31b58588a5cd req-08819b66-3734-4331-b59b-729b532d0ef5 service nova] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8c076806-98a7-4cf1-9bdf-31b58588a5cd req-08819b66-3734-4331-b59b-729b532d0ef5 service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8c076806-98a7-4cf1-9bdf-31b58588a5cd req-08819b66-3734-4331-b59b-729b532d0ef5 service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-8c076806-98a7-4cf1-9bdf-31b58588a5cd req-08819b66-3734-4331-b59b-729b532d0ef5 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] No waiting events found dispatching network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:17:18 user nova-compute[72849]: WARNING nova.compute.manager [req-8c076806-98a7-4cf1-9bdf-31b58588a5cd req-08819b66-3734-4331-b59b-729b532d0ef5 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received unexpected event network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 for instance with vm_state active and task_state None.
Aug 15 16:17:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116239.208099, 3954da38-0292-40f7-8ace-6987d0248a44 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] VM Resumed (Lifecycle Event)
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Instance spawned successfully.
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Updating instance_info_cache with network_info: [{"id": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "address": "fa:16:3e:18:f5:fe", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88628ea8-90", "ovs_interfaceid": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116239.208259, 3954da38-0292-40f7-8ace-6987d0248a44 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] VM Started (Lifecycle Event)
Aug 15 16:17:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.compute.manager [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Took 13.90 seconds to spawn the instance on the hypervisor.
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.compute.manager [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Took 15.82 seconds to build instance.
Aug 15 16:17:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf794385-dbe3-444e-93c9-b1507546ecfa tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lock "3954da38-0292-40f7-8ace-6987d0248a44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.963s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116239.5725324, 5c64c95c-74b3-4883-94d2-ee99ff27434e => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] VM Resumed (Lifecycle Event)
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Instance spawned successfully.
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116239.5771508, 5c64c95c-74b3-4883-94d2-ee99ff27434e => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] VM Started (Lifecycle Event)
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Instance spawned successfully.
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116239.5871484, 7d843493-eda8-46a9-bb1b-3cc80eed7488 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] VM Resumed (Lifecycle Event)
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.compute.manager [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Took 9.40 seconds to spawn the instance on the hypervisor.
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.compute.manager [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Took 13.50 seconds to spawn the instance on the hypervisor.
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116239.594815, 7d843493-eda8-46a9-bb1b-3cc80eed7488 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] VM Started (Lifecycle Event)
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:17:20 user nova-compute[72849]: INFO nova.compute.manager [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Took 16.35 seconds to build instance.
Aug 15 16:17:20 user nova-compute[72849]: INFO nova.compute.manager [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Took 11.23 seconds to build instance.
Aug 15 16:17:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-def3fbda-536a-49bc-af87-8cb243e16daf tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.514s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-136b2373-4dee-4efa-b37d-dd7b09ffd625 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.450s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk --force-share --output=json" returned: 0 in 0.342s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-c507b9d1-af7b-4280-937b-0f5a00e009c4 req-ae423603-035d-4265-8753-a83147ce837d service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received event network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c507b9d1-af7b-4280-937b-0f5a00e009c4 req-ae423603-035d-4265-8753-a83147ce837d service nova] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c507b9d1-af7b-4280-937b-0f5a00e009c4 req-ae423603-035d-4265-8753-a83147ce837d service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c507b9d1-af7b-4280-937b-0f5a00e009c4 req-ae423603-035d-4265-8753-a83147ce837d service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-c507b9d1-af7b-4280-937b-0f5a00e009c4 req-ae423603-035d-4265-8753-a83147ce837d service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] No waiting events found dispatching network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:17:20 user nova-compute[72849]: WARNING nova.compute.manager [req-c507b9d1-af7b-4280-937b-0f5a00e009c4 req-ae423603-035d-4265-8753-a83147ce837d service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received unexpected event network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 for instance with vm_state active and task_state None.
Aug 15 16:17:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:24 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:17:24 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:17:24 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=7623MB free_disk=25.79149627685547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:17:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b0a869eb-9ee8-4c31-9786-5b8be7d362a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 341edacc-b44b-4d92-9fcd-982c252fcdd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance c47e8572-bf45-4f91-9ca7-2dbee7972113 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 7d843493-eda8-46a9-bb1b-3cc80eed7488 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 3954da38-0292-40f7-8ace-6987d0248a44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 5c64c95c-74b3-4883-94d2-ee99ff27434e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing inventories for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating ProviderTree inventory for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating inventory in ProviderTree for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing aggregate associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, aggregates: None {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing trait associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-e3deb3d4-cd31-4549-b085-c1bdc70ea12c req-6abfcc2a-a75a-4a13-a04a-1b43f74623da service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Received event network-vif-plugged-c605963e-3827-4ad6-ab40-665c92c252b1 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e3deb3d4-cd31-4549-b085-c1bdc70ea12c req-6abfcc2a-a75a-4a13-a04a-1b43f74623da service nova] Acquiring lock "341edacc-b44b-4d92-9fcd-982c252fcdd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e3deb3d4-cd31-4549-b085-c1bdc70ea12c req-6abfcc2a-a75a-4a13-a04a-1b43f74623da service nova] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e3deb3d4-cd31-4549-b085-c1bdc70ea12c req-6abfcc2a-a75a-4a13-a04a-1b43f74623da service nova] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-e3deb3d4-cd31-4549-b085-c1bdc70ea12c req-6abfcc2a-a75a-4a13-a04a-1b43f74623da service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] No waiting events found dispatching network-vif-plugged-c605963e-3827-4ad6-ab40-665c92c252b1 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:17:25 user nova-compute[72849]: WARNING nova.compute.manager [req-e3deb3d4-cd31-4549-b085-c1bdc70ea12c req-6abfcc2a-a75a-4a13-a04a-1b43f74623da service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Received unexpected event network-vif-plugged-c605963e-3827-4ad6-ab40-665c92c252b1 for instance with vm_state active and task_state None.
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:17:25 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:17:26 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:17:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.085s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Received event network-vif-plugged-c605963e-3827-4ad6-ab40-665c92c252b1 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] Acquiring lock "341edacc-b44b-4d92-9fcd-982c252fcdd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] No waiting events found dispatching network-vif-plugged-c605963e-3827-4ad6-ab40-665c92c252b1 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:17:27 user nova-compute[72849]: WARNING nova.compute.manager [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Received unexpected event network-vif-plugged-c605963e-3827-4ad6-ab40-665c92c252b1 for instance with vm_state active and task_state None.
Aug 15 16:17:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Received event network-vif-plugged-4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] Acquiring lock "c47e8572-bf45-4f91-9ca7-2dbee7972113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] No waiting events found dispatching network-vif-plugged-4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:17:27 user nova-compute[72849]: WARNING nova.compute.manager [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Received unexpected event network-vif-plugged-4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e for instance with vm_state active and task_state None.
Aug 15 16:17:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Received event network-vif-plugged-4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] Acquiring lock "c47e8572-bf45-4f91-9ca7-2dbee7972113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] No waiting events found dispatching network-vif-plugged-4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:17:27 user nova-compute[72849]: WARNING nova.compute.manager [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Received unexpected event network-vif-plugged-4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e for instance with vm_state active and task_state None.
Aug 15 16:17:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Received event network-vif-plugged-9312a7dc-cae1-498e-8151-5dea468286d0 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] Acquiring lock "3954da38-0292-40f7-8ace-6987d0248a44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] Lock "3954da38-0292-40f7-8ace-6987d0248a44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] Lock "3954da38-0292-40f7-8ace-6987d0248a44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] No waiting events found dispatching network-vif-plugged-9312a7dc-cae1-498e-8151-5dea468286d0 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:17:27 user nova-compute[72849]: WARNING nova.compute.manager [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Received unexpected event network-vif-plugged-9312a7dc-cae1-498e-8151-5dea468286d0 for instance with vm_state active and task_state None.
Aug 15 16:17:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Received event network-vif-plugged-9312a7dc-cae1-498e-8151-5dea468286d0 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] Acquiring lock "3954da38-0292-40f7-8ace-6987d0248a44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] Lock "3954da38-0292-40f7-8ace-6987d0248a44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] Lock "3954da38-0292-40f7-8ace-6987d0248a44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] No waiting events found dispatching network-vif-plugged-9312a7dc-cae1-498e-8151-5dea468286d0 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:17:27 user nova-compute[72849]: WARNING nova.compute.manager [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Received unexpected event network-vif-plugged-9312a7dc-cae1-498e-8151-5dea468286d0 for instance with vm_state active and task_state None.
Aug 15 16:17:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received event network-vif-plugged-888d8da9-c8a5-40fd-a421-1a8ec1890f25 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] Acquiring lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] No waiting events found dispatching network-vif-plugged-888d8da9-c8a5-40fd-a421-1a8ec1890f25 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:17:27 user nova-compute[72849]: WARNING nova.compute.manager [req-48be80d7-c6e5-4536-a75d-42f4bfddafa1 req-b34d4337-e1cd-4b8e-bb6a-d8bcbf500537 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received unexpected event network-vif-plugged-888d8da9-c8a5-40fd-a421-1a8ec1890f25 for instance with vm_state active and task_state None.
Aug 15 16:17:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:29 user nova-compute[72849]: DEBUG nova.compute.manager [req-df276894-2059-4d89-80c4-aa154baf5375 req-93d76753-74f4-4fe6-a43a-8d304c0bd5d2 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received event network-vif-plugged-888d8da9-c8a5-40fd-a421-1a8ec1890f25 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-df276894-2059-4d89-80c4-aa154baf5375 req-93d76753-74f4-4fe6-a43a-8d304c0bd5d2 service nova] Acquiring lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-df276894-2059-4d89-80c4-aa154baf5375 req-93d76753-74f4-4fe6-a43a-8d304c0bd5d2 service nova] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-df276894-2059-4d89-80c4-aa154baf5375 req-93d76753-74f4-4fe6-a43a-8d304c0bd5d2 service nova] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:29 user nova-compute[72849]: DEBUG nova.compute.manager [req-df276894-2059-4d89-80c4-aa154baf5375 req-93d76753-74f4-4fe6-a43a-8d304c0bd5d2 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] No waiting events found dispatching network-vif-plugged-888d8da9-c8a5-40fd-a421-1a8ec1890f25 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:17:29 user nova-compute[72849]: WARNING nova.compute.manager [req-df276894-2059-4d89-80c4-aa154baf5375 req-93d76753-74f4-4fe6-a43a-8d304c0bd5d2 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received unexpected event network-vif-plugged-888d8da9-c8a5-40fd-a421-1a8ec1890f25 for instance with vm_state active and task_state None.
Aug 15 16:17:29 user nova-compute[72849]: DEBUG nova.compute.manager [req-df276894-2059-4d89-80c4-aa154baf5375 req-93d76753-74f4-4fe6-a43a-8d304c0bd5d2 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received event network-vif-plugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-df276894-2059-4d89-80c4-aa154baf5375 req-93d76753-74f4-4fe6-a43a-8d304c0bd5d2 service nova] Acquiring lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-df276894-2059-4d89-80c4-aa154baf5375 req-93d76753-74f4-4fe6-a43a-8d304c0bd5d2 service nova] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-df276894-2059-4d89-80c4-aa154baf5375 req-93d76753-74f4-4fe6-a43a-8d304c0bd5d2 service nova] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:29 user nova-compute[72849]: DEBUG nova.compute.manager [req-df276894-2059-4d89-80c4-aa154baf5375 req-93d76753-74f4-4fe6-a43a-8d304c0bd5d2 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] No waiting events found dispatching network-vif-plugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:17:29 user nova-compute[72849]: WARNING nova.compute.manager [req-df276894-2059-4d89-80c4-aa154baf5375 req-93d76753-74f4-4fe6-a43a-8d304c0bd5d2 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received unexpected event network-vif-plugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 for instance with vm_state active and task_state None.
Aug 15 16:17:29 user nova-compute[72849]: DEBUG nova.compute.manager [req-df276894-2059-4d89-80c4-aa154baf5375 req-93d76753-74f4-4fe6-a43a-8d304c0bd5d2 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received event network-vif-plugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-df276894-2059-4d89-80c4-aa154baf5375 req-93d76753-74f4-4fe6-a43a-8d304c0bd5d2 service nova] Acquiring lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-df276894-2059-4d89-80c4-aa154baf5375 req-93d76753-74f4-4fe6-a43a-8d304c0bd5d2 service nova] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-df276894-2059-4d89-80c4-aa154baf5375 req-93d76753-74f4-4fe6-a43a-8d304c0bd5d2 service nova] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:29 user nova-compute[72849]: DEBUG nova.compute.manager [req-df276894-2059-4d89-80c4-aa154baf5375 req-93d76753-74f4-4fe6-a43a-8d304c0bd5d2 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] No waiting events found dispatching network-vif-plugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:17:29 user nova-compute[72849]: WARNING nova.compute.manager [req-df276894-2059-4d89-80c4-aa154baf5375 req-93d76753-74f4-4fe6-a43a-8d304c0bd5d2 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received unexpected event network-vif-plugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 for instance with vm_state active and task_state None.
Aug 15 16:17:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:17:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:17:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:17:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:17:48 user nova-compute[72849]: INFO nova.compute.claims [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Claim successful on node user
Aug 15 16:17:48 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:17:48 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:17:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:17:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:17:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:17:48 user nova-compute[72849]: DEBUG nova.network.neutron [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:17:48 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:17:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:17:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:48 user nova-compute[72849]: INFO nova.virt.block_device [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Booting with volume 09a3bddc-122f-4557-9246-1adbf93a9152 at /dev/vda
Aug 15 16:17:48 user nova-compute[72849]: DEBUG nova.policy [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7af94d2a9ff14736ad788d175f392cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd504c6bf4d1e40f89105b6bb868fbb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:17:49 user nova-compute[72849]: DEBUG os_brick.utils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:17:49 user nova-compute[72849]: INFO oslo.privsep.daemon [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp2try_a4e/privsep.sock']
Aug 15 16:17:49 user sudo[84041]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp2try_a4e/privsep.sock
Aug 15 16:17:49 user sudo[84041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 16:17:49 user nova-compute[72849]: DEBUG nova.network.neutron [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Successfully created port: 3e960116-61a7-4ee5-9eb6-72c9a60f0657 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:17:50 user nova-compute[72849]: DEBUG nova.network.neutron [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Successfully created port: 74249c5d-642c-48c3-aa3e-79f9165580bc {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:17:50 user nova-compute[72849]: DEBUG nova.network.neutron [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Successfully created port: 68f4af0d-01e5-4950-b08a-c8454b09dd3e {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:17:51 user sudo[84041]: pam_unix(sudo:session): session closed for user root
Aug 15 16:17:51 user nova-compute[72849]: INFO oslo.privsep.daemon [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Spawned new privsep daemon via rootwrap
Aug 15 16:17:51 user nova-compute[72849]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 16:17:51 user nova-compute[72849]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 16:17:51 user nova-compute[72849]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 15 16:17:51 user nova-compute[72849]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84060
Aug 15 16:17:51 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b330641-9165-45d6-8320-1042759baa43]: (2,) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8db6e5-a1bb-4302-9f55-ab856f82843e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:17:51 user nova-compute[72849]: WARNING os_brick.initiator.connectors.nvmeof [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 15 16:17:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[778f00fe-a74d-4aea-bfd5-0cc05c2022e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9a4716-45e9-44f7-b15f-e5e28aadd334]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5d2936-cdab-44b2-b0da-d5c16a0877b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:17:51 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:17:51 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[06774f48-4847-4d5d-bf1c-36c334e54d9c]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG os_brick.utils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] <== get_connector_properties: return (2506ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Updating existing volume attachment record: 379070a6-f663-4009-9525-1cf365ea9a25 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:17:51 user nova-compute[72849]: DEBUG nova.network.neutron [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Successfully created port: 3c779d1d-1bdc-4614-b153-60d32915a3b9 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:17:52 user nova-compute[72849]: DEBUG nova.network.neutron [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Successfully created port: be0000b5-95ec-4f3f-9344-3754b9f63a3d {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:17:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:53 user nova-compute[72849]: DEBUG nova.network.neutron [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Successfully updated port: 3e960116-61a7-4ee5-9eb6-72c9a60f0657 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:17:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-c210ed58-9652-4ff9-99bf-68486a4a9ade req-9ab8d7c1-99f9-46d7-9390-9593571236ab service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-changed-3e960116-61a7-4ee5-9eb6-72c9a60f0657 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-c210ed58-9652-4ff9-99bf-68486a4a9ade req-9ab8d7c1-99f9-46d7-9390-9593571236ab service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Refreshing instance network info cache due to event network-changed-3e960116-61a7-4ee5-9eb6-72c9a60f0657. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:17:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c210ed58-9652-4ff9-99bf-68486a4a9ade req-9ab8d7c1-99f9-46d7-9390-9593571236ab service nova] Acquiring lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:17:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c210ed58-9652-4ff9-99bf-68486a4a9ade req-9ab8d7c1-99f9-46d7-9390-9593571236ab service nova] Acquired lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:17:53 user nova-compute[72849]: DEBUG nova.network.neutron [req-c210ed58-9652-4ff9-99bf-68486a4a9ade req-9ab8d7c1-99f9-46d7-9390-9593571236ab service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Refreshing network info cache for port 3e960116-61a7-4ee5-9eb6-72c9a60f0657 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:17:53 user nova-compute[72849]: DEBUG nova.network.neutron [req-c210ed58-9652-4ff9-99bf-68486a4a9ade req-9ab8d7c1-99f9-46d7-9390-9593571236ab service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:17:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:53 user nova-compute[72849]: DEBUG nova.network.neutron [req-c210ed58-9652-4ff9-99bf-68486a4a9ade req-9ab8d7c1-99f9-46d7-9390-9593571236ab service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:17:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c210ed58-9652-4ff9-99bf-68486a4a9ade req-9ab8d7c1-99f9-46d7-9390-9593571236ab service nova] Releasing lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:17:54 user nova-compute[72849]: DEBUG nova.network.neutron [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Successfully updated port: 869edc66-112a-4313-a86a-786335d36b51 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:17:54 user nova-compute[72849]: DEBUG nova.network.neutron [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Successfully updated port: 37e52690-0504-4905-9c66-32f05b9ca665 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:17:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-636ab991-2014-4fcf-9e88-a582562841fa req-90eff5ed-a3df-4067-b0fc-063278d18ec6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-changed-869edc66-112a-4313-a86a-786335d36b51 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-636ab991-2014-4fcf-9e88-a582562841fa req-90eff5ed-a3df-4067-b0fc-063278d18ec6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Refreshing instance network info cache due to event network-changed-869edc66-112a-4313-a86a-786335d36b51. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:17:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-636ab991-2014-4fcf-9e88-a582562841fa req-90eff5ed-a3df-4067-b0fc-063278d18ec6 service nova] Acquiring lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:17:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-636ab991-2014-4fcf-9e88-a582562841fa req-90eff5ed-a3df-4067-b0fc-063278d18ec6 service nova] Acquired lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:17:55 user nova-compute[72849]: DEBUG nova.network.neutron [req-636ab991-2014-4fcf-9e88-a582562841fa req-90eff5ed-a3df-4067-b0fc-063278d18ec6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Refreshing network info cache for port 869edc66-112a-4313-a86a-786335d36b51 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:17:55 user nova-compute[72849]: DEBUG nova.network.neutron [req-636ab991-2014-4fcf-9e88-a582562841fa req-90eff5ed-a3df-4067-b0fc-063278d18ec6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:17:55 user nova-compute[72849]: DEBUG nova.network.neutron [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Successfully updated port: 74249c5d-642c-48c3-aa3e-79f9165580bc {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:17:55 user nova-compute[72849]: DEBUG nova.network.neutron [req-636ab991-2014-4fcf-9e88-a582562841fa req-90eff5ed-a3df-4067-b0fc-063278d18ec6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:17:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-636ab991-2014-4fcf-9e88-a582562841fa req-90eff5ed-a3df-4067-b0fc-063278d18ec6 service nova] Releasing lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:17:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-636ab991-2014-4fcf-9e88-a582562841fa req-90eff5ed-a3df-4067-b0fc-063278d18ec6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-changed-37e52690-0504-4905-9c66-32f05b9ca665 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-636ab991-2014-4fcf-9e88-a582562841fa req-90eff5ed-a3df-4067-b0fc-063278d18ec6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Refreshing instance network info cache due to event network-changed-37e52690-0504-4905-9c66-32f05b9ca665. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:17:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-636ab991-2014-4fcf-9e88-a582562841fa req-90eff5ed-a3df-4067-b0fc-063278d18ec6 service nova] Acquiring lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:17:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-636ab991-2014-4fcf-9e88-a582562841fa req-90eff5ed-a3df-4067-b0fc-063278d18ec6 service nova] Acquired lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:17:55 user nova-compute[72849]: DEBUG nova.network.neutron [req-636ab991-2014-4fcf-9e88-a582562841fa req-90eff5ed-a3df-4067-b0fc-063278d18ec6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Refreshing network info cache for port 37e52690-0504-4905-9c66-32f05b9ca665 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:17:55 user nova-compute[72849]: DEBUG nova.network.neutron [req-636ab991-2014-4fcf-9e88-a582562841fa req-90eff5ed-a3df-4067-b0fc-063278d18ec6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:17:56 user nova-compute[72849]: DEBUG nova.network.neutron [req-636ab991-2014-4fcf-9e88-a582562841fa req-90eff5ed-a3df-4067-b0fc-063278d18ec6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:17:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-636ab991-2014-4fcf-9e88-a582562841fa req-90eff5ed-a3df-4067-b0fc-063278d18ec6 service nova] Releasing lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:17:56 user nova-compute[72849]: DEBUG nova.network.neutron [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Successfully updated port: 68f4af0d-01e5-4950-b08a-c8454b09dd3e {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:17:57 user nova-compute[72849]: DEBUG nova.network.neutron [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Successfully updated port: 3c779d1d-1bdc-4614-b153-60d32915a3b9 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:17:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-changed-74249c5d-642c-48c3-aa3e-79f9165580bc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Refreshing instance network info cache due to event network-changed-74249c5d-642c-48c3-aa3e-79f9165580bc. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:17:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] Acquiring lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:17:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] Acquired lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:17:57 user nova-compute[72849]: DEBUG nova.network.neutron [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Refreshing network info cache for port 74249c5d-642c-48c3-aa3e-79f9165580bc {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:17:57 user nova-compute[72849]: DEBUG nova.network.neutron [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG nova.network.neutron [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] Releasing lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG nova.compute.manager [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-changed-68f4af0d-01e5-4950-b08a-c8454b09dd3e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG nova.compute.manager [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Refreshing instance network info cache due to event network-changed-68f4af0d-01e5-4950-b08a-c8454b09dd3e. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] Acquiring lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] Acquired lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG nova.network.neutron [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Refreshing network info cache for port 68f4af0d-01e5-4950-b08a-c8454b09dd3e {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG nova.network.neutron [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG nova.network.neutron [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] Releasing lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG nova.compute.manager [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-changed-3c779d1d-1bdc-4614-b153-60d32915a3b9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG nova.compute.manager [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Refreshing instance network info cache due to event network-changed-3c779d1d-1bdc-4614-b153-60d32915a3b9. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] Acquiring lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] Acquired lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG nova.network.neutron [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Refreshing network info cache for port 3c779d1d-1bdc-4614-b153-60d32915a3b9 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG nova.network.neutron [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Successfully updated port: be0000b5-95ec-4f3f-9344-3754b9f63a3d {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Acquiring lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG nova.network.neutron [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG nova.network.neutron [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e93d209f-9343-4c0c-8716-8d284ac339ed req-ad735f5f-a70d-4ba0-b368-07179294fdae service nova] Releasing lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Acquired lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:17:58 user nova-compute[72849]: DEBUG nova.network.neutron [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:17:59 user nova-compute[72849]: DEBUG nova.network.neutron [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:17:59 user nova-compute[72849]: DEBUG nova.compute.manager [req-57cc3977-3ed9-42c9-b535-d25aee87e90a req-9bbc2ea3-b370-4f24-aa16-ac37cb85fa10 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-changed-be0000b5-95ec-4f3f-9344-3754b9f63a3d {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:17:59 user nova-compute[72849]: DEBUG nova.compute.manager [req-57cc3977-3ed9-42c9-b535-d25aee87e90a req-9bbc2ea3-b370-4f24-aa16-ac37cb85fa10 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Refreshing instance network info cache due to event network-changed-be0000b5-95ec-4f3f-9344-3754b9f63a3d. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:17:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-57cc3977-3ed9-42c9-b535-d25aee87e90a req-9bbc2ea3-b370-4f24-aa16-ac37cb85fa10 service nova] Acquiring lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:18:00 user nova-compute[72849]: DEBUG nova.network.neutron [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Updating instance_info_cache with network_info: [{"id": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "address": "fa:16:3e:7b:f7:02", "network": {"id": "5b2340e6-1701-4cd9-b55a-22a560dfe14f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1630894672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e960116-61", "ovs_interfaceid": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "869edc66-112a-4313-a86a-786335d36b51", "address": "fa:16:3e:22:06:6c", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869edc66-11", "ovs_interfaceid": "869edc66-112a-4313-a86a-786335d36b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37e52690-0504-4905-9c66-32f05b9ca665", "address": "fa:16:3e:fd:30:f1", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e52690-05", "ovs_interfaceid": "37e52690-0504-4905-9c66-32f05b9ca665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74249c5d-642c-48c3-aa3e-79f9165580bc", "address": "fa:16:3e:68:02:91", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74249c5d-64", "ovs_interfaceid": "74249c5d-642c-48c3-aa3e-79f9165580bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "address": "fa:16:3e:cf:22:4a", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f4af0d-01", "ovs_interfaceid": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "address": "fa:16:3e:83:44:49", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c779d1d-1b", "ovs_interfaceid": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "address": "fa:16:3e:ae:f3:b3", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0000b5-95", "ovs_interfaceid": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:18:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Releasing lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:18:00 user nova-compute[72849]: DEBUG nova.compute.manager [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Instance network_info: |[{"id": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "address": "fa:16:3e:7b:f7:02", "network": {"id": "5b2340e6-1701-4cd9-b55a-22a560dfe14f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1630894672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e960116-61", "ovs_interfaceid": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "869edc66-112a-4313-a86a-786335d36b51", "address": "fa:16:3e:22:06:6c", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869edc66-11", "ovs_interfaceid": "869edc66-112a-4313-a86a-786335d36b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37e52690-0504-4905-9c66-32f05b9ca665", "address": "fa:16:3e:fd:30:f1", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e52690-05", "ovs_interfaceid": "37e52690-0504-4905-9c66-32f05b9ca665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74249c5d-642c-48c3-aa3e-79f9165580bc", "address": "fa:16:3e:68:02:91", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74249c5d-64", "ovs_interfaceid": "74249c5d-642c-48c3-aa3e-79f9165580bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "address": "fa:16:3e:cf:22:4a", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f4af0d-01", "ovs_interfaceid": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "address": "fa:16:3e:83:44:49", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c779d1d-1b", "ovs_interfaceid": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "address": "fa:16:3e:ae:f3:b3", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0000b5-95", "ovs_interfaceid": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:18:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-57cc3977-3ed9-42c9-b535-d25aee87e90a req-9bbc2ea3-b370-4f24-aa16-ac37cb85fa10 service nova] Acquired lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:18:00 user nova-compute[72849]: DEBUG nova.network.neutron [req-57cc3977-3ed9-42c9-b535-d25aee87e90a req-9bbc2ea3-b370-4f24-aa16-ac37cb85fa10 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Refreshing network info cache for port be0000b5-95ec-4f3f-9344-3754b9f63a3d {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:18:01 user nova-compute[72849]: INFO nova.virt.block_device [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Booting with volume 7f1661f8-0165-4dae-86c4-fbb833894d46 at /dev/vdb
Aug 15 16:18:01 user nova-compute[72849]: DEBUG os_brick.utils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b623f6b-df3c-4497-8363-c0479ae65607]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[001a722a-4165-4092-a0eb-a33eb9ebe84c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b0db55-3f76-42df-80fa-8b163fe91fd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca9e229-c8a0-4fdf-bea6-f4263f0fa85f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:18:01 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:18:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59892a2-e830-4107-801b-714748905882]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG os_brick.utils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Updating existing volume attachment record: 301fbd16-0a24-4072-bbbd-1bbcbcaf19fd {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG nova.network.neutron [req-57cc3977-3ed9-42c9-b535-d25aee87e90a req-9bbc2ea3-b370-4f24-aa16-ac37cb85fa10 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Updated VIF entry in instance network info cache for port be0000b5-95ec-4f3f-9344-3754b9f63a3d. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG nova.network.neutron [req-57cc3977-3ed9-42c9-b535-d25aee87e90a req-9bbc2ea3-b370-4f24-aa16-ac37cb85fa10 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Updating instance_info_cache with network_info: [{"id": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "address": "fa:16:3e:7b:f7:02", "network": {"id": "5b2340e6-1701-4cd9-b55a-22a560dfe14f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1630894672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e960116-61", "ovs_interfaceid": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "869edc66-112a-4313-a86a-786335d36b51", "address": "fa:16:3e:22:06:6c", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869edc66-11", "ovs_interfaceid": "869edc66-112a-4313-a86a-786335d36b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37e52690-0504-4905-9c66-32f05b9ca665", "address": "fa:16:3e:fd:30:f1", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e52690-05", "ovs_interfaceid": "37e52690-0504-4905-9c66-32f05b9ca665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74249c5d-642c-48c3-aa3e-79f9165580bc", "address": "fa:16:3e:68:02:91", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74249c5d-64", "ovs_interfaceid": "74249c5d-642c-48c3-aa3e-79f9165580bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "address": "fa:16:3e:cf:22:4a", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f4af0d-01", "ovs_interfaceid": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "address": "fa:16:3e:83:44:49", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c779d1d-1b", "ovs_interfaceid": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "address": "fa:16:3e:ae:f3:b3", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0000b5-95", "ovs_interfaceid": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:18:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-57cc3977-3ed9-42c9-b535-d25aee87e90a req-9bbc2ea3-b370-4f24-aa16-ac37cb85fa10 service nova] Releasing lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:18:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:18:10 user nova-compute[72849]: INFO nova.virt.block_device [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Booting with volume b8b821dc-9517-43cd-bac2-78ee1cc1c381 at /dev/vdc
Aug 15 16:18:10 user nova-compute[72849]: DEBUG os_brick.utils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[848afc48-b7ee-4c91-8f1f-5858767a0c4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc0ee1b-6d2f-4484-a0c6-16e3b299d66b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd6ea3a-fe99-4745-b386-9584b4675644]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[360d8937-1a87-4dbf-b17c-5eb7e30e1037]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:18:10 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:18:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b9898a-9a0b-494d-af3d-048abcd12e9c]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG os_brick.utils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:18:10 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Updating existing volume attachment record: 9f43bc18-95dc-4916-8396-f3e85b8dfbf9 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:18:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:18:17 user nova-compute[72849]: INFO nova.compute.manager [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] instance snapshotting
Aug 15 16:18:17 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Beginning live snapshot process
Aug 15 16:18:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json -f qcow2 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json -f qcow2" returned: 0 in 0.222s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json -f qcow2 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.172s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpofarhv5o/f825dca8c39a43e1921c16dc02007998.delta 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpofarhv5o/f825dca8c39a43e1921c16dc02007998.delta 1073741824" returned: 0 in 0.051s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:18 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 16:18:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72849) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 15 16:18:18 user nova-compute[72849]: INFO nova.virt.libvirt.host [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] UEFI support detected
Aug 15 16:18:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:18:20 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.privsep.utils [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72849) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpofarhv5o/f825dca8c39a43e1921c16dc02007998.delta /opt/stack/data/nova/instances/snapshots/tmpofarhv5o/f825dca8c39a43e1921c16dc02007998 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.compute.manager [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:18:20 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Creating image(s)
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Did not create local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Ensure instance console log exists: /opt/stack/data/nova/instances/40d69bd5-67c0-4b3c-8615-6660145b61fb/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Start _get_guest_xml network_info=[{"id": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "address": "fa:16:3e:7b:f7:02", "network": {"id": "5b2340e6-1701-4cd9-b55a-22a560dfe14f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1630894672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e960116-61", "ovs_interfaceid": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "869edc66-112a-4313-a86a-786335d36b51", "address": "fa:16:3e:22:06:6c", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869edc66-11", "ovs_interfaceid": "869edc66-112a-4313-a86a-786335d36b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37e52690-0504-4905-9c66-32f05b9ca665", "address": "fa:16:3e:fd:30:f1", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e52690-05", "ovs_interfaceid": "37e52690-0504-4905-9c66-32f05b9ca665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74249c5d-642c-48c3-aa3e-79f9165580bc", "address": "fa:16:3e:68:02:91", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74249c5d-64", "ovs_interfaceid": "74249c5d-642c-48c3-aa3e-79f9165580bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "address": "fa:16:3e:cf:22:4a", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f4af0d-01", "ovs_interfaceid": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "address": "fa:16:3e:83:44:49", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c779d1d-1b", "ovs_interfaceid": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "address": "fa:16:3e:ae:f3:b3", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0000b5-95", "ovs_interfaceid": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDNZanHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '40d69bd5-67c0-4b3c-8615-6660145b61fb', 'attached_at': '', 'detached_at': '', 'volume_id': '09a3bddc-122f-4557-9246-1adbf93a9152', 'serial': '09a3bddc-122f-4557-9246-1adbf93a9152'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '379070a6-f663-4009-9525-1cf365ea9a25', 'volume_type': None}, {'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClpdcsMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '40d69bd5-67c0-4b3c-8615-6660145b61fb', 'attached_at': '', 'detached_at': '', 'volume_id': '7f1661f8-0165-4dae-86c4-fbb833894d46', 'serial': '7f1661f8-0165-4dae-86c4-fbb833894d46'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '301fbd16-0a24-4072-bbbd-1bbcbcaf19fd', 'volume_type': None}, {'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JinTwUXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '40d69bd5-67c0-4b3c-8615-6660145b61fb', 'attached_at': '', 'detached_at': '', 'volume_id': 'b8b821dc-9517-43cd-bac2-78ee1cc1c381', 'serial': 'b8b821dc-9517-43cd-bac2-78ee1cc1c381'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '9f43bc18-95dc-4916-8396-f3e85b8dfbf9', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:18:20 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:18:20 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connector [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Factory for ISCSI on None {{(pid=72849) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDNZanHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:18:20 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:18:20 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:18:20 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39df1e0-ceec-4d5b-bcd3-84824f34c833]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:18:20 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a32f86-2d5b-47db-be3f-4783cbf5744a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152] added
Aug 15 16:18:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fbb6c2-f351-4625-8eaf-cdb5b7ebfd83]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e329b73-fd62-4c71-9f1b-662e17579f97]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tDNZanHT {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tDNZanHT" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[027075c2-a359-4d41-adc5-cfde5d92bb2c]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tDNZanHT'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1bf646-3e47-4708-bb2f-41ee6b8a7470]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpofarhv5o/f825dca8c39a43e1921c16dc02007998.delta /opt/stack/data/nova/instances/snapshots/tmpofarhv5o/f825dca8c39a43e1921c16dc02007998" returned: 0 in 0.314s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:20 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Snapshot extracted, beginning image upload
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10b1cd2-999f-4f75-bf27-0ff8999d6cd7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-89580587-6794-443e-8a79-b16937f27d47 req-cad0a27d-7d55-4faf-8ecc-813a3b9944f0 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received event network-changed-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-89580587-6794-443e-8a79-b16937f27d47 req-cad0a27d-7d55-4faf-8ecc-813a3b9944f0 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Refreshing instance network info cache due to event network-changed-1b0d74bc-a28a-4a88-80b2-377fc19f2c30. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-89580587-6794-443e-8a79-b16937f27d47 req-cad0a27d-7d55-4faf-8ecc-813a3b9944f0 service nova] Acquiring lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-89580587-6794-443e-8a79-b16937f27d47 req-cad0a27d-7d55-4faf-8ecc-813a3b9944f0 service nova] Acquired lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG nova.network.neutron [req-89580587-6794-443e-8a79-b16937f27d47 req-cad0a27d-7d55-4faf-8ecc-813a3b9944f0 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Refreshing network info cache for port 1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:18:20 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:18:20 user nova-compute[72849]:  {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:18:20 user nova-compute[72849]: WARNING os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 16:18:20 user nova-compute[72849]: 
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec9b6c2-c8ed-44db-930f-9eb00a5872e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152, portal: 172.16.0.220,3260]
Aug 15 16:18:20 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152, portal: 172.16.0.220,3260] successful.
Aug 15 16:18:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[617f58ae-368e-4857-8853-151544172cf5]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd24ce0e-4db1-40c4-9a79-4e4d1876fffc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:18:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:18:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[796f361d-b21b-4105-aede-c33e4ec0de6c]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDNZanHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:18:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG nova.network.neutron [req-89580587-6794-443e-8a79-b16937f27d47 req-cad0a27d-7d55-4faf-8ecc-813a3b9944f0 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Updated VIF entry in instance network info cache for port 1b0d74bc-a28a-4a88-80b2-377fc19f2c30. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG nova.network.neutron [req-89580587-6794-443e-8a79-b16937f27d47 req-cad0a27d-7d55-4faf-8ecc-813a3b9944f0 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Updating instance_info_cache with network_info: [{"id": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "address": "fa:16:3e:15:be:6e", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d74bc-a2", "ovs_interfaceid": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-89580587-6794-443e-8a79-b16937f27d47 req-cad0a27d-7d55-4faf-8ecc-813a3b9944f0 service nova] Releasing lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26366386632383761', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366386632383761', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClpdcsMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:18:21 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:18:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:18:21 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:18:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:18:21 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e38f999-440a-4534-98ef-009e1dea90c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:18:21 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbab236-6d32-4351-ae22-af3317a48819]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46] added
Aug 15 16:18:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f030eb2-7040-46a9-8355-6bcf1126cb93]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bb8dff-669a-4912-8c89-d45b7f021a9a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ClpdcsMD {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ClpdcsMD" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafb6854-1184-4bdd-8711-670f7b569cf1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ClpdcsMD'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0f2221-8563-4c8e-869b-0af10e263b48]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a08fde6-7c85-4a4f-aabe-75bca9ed6172]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:18:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:18:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:18:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[602c070f-52f1-4a24-b931-e2fd63ca9081]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46, portal: 172.16.0.220,3260]
Aug 15 16:18:22 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46, portal: 172.16.0.220,3260] successful.
Aug 15 16:18:22 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[054c09cb-a4fd-4067-809b-c65f851ce049]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f47b67-ffaa-41a7-82fb-676a06ba2b91]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:18:22 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:18:22 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:18:22 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:18:22 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[046c5ba4-3c8c-4c6c-803a-cd95f9299133]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClpdcsMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:18:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23336393933326534', 'path': '/dev/sdc'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336393933326534', 'path': '/dev/sdc'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JinTwUXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:18:23 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:18:23 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:18:23 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1964f9ae-a87c-4b1e-ade4-f3bf4b83c805]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:18:23 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e08aa3-a574-45d2-b745-d177dc53c195]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381] added
Aug 15 16:18:23 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:23 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Snapshot image upload complete
Aug 15 16:18:23 user nova-compute[72849]: INFO nova.compute.manager [None req-8f3eb370-90a8-4a4c-890d-d64f97cfeb84 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Took 5.42 seconds to snapshot the instance on the hypervisor.
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a81f78-74bd-4f97-a1c3-0627cc6c6847]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbd9c91-8653-46a8-8f3a-fdd80eb37a1a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JinTwUXc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JinTwUXc" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3088535f-374b-42cf-8b98-a55eda4bafe7]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JinTwUXc'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c403e6-c4c5-4f9d-bb89-9dc62a5e0c09]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1905d515-d3da-4717-af34-e276329d99d8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:18:23 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:18:23 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:18:23 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:18:23 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a858c86e-931f-461c-99c6-d9df294056d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381, portal: 172.16.0.220,3260]
Aug 15 16:18:23 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381, portal: 172.16.0.220,3260] successful.
Aug 15 16:18:23 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[515e9878-5bbd-46e3-94ee-6e42cb39c479]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef7aa5a-c480-4ed4-943f-5f950d04c57f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:18:23 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:18:23 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:18:23 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:18:23 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:18:23 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:18:23 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3906ca0d-d334-4d32-9e97-61ef0d9b5285]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JinTwUXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:18:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26635653631373237', 'path': '/dev/sdd'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635653631373237', 'path': '/dev/sdd'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "address": "fa:16:3e:7b:f7:02", "network": {"id": "5b2340e6-1701-4cd9-b55a-22a560dfe14f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1630894672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e960116-61", "ovs_interfaceid": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "address": "fa:16:3e:7b:f7:02", "network": {"id": "5b2340e6-1701-4cd9-b55a-22a560dfe14f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1630894672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e960116-61", "ovs_interfaceid": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=3e960116-61a7-4ee5-9eb6-72c9a60f0657,network=Network(5b2340e6-1701-4cd9-b55a-22a560dfe14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e960116-61') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "869edc66-112a-4313-a86a-786335d36b51", "address": "fa:16:3e:22:06:6c", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869edc66-11", "ovs_interfaceid": "869edc66-112a-4313-a86a-786335d36b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "869edc66-112a-4313-a86a-786335d36b51", "address": "fa:16:3e:22:06:6c", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869edc66-11", "ovs_interfaceid": "869edc66-112a-4313-a86a-786335d36b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:06:6c,bridge_name='br-int',has_traffic_filtering=True,id=869edc66-112a-4313-a86a-786335d36b51,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap869edc66-11') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37e52690-0504-4905-9c66-32f05b9ca665", "address": "fa:16:3e:fd:30:f1", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e52690-05", "ovs_interfaceid": "37e52690-0504-4905-9c66-32f05b9ca665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "37e52690-0504-4905-9c66-32f05b9ca665", "address": "fa:16:3e:fd:30:f1", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e52690-05", "ovs_interfaceid": "37e52690-0504-4905-9c66-32f05b9ca665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:f1,bridge_name='br-int',has_traffic_filtering=True,id=37e52690-0504-4905-9c66-32f05b9ca665,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37e52690-05') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74249c5d-642c-48c3-aa3e-79f9165580bc", "address": "fa:16:3e:68:02:91", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74249c5d-64", "ovs_interfaceid": "74249c5d-642c-48c3-aa3e-79f9165580bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "74249c5d-642c-48c3-aa3e-79f9165580bc", "address": "fa:16:3e:68:02:91", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74249c5d-64", "ovs_interfaceid": "74249c5d-642c-48c3-aa3e-79f9165580bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:02:91,bridge_name='br-int',has_traffic_filtering=True,id=74249c5d-642c-48c3-aa3e-79f9165580bc,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74249c5d-64') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "address": "fa:16:3e:cf:22:4a", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f4af0d-01", "ovs_interfaceid": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "address": "fa:16:3e:cf:22:4a", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f4af0d-01", "ovs_interfaceid": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:22:4a,bridge_name='br-int',has_traffic_filtering=True,id=68f4af0d-01e5-4950-b08a-c8454b09dd3e,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f4af0d-01') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "address": "fa:16:3e:83:44:49", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c779d1d-1b", "ovs_interfaceid": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "address": "fa:16:3e:83:44:49", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c779d1d-1b", "ovs_interfaceid": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:44:49,bridge_name='br-int',has_traffic_filtering=True,id=3c779d1d-1bdc-4614-b153-60d32915a3b9,network=Network(10a3e942-8148-4a73-9d5f-353e9c05b95b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c779d1d-1b') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "address": "fa:16:3e:ae:f3:b3", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0000b5-95", "ovs_interfaceid": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "address": "fa:16:3e:ae:f3:b3", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0000b5-95", "ovs_interfaceid": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:f3:b3,bridge_name='br-int',has_traffic_filtering=True,id=be0000b5-95ec-4f3f-9344-3754b9f63a3d,network=Network(10a3e942-8148-4a73-9d5f-353e9c05b95b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0000b5-95') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.objects.instance [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lazy-loading 'pci_devices' on Instance uuid 40d69bd5-67c0-4b3c-8615-6660145b61fb {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:18:24 user nova-compute[72849]:   <uuid>40d69bd5-67c0-4b3c-8615-6660145b61fb</uuid>
Aug 15 16:18:24 user nova-compute[72849]:   <name>instance-0000000a</name>
Aug 15 16:18:24 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:18:24 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:18:24 user nova-compute[72849]:   <metadata>
Aug 15 16:18:24 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:18:24 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:18:24 user nova-compute[72849]:       <nova:name>tempest-device-tagging-server-77370635</nova:name>
Aug 15 16:18:24 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:18:20</nova:creationTime>
Aug 15 16:18:24 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:18:24 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:18:24 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:18:24 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:18:24 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:18:24 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:18:24 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:18:24 user nova-compute[72849]:       <nova:owner>
Aug 15 16:18:24 user nova-compute[72849]:         <nova:user uuid="7af94d2a9ff14736ad788d175f392cc9">tempest-TaggedBootDevicesTest-1229052876-project-member</nova:user>
Aug 15 16:18:24 user nova-compute[72849]:         <nova:project uuid="d504c6bf4d1e40f89105b6bb868fbb28">tempest-TaggedBootDevicesTest-1229052876</nova:project>
Aug 15 16:18:24 user nova-compute[72849]:       </nova:owner>
Aug 15 16:18:24 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:18:24 user nova-compute[72849]:       <nova:ports>
Aug 15 16:18:24 user nova-compute[72849]:         <nova:port uuid="3e960116-61a7-4ee5-9eb6-72c9a60f0657">
Aug 15 16:18:24 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 16:18:24 user nova-compute[72849]:         </nova:port>
Aug 15 16:18:24 user nova-compute[72849]:         <nova:port uuid="869edc66-112a-4313-a86a-786335d36b51">
Aug 15 16:18:24 user nova-compute[72849]:           <nova:ip type="fixed" address="10.1.1.27" ipVersion="4"/>
Aug 15 16:18:24 user nova-compute[72849]:         </nova:port>
Aug 15 16:18:24 user nova-compute[72849]:         <nova:port uuid="37e52690-0504-4905-9c66-32f05b9ca665">
Aug 15 16:18:24 user nova-compute[72849]:           <nova:ip type="fixed" address="10.1.1.147" ipVersion="4"/>
Aug 15 16:18:24 user nova-compute[72849]:         </nova:port>
Aug 15 16:18:24 user nova-compute[72849]:         <nova:port uuid="74249c5d-642c-48c3-aa3e-79f9165580bc">
Aug 15 16:18:24 user nova-compute[72849]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Aug 15 16:18:24 user nova-compute[72849]:         </nova:port>
Aug 15 16:18:24 user nova-compute[72849]:         <nova:port uuid="68f4af0d-01e5-4950-b08a-c8454b09dd3e">
Aug 15 16:18:24 user nova-compute[72849]:           <nova:ip type="fixed" address="10.1.1.191" ipVersion="4"/>
Aug 15 16:18:24 user nova-compute[72849]:         </nova:port>
Aug 15 16:18:24 user nova-compute[72849]:         <nova:port uuid="3c779d1d-1bdc-4614-b153-60d32915a3b9">
Aug 15 16:18:24 user nova-compute[72849]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 15 16:18:24 user nova-compute[72849]:         </nova:port>
Aug 15 16:18:24 user nova-compute[72849]:         <nova:port uuid="be0000b5-95ec-4f3f-9344-3754b9f63a3d">
Aug 15 16:18:24 user nova-compute[72849]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 15 16:18:24 user nova-compute[72849]:         </nova:port>
Aug 15 16:18:24 user nova-compute[72849]:       </nova:ports>
Aug 15 16:18:24 user nova-compute[72849]:     </nova:instance>
Aug 15 16:18:24 user nova-compute[72849]:   </metadata>
Aug 15 16:18:24 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:18:24 user nova-compute[72849]:     <system>
Aug 15 16:18:24 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:18:24 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:18:24 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:18:24 user nova-compute[72849]:       <entry name="serial">40d69bd5-67c0-4b3c-8615-6660145b61fb</entry>
Aug 15 16:18:24 user nova-compute[72849]:       <entry name="uuid">40d69bd5-67c0-4b3c-8615-6660145b61fb</entry>
Aug 15 16:18:24 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:18:24 user nova-compute[72849]:     </system>
Aug 15 16:18:24 user nova-compute[72849]:   </sysinfo>
Aug 15 16:18:24 user nova-compute[72849]:   <os>
Aug 15 16:18:24 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:18:24 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:18:24 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:18:24 user nova-compute[72849]:   </os>
Aug 15 16:18:24 user nova-compute[72849]:   <features>
Aug 15 16:18:24 user nova-compute[72849]:     <acpi/>
Aug 15 16:18:24 user nova-compute[72849]:     <apic/>
Aug 15 16:18:24 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:18:24 user nova-compute[72849]:   </features>
Aug 15 16:18:24 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:18:24 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:18:24 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:18:24 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:18:24 user nova-compute[72849]:   </clock>
Aug 15 16:18:24 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:18:24 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:18:24 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:18:24 user nova-compute[72849]:   </cpu>
Aug 15 16:18:24 user nova-compute[72849]:   <devices>
Aug 15 16:18:24 user nova-compute[72849]:     <disk type="file" device="cdrom">
Aug 15 16:18:24 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 16:18:24 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/40d69bd5-67c0-4b3c-8615-6660145b61fb/disk.config"/>
Aug 15 16:18:24 user nova-compute[72849]:       <target dev="hda" bus="ide"/>
Aug 15 16:18:24 user nova-compute[72849]:     </disk>
Aug 15 16:18:24 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:18:24 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:18:24 user nova-compute[72849]:       <source dev="/dev/sdb"/>
Aug 15 16:18:24 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:18:24 user nova-compute[72849]:       <serial>09a3bddc-122f-4557-9246-1adbf93a9152</serial>
Aug 15 16:18:24 user nova-compute[72849]:     </disk>
Aug 15 16:18:24 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:18:24 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:18:24 user nova-compute[72849]:       <source dev="/dev/sdc"/>
Aug 15 16:18:24 user nova-compute[72849]:       <target dev="vdb" bus="virtio"/>
Aug 15 16:18:24 user nova-compute[72849]:       <serial>7f1661f8-0165-4dae-86c4-fbb833894d46</serial>
Aug 15 16:18:24 user nova-compute[72849]:     </disk>
Aug 15 16:18:24 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:18:24 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:18:24 user nova-compute[72849]:       <source dev="/dev/sdd"/>
Aug 15 16:18:24 user nova-compute[72849]:       <target dev="vdc" bus="virtio"/>
Aug 15 16:18:24 user nova-compute[72849]:       <serial>b8b821dc-9517-43cd-bac2-78ee1cc1c381</serial>
Aug 15 16:18:24 user nova-compute[72849]:     </disk>
Aug 15 16:18:24 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:18:24 user nova-compute[72849]:       <mac address="fa:16:3e:7b:f7:02"/>
Aug 15 16:18:24 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:18:24 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:18:24 user nova-compute[72849]:       <target dev="tap3e960116-61"/>
Aug 15 16:18:24 user nova-compute[72849]:     </interface>
Aug 15 16:18:24 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:18:24 user nova-compute[72849]:       <mac address="fa:16:3e:22:06:6c"/>
Aug 15 16:18:24 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:18:24 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:18:24 user nova-compute[72849]:       <target dev="tap869edc66-11"/>
Aug 15 16:18:24 user nova-compute[72849]:     </interface>
Aug 15 16:18:24 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:18:24 user nova-compute[72849]:       <mac address="fa:16:3e:fd:30:f1"/>
Aug 15 16:18:24 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:18:24 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:18:24 user nova-compute[72849]:       <target dev="tap37e52690-05"/>
Aug 15 16:18:24 user nova-compute[72849]:     </interface>
Aug 15 16:18:24 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:18:24 user nova-compute[72849]:       <mac address="fa:16:3e:68:02:91"/>
Aug 15 16:18:24 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:18:24 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:18:24 user nova-compute[72849]:       <target dev="tap74249c5d-64"/>
Aug 15 16:18:24 user nova-compute[72849]:     </interface>
Aug 15 16:18:24 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:18:24 user nova-compute[72849]:       <mac address="fa:16:3e:cf:22:4a"/>
Aug 15 16:18:24 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:18:24 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:18:24 user nova-compute[72849]:       <target dev="tap68f4af0d-01"/>
Aug 15 16:18:24 user nova-compute[72849]:     </interface>
Aug 15 16:18:24 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:18:24 user nova-compute[72849]:       <mac address="fa:16:3e:83:44:49"/>
Aug 15 16:18:24 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:18:24 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:18:24 user nova-compute[72849]:       <target dev="tap3c779d1d-1b"/>
Aug 15 16:18:24 user nova-compute[72849]:     </interface>
Aug 15 16:18:24 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:18:24 user nova-compute[72849]:       <mac address="fa:16:3e:ae:f3:b3"/>
Aug 15 16:18:24 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:18:24 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:18:24 user nova-compute[72849]:       <target dev="tapbe0000b5-95"/>
Aug 15 16:18:24 user nova-compute[72849]:     </interface>
Aug 15 16:18:24 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:18:24 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/40d69bd5-67c0-4b3c-8615-6660145b61fb/console.log" append="off"/>
Aug 15 16:18:24 user nova-compute[72849]:     </serial>
Aug 15 16:18:24 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:18:24 user nova-compute[72849]:     <video>
Aug 15 16:18:24 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:18:24 user nova-compute[72849]:     </video>
Aug 15 16:18:24 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:18:24 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:18:24 user nova-compute[72849]:     </rng>
Aug 15 16:18:24 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:18:24 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:18:24 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:18:24 user nova-compute[72849]:     </memballoon>
Aug 15 16:18:24 user nova-compute[72849]:   </devices>
Aug 15 16:18:24 user nova-compute[72849]: </domain>
Aug 15 16:18:24 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "address": "fa:16:3e:7b:f7:02", "network": {"id": "5b2340e6-1701-4cd9-b55a-22a560dfe14f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1630894672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e960116-61", "ovs_interfaceid": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "address": "fa:16:3e:7b:f7:02", "network": {"id": "5b2340e6-1701-4cd9-b55a-22a560dfe14f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1630894672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e960116-61", "ovs_interfaceid": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=3e960116-61a7-4ee5-9eb6-72c9a60f0657,network=Network(5b2340e6-1701-4cd9-b55a-22a560dfe14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e960116-61') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG os_vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=3e960116-61a7-4ee5-9eb6-72c9a60f0657,network=Network(5b2340e6-1701-4cd9-b55a-22a560dfe14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e960116-61') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e960116-61, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e960116-61, col_values=(('external_ids', {'iface-id': '3e960116-61a7-4ee5-9eb6-72c9a60f0657', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:f7:02', 'vm-uuid': '40d69bd5-67c0-4b3c-8615-6660145b61fb'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: INFO os_vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=3e960116-61a7-4ee5-9eb6-72c9a60f0657,network=Network(5b2340e6-1701-4cd9-b55a-22a560dfe14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e960116-61')
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "869edc66-112a-4313-a86a-786335d36b51", "address": "fa:16:3e:22:06:6c", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869edc66-11", "ovs_interfaceid": "869edc66-112a-4313-a86a-786335d36b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "869edc66-112a-4313-a86a-786335d36b51", "address": "fa:16:3e:22:06:6c", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869edc66-11", "ovs_interfaceid": "869edc66-112a-4313-a86a-786335d36b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:06:6c,bridge_name='br-int',has_traffic_filtering=True,id=869edc66-112a-4313-a86a-786335d36b51,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap869edc66-11') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG os_vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:06:6c,bridge_name='br-int',has_traffic_filtering=True,id=869edc66-112a-4313-a86a-786335d36b51,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap869edc66-11') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap869edc66-11, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap869edc66-11, col_values=(('external_ids', {'iface-id': '869edc66-112a-4313-a86a-786335d36b51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:06:6c', 'vm-uuid': '40d69bd5-67c0-4b3c-8615-6660145b61fb'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: INFO os_vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:06:6c,bridge_name='br-int',has_traffic_filtering=True,id=869edc66-112a-4313-a86a-786335d36b51,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap869edc66-11')
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37e52690-0504-4905-9c66-32f05b9ca665", "address": "fa:16:3e:fd:30:f1", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e52690-05", "ovs_interfaceid": "37e52690-0504-4905-9c66-32f05b9ca665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "37e52690-0504-4905-9c66-32f05b9ca665", "address": "fa:16:3e:fd:30:f1", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e52690-05", "ovs_interfaceid": "37e52690-0504-4905-9c66-32f05b9ca665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:f1,bridge_name='br-int',has_traffic_filtering=True,id=37e52690-0504-4905-9c66-32f05b9ca665,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37e52690-05') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG os_vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:f1,bridge_name='br-int',has_traffic_filtering=True,id=37e52690-0504-4905-9c66-32f05b9ca665,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37e52690-05') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37e52690-05, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37e52690-05, col_values=(('external_ids', {'iface-id': '37e52690-0504-4905-9c66-32f05b9ca665', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:30:f1', 'vm-uuid': '40d69bd5-67c0-4b3c-8615-6660145b61fb'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Updating instance_info_cache with network_info: [{"id": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "address": "fa:16:3e:15:be:6e", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d74bc-a2", "ovs_interfaceid": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: INFO os_vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:f1,bridge_name='br-int',has_traffic_filtering=True,id=37e52690-0504-4905-9c66-32f05b9ca665,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37e52690-05')
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74249c5d-642c-48c3-aa3e-79f9165580bc", "address": "fa:16:3e:68:02:91", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74249c5d-64", "ovs_interfaceid": "74249c5d-642c-48c3-aa3e-79f9165580bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "74249c5d-642c-48c3-aa3e-79f9165580bc", "address": "fa:16:3e:68:02:91", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74249c5d-64", "ovs_interfaceid": "74249c5d-642c-48c3-aa3e-79f9165580bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:02:91,bridge_name='br-int',has_traffic_filtering=True,id=74249c5d-642c-48c3-aa3e-79f9165580bc,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74249c5d-64') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG os_vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:02:91,bridge_name='br-int',has_traffic_filtering=True,id=74249c5d-642c-48c3-aa3e-79f9165580bc,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74249c5d-64') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74249c5d-64, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74249c5d-64, col_values=(('external_ids', {'iface-id': '74249c5d-642c-48c3-aa3e-79f9165580bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:02:91', 'vm-uuid': '40d69bd5-67c0-4b3c-8615-6660145b61fb'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: INFO os_vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:02:91,bridge_name='br-int',has_traffic_filtering=True,id=74249c5d-642c-48c3-aa3e-79f9165580bc,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74249c5d-64')
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "address": "fa:16:3e:cf:22:4a", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f4af0d-01", "ovs_interfaceid": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "address": "fa:16:3e:cf:22:4a", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f4af0d-01", "ovs_interfaceid": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:22:4a,bridge_name='br-int',has_traffic_filtering=True,id=68f4af0d-01e5-4950-b08a-c8454b09dd3e,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f4af0d-01') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG os_vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:22:4a,bridge_name='br-int',has_traffic_filtering=True,id=68f4af0d-01e5-4950-b08a-c8454b09dd3e,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f4af0d-01') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68f4af0d-01, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68f4af0d-01, col_values=(('external_ids', {'iface-id': '68f4af0d-01e5-4950-b08a-c8454b09dd3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:22:4a', 'vm-uuid': '40d69bd5-67c0-4b3c-8615-6660145b61fb'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: INFO os_vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:22:4a,bridge_name='br-int',has_traffic_filtering=True,id=68f4af0d-01e5-4950-b08a-c8454b09dd3e,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f4af0d-01')
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "address": "fa:16:3e:83:44:49", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c779d1d-1b", "ovs_interfaceid": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "address": "fa:16:3e:83:44:49", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c779d1d-1b", "ovs_interfaceid": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:44:49,bridge_name='br-int',has_traffic_filtering=True,id=3c779d1d-1bdc-4614-b153-60d32915a3b9,network=Network(10a3e942-8148-4a73-9d5f-353e9c05b95b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c779d1d-1b') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG os_vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:44:49,bridge_name='br-int',has_traffic_filtering=True,id=3c779d1d-1bdc-4614-b153-60d32915a3b9,network=Network(10a3e942-8148-4a73-9d5f-353e9c05b95b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c779d1d-1b') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c779d1d-1b, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c779d1d-1b, col_values=(('external_ids', {'iface-id': '3c779d1d-1bdc-4614-b153-60d32915a3b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:44:49', 'vm-uuid': '40d69bd5-67c0-4b3c-8615-6660145b61fb'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: INFO os_vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:44:49,bridge_name='br-int',has_traffic_filtering=True,id=3c779d1d-1bdc-4614-b153-60d32915a3b9,network=Network(10a3e942-8148-4a73-9d5f-353e9c05b95b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c779d1d-1b')
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "address": "fa:16:3e:ae:f3:b3", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0000b5-95", "ovs_interfaceid": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "address": "fa:16:3e:ae:f3:b3", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0000b5-95", "ovs_interfaceid": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:f3:b3,bridge_name='br-int',has_traffic_filtering=True,id=be0000b5-95ec-4f3f-9344-3754b9f63a3d,network=Network(10a3e942-8148-4a73-9d5f-353e9c05b95b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0000b5-95') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG os_vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:f3:b3,bridge_name='br-int',has_traffic_filtering=True,id=be0000b5-95ec-4f3f-9344-3754b9f63a3d,network=Network(10a3e942-8148-4a73-9d5f-353e9c05b95b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0000b5-95') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe0000b5-95, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe0000b5-95, col_values=(('external_ids', {'iface-id': 'be0000b5-95ec-4f3f-9344-3754b9f63a3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:f3:b3', 'vm-uuid': '40d69bd5-67c0-4b3c-8615-6660145b61fb'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:18:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:25 user nova-compute[72849]: INFO os_vif [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:f3:b3,bridge_name='br-int',has_traffic_filtering=True,id=be0000b5-95ec-4f3f-9344-3754b9f63a3d,network=Network(10a3e942-8148-4a73-9d5f-353e9c05b95b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0000b5-95')
Aug 15 16:18:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] No BDM found with device name hda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:18:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:18:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] No VIF found with MAC fa:16:3e:7b:f7:02, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:18:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] No VIF found with MAC fa:16:3e:cf:22:4a, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:18:25 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Using config drive
Aug 15 16:18:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:25 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Creating config drive at /opt/stack/data/nova/instances/40d69bd5-67c0-4b3c-8615-6660145b61fb/disk.config
Aug 15 16:18:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/40d69bd5-67c0-4b3c-8615-6660145b61fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4o74y82j {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/40d69bd5-67c0-4b3c-8615-6660145b61fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4o74y82j" returned: 0 in 0.061s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-2d154fc2-d101-49f2-af93-5990be4a2098 req-771e280f-1236-43fd-9b60-3ebf13f9f869 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received event network-changed-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-2d154fc2-d101-49f2-af93-5990be4a2098 req-771e280f-1236-43fd-9b60-3ebf13f9f869 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Refreshing instance network info cache due to event network-changed-25a67315-9859-4077-8f36-23635b760770. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:18:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2d154fc2-d101-49f2-af93-5990be4a2098 req-771e280f-1236-43fd-9b60-3ebf13f9f869 service nova] Acquiring lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:18:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2d154fc2-d101-49f2-af93-5990be4a2098 req-771e280f-1236-43fd-9b60-3ebf13f9f869 service nova] Acquired lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:18:26 user nova-compute[72849]: DEBUG nova.network.neutron [req-2d154fc2-d101-49f2-af93-5990be4a2098 req-771e280f-1236-43fd-9b60-3ebf13f9f869 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Refreshing network info cache for port 25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:18:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG nova.network.neutron [req-2d154fc2-d101-49f2-af93-5990be4a2098 req-771e280f-1236-43fd-9b60-3ebf13f9f869 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updated VIF entry in instance network info cache for port 25a67315-9859-4077-8f36-23635b760770. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG nova.network.neutron [req-2d154fc2-d101-49f2-af93-5990be4a2098 req-771e280f-1236-43fd-9b60-3ebf13f9f869 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updating instance_info_cache with network_info: [{"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2d154fc2-d101-49f2-af93-5990be4a2098 req-771e280f-1236-43fd-9b60-3ebf13f9f869 service nova] Releasing lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG nova.compute.manager [req-99a043b8-bfda-465a-a9dc-b881a6753787 req-094f1aec-fae3-4f82-bc80-66889b55c8ac service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-3e960116-61a7-4ee5-9eb6-72c9a60f0657 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-99a043b8-bfda-465a-a9dc-b881a6753787 req-094f1aec-fae3-4f82-bc80-66889b55c8ac service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-99a043b8-bfda-465a-a9dc-b881a6753787 req-094f1aec-fae3-4f82-bc80-66889b55c8ac service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-99a043b8-bfda-465a-a9dc-b881a6753787 req-094f1aec-fae3-4f82-bc80-66889b55c8ac service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG nova.compute.manager [req-99a043b8-bfda-465a-a9dc-b881a6753787 req-094f1aec-fae3-4f82-bc80-66889b55c8ac service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-3e960116-61a7-4ee5-9eb6-72c9a60f0657 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:18:28 user nova-compute[72849]: WARNING nova.compute.manager [req-99a043b8-bfda-465a-a9dc-b881a6753787 req-094f1aec-fae3-4f82-bc80-66889b55c8ac service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-3e960116-61a7-4ee5-9eb6-72c9a60f0657 for instance with vm_state building and task_state spawning.
Aug 15 16:18:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116311.7191265, 40d69bd5-67c0-4b3c-8615-6660145b61fb => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:18:32 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] VM Resumed (Lifecycle Event)
Aug 15 16:18:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-ad3001a9-884c-427d-8a0f-55eda67e9818 req-69046fe7-778f-4cbe-ac9b-200b55daaf52 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-869edc66-112a-4313-a86a-786335d36b51 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ad3001a9-884c-427d-8a0f-55eda67e9818 req-69046fe7-778f-4cbe-ac9b-200b55daaf52 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ad3001a9-884c-427d-8a0f-55eda67e9818 req-69046fe7-778f-4cbe-ac9b-200b55daaf52 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ad3001a9-884c-427d-8a0f-55eda67e9818 req-69046fe7-778f-4cbe-ac9b-200b55daaf52 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-ad3001a9-884c-427d-8a0f-55eda67e9818 req-69046fe7-778f-4cbe-ac9b-200b55daaf52 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-869edc66-112a-4313-a86a-786335d36b51 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:18:32 user nova-compute[72849]: WARNING nova.compute.manager [req-ad3001a9-884c-427d-8a0f-55eda67e9818 req-69046fe7-778f-4cbe-ac9b-200b55daaf52 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-869edc66-112a-4313-a86a-786335d36b51 for instance with vm_state building and task_state spawning.
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-3e960116-61a7-4ee5-9eb6-72c9a60f0657 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-3e960116-61a7-4ee5-9eb6-72c9a60f0657 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:18:32 user nova-compute[72849]: WARNING nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-3e960116-61a7-4ee5-9eb6-72c9a60f0657 for instance with vm_state building and task_state spawning.
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-37e52690-0504-4905-9c66-32f05b9ca665 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-37e52690-0504-4905-9c66-32f05b9ca665 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:18:32 user nova-compute[72849]: WARNING nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-37e52690-0504-4905-9c66-32f05b9ca665 for instance with vm_state building and task_state spawning.
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-37e52690-0504-4905-9c66-32f05b9ca665 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-37e52690-0504-4905-9c66-32f05b9ca665 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:18:32 user nova-compute[72849]: WARNING nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-37e52690-0504-4905-9c66-32f05b9ca665 for instance with vm_state building and task_state spawning.
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received event network-changed-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Refreshing instance network info cache due to event network-changed-fc17db49-50e4-4186-af46-e3cbd2dd7677. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Acquiring lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Acquired lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.network.neutron [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Refreshing network info cache for port fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-ef2cc40d-ca85-44dd-bee3-afc71852c835 req-ad7f5419-a87f-4d93-9f81-1685ca9a157f service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-869edc66-112a-4313-a86a-786335d36b51 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ef2cc40d-ca85-44dd-bee3-afc71852c835 req-ad7f5419-a87f-4d93-9f81-1685ca9a157f service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ef2cc40d-ca85-44dd-bee3-afc71852c835 req-ad7f5419-a87f-4d93-9f81-1685ca9a157f service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ef2cc40d-ca85-44dd-bee3-afc71852c835 req-ad7f5419-a87f-4d93-9f81-1685ca9a157f service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-ef2cc40d-ca85-44dd-bee3-afc71852c835 req-ad7f5419-a87f-4d93-9f81-1685ca9a157f service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-869edc66-112a-4313-a86a-786335d36b51 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:18:32 user nova-compute[72849]: WARNING nova.compute.manager [req-ef2cc40d-ca85-44dd-bee3-afc71852c835 req-ad7f5419-a87f-4d93-9f81-1685ca9a157f service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-869edc66-112a-4313-a86a-786335d36b51 for instance with vm_state building and task_state spawning.
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-ef2cc40d-ca85-44dd-bee3-afc71852c835 req-ad7f5419-a87f-4d93-9f81-1685ca9a157f service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-be0000b5-95ec-4f3f-9344-3754b9f63a3d {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ef2cc40d-ca85-44dd-bee3-afc71852c835 req-ad7f5419-a87f-4d93-9f81-1685ca9a157f service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ef2cc40d-ca85-44dd-bee3-afc71852c835 req-ad7f5419-a87f-4d93-9f81-1685ca9a157f service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ef2cc40d-ca85-44dd-bee3-afc71852c835 req-ad7f5419-a87f-4d93-9f81-1685ca9a157f service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-ef2cc40d-ca85-44dd-bee3-afc71852c835 req-ad7f5419-a87f-4d93-9f81-1685ca9a157f service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-be0000b5-95ec-4f3f-9344-3754b9f63a3d {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:18:32 user nova-compute[72849]: WARNING nova.compute.manager [req-ef2cc40d-ca85-44dd-bee3-afc71852c835 req-ad7f5419-a87f-4d93-9f81-1685ca9a157f service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-be0000b5-95ec-4f3f-9344-3754b9f63a3d for instance with vm_state building and task_state spawning.
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-ef2cc40d-ca85-44dd-bee3-afc71852c835 req-ad7f5419-a87f-4d93-9f81-1685ca9a157f service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-be0000b5-95ec-4f3f-9344-3754b9f63a3d {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ef2cc40d-ca85-44dd-bee3-afc71852c835 req-ad7f5419-a87f-4d93-9f81-1685ca9a157f service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ef2cc40d-ca85-44dd-bee3-afc71852c835 req-ad7f5419-a87f-4d93-9f81-1685ca9a157f service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ef2cc40d-ca85-44dd-bee3-afc71852c835 req-ad7f5419-a87f-4d93-9f81-1685ca9a157f service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-ef2cc40d-ca85-44dd-bee3-afc71852c835 req-ad7f5419-a87f-4d93-9f81-1685ca9a157f service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-be0000b5-95ec-4f3f-9344-3754b9f63a3d {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:18:32 user nova-compute[72849]: WARNING nova.compute.manager [req-ef2cc40d-ca85-44dd-bee3-afc71852c835 req-ad7f5419-a87f-4d93-9f81-1685ca9a157f service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-be0000b5-95ec-4f3f-9344-3754b9f63a3d for instance with vm_state building and task_state spawning.
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:18:32 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:18:32 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=7100MB free_disk=25.622020721435547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:32 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Instance spawned successfully.
Aug 15 16:18:32 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116311.7198308, 40d69bd5-67c0-4b3c-8615-6660145b61fb => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:18:32 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] VM Started (Lifecycle Event)
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:18:32 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:18:32 user nova-compute[72849]: INFO nova.compute.manager [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] instance snapshotting
Aug 15 16:18:32 user nova-compute[72849]: INFO nova.compute.manager [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Took 12.07 seconds to spawn the instance on the hypervisor.
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b0a869eb-9ee8-4c31-9786-5b8be7d362a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 341edacc-b44b-4d92-9fcd-982c252fcdd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance c47e8572-bf45-4f91-9ca7-2dbee7972113 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 7d843493-eda8-46a9-bb1b-3cc80eed7488 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 3954da38-0292-40f7-8ace-6987d0248a44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 5c64c95c-74b3-4883-94d2-ee99ff27434e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 40d69bd5-67c0-4b3c-8615-6660145b61fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:18:32 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Beginning live snapshot process
Aug 15 16:18:32 user nova-compute[72849]: INFO nova.compute.manager [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Took 44.39 seconds to build instance.
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-77299e07-da09-4429-8931-1f24eb724a8f tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.521s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json -f qcow2 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c95d2b63-2933-4993-863b-9254f984d8cf req-46087472-fc2f-432b-9056-9a0e7f7d76a6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-68f4af0d-01e5-4950-b08a-c8454b09dd3e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c95d2b63-2933-4993-863b-9254f984d8cf req-46087472-fc2f-432b-9056-9a0e7f7d76a6 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c95d2b63-2933-4993-863b-9254f984d8cf req-46087472-fc2f-432b-9056-9a0e7f7d76a6 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c95d2b63-2933-4993-863b-9254f984d8cf req-46087472-fc2f-432b-9056-9a0e7f7d76a6 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c95d2b63-2933-4993-863b-9254f984d8cf req-46087472-fc2f-432b-9056-9a0e7f7d76a6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-68f4af0d-01e5-4950-b08a-c8454b09dd3e {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:18:32 user nova-compute[72849]: WARNING nova.compute.manager [req-c95d2b63-2933-4993-863b-9254f984d8cf req-46087472-fc2f-432b-9056-9a0e7f7d76a6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-68f4af0d-01e5-4950-b08a-c8454b09dd3e for instance with vm_state active and task_state None.
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c95d2b63-2933-4993-863b-9254f984d8cf req-46087472-fc2f-432b-9056-9a0e7f7d76a6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-3c779d1d-1bdc-4614-b153-60d32915a3b9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c95d2b63-2933-4993-863b-9254f984d8cf req-46087472-fc2f-432b-9056-9a0e7f7d76a6 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c95d2b63-2933-4993-863b-9254f984d8cf req-46087472-fc2f-432b-9056-9a0e7f7d76a6 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c95d2b63-2933-4993-863b-9254f984d8cf req-46087472-fc2f-432b-9056-9a0e7f7d76a6 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c95d2b63-2933-4993-863b-9254f984d8cf req-46087472-fc2f-432b-9056-9a0e7f7d76a6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-3c779d1d-1bdc-4614-b153-60d32915a3b9 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:18:32 user nova-compute[72849]: WARNING nova.compute.manager [req-c95d2b63-2933-4993-863b-9254f984d8cf req-46087472-fc2f-432b-9056-9a0e7f7d76a6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-3c779d1d-1bdc-4614-b153-60d32915a3b9 for instance with vm_state active and task_state None.
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c95d2b63-2933-4993-863b-9254f984d8cf req-46087472-fc2f-432b-9056-9a0e7f7d76a6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-3c779d1d-1bdc-4614-b153-60d32915a3b9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c95d2b63-2933-4993-863b-9254f984d8cf req-46087472-fc2f-432b-9056-9a0e7f7d76a6 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c95d2b63-2933-4993-863b-9254f984d8cf req-46087472-fc2f-432b-9056-9a0e7f7d76a6 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c95d2b63-2933-4993-863b-9254f984d8cf req-46087472-fc2f-432b-9056-9a0e7f7d76a6 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c95d2b63-2933-4993-863b-9254f984d8cf req-46087472-fc2f-432b-9056-9a0e7f7d76a6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-3c779d1d-1bdc-4614-b153-60d32915a3b9 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:18:32 user nova-compute[72849]: WARNING nova.compute.manager [req-c95d2b63-2933-4993-863b-9254f984d8cf req-46087472-fc2f-432b-9056-9a0e7f7d76a6 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-3c779d1d-1bdc-4614-b153-60d32915a3b9 for instance with vm_state active and task_state None.
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.network.neutron [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Updated VIF entry in instance network info cache for port fc17db49-50e4-4186-af46-e3cbd2dd7677. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.network.neutron [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Updating instance_info_cache with network_info: [{"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Releasing lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-74249c5d-642c-48c3-aa3e-79f9165580bc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-74249c5d-642c-48c3-aa3e-79f9165580bc {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:18:32 user nova-compute[72849]: WARNING nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-74249c5d-642c-48c3-aa3e-79f9165580bc for instance with vm_state building and task_state spawning.
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-74249c5d-642c-48c3-aa3e-79f9165580bc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-74249c5d-642c-48c3-aa3e-79f9165580bc {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:18:32 user nova-compute[72849]: WARNING nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-74249c5d-642c-48c3-aa3e-79f9165580bc for instance with vm_state building and task_state spawning.
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-68f4af0d-01e5-4950-b08a-c8454b09dd3e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-68f4af0d-01e5-4950-b08a-c8454b09dd3e {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:18:32 user nova-compute[72849]: WARNING nova.compute.manager [req-c597cb90-8a33-46b4-9e65-1c2ad0c930f4 req-7967b8b6-cb0a-4fbc-88b9-8cbb4c6f5c27 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-68f4af0d-01e5-4950-b08a-c8454b09dd3e for instance with vm_state building and task_state spawning.
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json -f qcow2 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:18:32 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:18:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:18:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.772s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.173s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppnrdwm5d/4ff5284ee26c4aed9dc0c9a793d4db1b.delta 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppnrdwm5d/4ff5284ee26c4aed9dc0c9a793d4db1b.delta 1073741824" returned: 0 in 0.044s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:33 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 16:18:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:18:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:18:34 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 16:18:34 user nova-compute[72849]: DEBUG nova.privsep.utils [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72849) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 16:18:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppnrdwm5d/4ff5284ee26c4aed9dc0c9a793d4db1b.delta /opt/stack/data/nova/instances/snapshots/tmppnrdwm5d/4ff5284ee26c4aed9dc0c9a793d4db1b {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppnrdwm5d/4ff5284ee26c4aed9dc0c9a793d4db1b.delta /opt/stack/data/nova/instances/snapshots/tmppnrdwm5d/4ff5284ee26c4aed9dc0c9a793d4db1b" returned: 0 in 0.241s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:34 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Snapshot extracted, beginning image upload
Aug 15 16:18:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:37 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Snapshot image upload complete
Aug 15 16:18:37 user nova-compute[72849]: INFO nova.compute.manager [None req-74fce1f7-5dcb-434e-954e-3acec8a6401b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Took 5.29 seconds to snapshot the instance on the hypervisor.
Aug 15 16:18:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-c13bbbbb-4e7b-40f6-b805-e3671ec738a0 req-7a66992b-030b-4c4b-8a91-ae24bce37e09 service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Received event network-changed-c605963e-3827-4ad6-ab40-665c92c252b1 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-c13bbbbb-4e7b-40f6-b805-e3671ec738a0 req-7a66992b-030b-4c4b-8a91-ae24bce37e09 service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Refreshing instance network info cache due to event network-changed-c605963e-3827-4ad6-ab40-665c92c252b1. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:18:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c13bbbbb-4e7b-40f6-b805-e3671ec738a0 req-7a66992b-030b-4c4b-8a91-ae24bce37e09 service nova] Acquiring lock "refresh_cache-341edacc-b44b-4d92-9fcd-982c252fcdd6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:18:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c13bbbbb-4e7b-40f6-b805-e3671ec738a0 req-7a66992b-030b-4c4b-8a91-ae24bce37e09 service nova] Acquired lock "refresh_cache-341edacc-b44b-4d92-9fcd-982c252fcdd6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:18:41 user nova-compute[72849]: DEBUG nova.network.neutron [req-c13bbbbb-4e7b-40f6-b805-e3671ec738a0 req-7a66992b-030b-4c4b-8a91-ae24bce37e09 service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Refreshing network info cache for port c605963e-3827-4ad6-ab40-665c92c252b1 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:18:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:41 user nova-compute[72849]: DEBUG nova.network.neutron [req-c13bbbbb-4e7b-40f6-b805-e3671ec738a0 req-7a66992b-030b-4c4b-8a91-ae24bce37e09 service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Updated VIF entry in instance network info cache for port c605963e-3827-4ad6-ab40-665c92c252b1. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:18:41 user nova-compute[72849]: DEBUG nova.network.neutron [req-c13bbbbb-4e7b-40f6-b805-e3671ec738a0 req-7a66992b-030b-4c4b-8a91-ae24bce37e09 service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Updating instance_info_cache with network_info: [{"id": "c605963e-3827-4ad6-ab40-665c92c252b1", "address": "fa:16:3e:0a:d9:a5", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605963e-38", "ovs_interfaceid": "c605963e-3827-4ad6-ab40-665c92c252b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:18:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c13bbbbb-4e7b-40f6-b805-e3671ec738a0 req-7a66992b-030b-4c4b-8a91-ae24bce37e09 service nova] Releasing lock "refresh_cache-341edacc-b44b-4d92-9fcd-982c252fcdd6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:18:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "8aa1e777-f613-457a-9458-d36b2b6010e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:18:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:43 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:18:43 user nova-compute[72849]: INFO nova.compute.claims [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Claim successful on node user
Aug 15 16:18:43 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:18:43 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:18:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:43 user nova-compute[72849]: DEBUG nova.compute.manager [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:18:43 user nova-compute[72849]: DEBUG nova.compute.manager [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:18:43 user nova-compute[72849]: DEBUG nova.network.neutron [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:18:43 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:18:43 user nova-compute[72849]: DEBUG nova.compute.manager [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:18:43 user nova-compute[72849]: DEBUG nova.policy [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2471145e3ea84645bcfa51f4fcf4cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065226f254df40baaf230ccd5f13f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:18:43 user nova-compute[72849]: DEBUG nova.compute.manager [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:18:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:18:43 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Creating image(s)
Aug 15 16:18:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "/opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "/opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "/opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.244s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.194s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk 1073741824" returned: 0 in 0.048s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:44 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:18:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:44 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Cannot resize image /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:18:44 user nova-compute[72849]: DEBUG nova.objects.instance [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lazy-loading 'migration_context' on Instance uuid 8aa1e777-f613-457a-9458-d36b2b6010e9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:18:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:18:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Ensure instance console log exists: /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:18:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:44 user nova-compute[72849]: DEBUG nova.network.neutron [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Successfully created port: 281634e4-b965-40cf-b60f-9c122ec59050 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "341edacc-b44b-4d92-9fcd-982c252fcdd6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lazy-loading 'flavor' on Instance uuid 341edacc-b44b-4d92-9fcd-982c252fcdd6 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "341edacc-b44b-4d92-9fcd-982c252fcdd6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:45 user nova-compute[72849]: INFO nova.compute.manager [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Attaching volume fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd to /dev/vdb
Aug 15 16:18:45 user nova-compute[72849]: DEBUG os_brick.utils [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48030f4-5b85-4aeb-8e7f-8a308d4cbf03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[792a7bc4-197f-469d-be00-62571862e27a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c66953b-05c6-4816-b7da-6bea4013fbe3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88819d9-9eb2-4cfd-a4c2-3c943796ffe7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.network.neutron [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Successfully updated port: 281634e4-b965-40cf-b60f-9c122ec59050 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:18:45 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[07681706-093a-4471-8b03-718d71c34750]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG os_brick.utils [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Updating existing volume attachment record: e669576e-42d0-4d57-9a2c-c0ce72fa2c6e {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "refresh_cache-8aa1e777-f613-457a-9458-d36b2b6010e9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquired lock "refresh_cache-8aa1e777-f613-457a-9458-d36b2b6010e9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.network.neutron [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-8c35bcf2-295c-4b56-959c-4b0fc2ed8983 req-1ebff573-fab7-40c5-a805-020da5fe45da service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Received event network-changed-281634e4-b965-40cf-b60f-9c122ec59050 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-8c35bcf2-295c-4b56-959c-4b0fc2ed8983 req-1ebff573-fab7-40c5-a805-020da5fe45da service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Refreshing instance network info cache due to event network-changed-281634e4-b965-40cf-b60f-9c122ec59050. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8c35bcf2-295c-4b56-959c-4b0fc2ed8983 req-1ebff573-fab7-40c5-a805-020da5fe45da service nova] Acquiring lock "refresh_cache-8aa1e777-f613-457a-9458-d36b2b6010e9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.network.neutron [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.network.neutron [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Updating instance_info_cache with network_info: [{"id": "281634e4-b965-40cf-b60f-9c122ec59050", "address": "fa:16:3e:18:f9:c0", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281634e4-b9", "ovs_interfaceid": "281634e4-b965-40cf-b60f-9c122ec59050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Releasing lock "refresh_cache-8aa1e777-f613-457a-9458-d36b2b6010e9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.compute.manager [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Instance network_info: |[{"id": "281634e4-b965-40cf-b60f-9c122ec59050", "address": "fa:16:3e:18:f9:c0", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281634e4-b9", "ovs_interfaceid": "281634e4-b965-40cf-b60f-9c122ec59050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8c35bcf2-295c-4b56-959c-4b0fc2ed8983 req-1ebff573-fab7-40c5-a805-020da5fe45da service nova] Acquired lock "refresh_cache-8aa1e777-f613-457a-9458-d36b2b6010e9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.network.neutron [req-8c35bcf2-295c-4b56-959c-4b0fc2ed8983 req-1ebff573-fab7-40c5-a805-020da5fe45da service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Refreshing network info cache for port 281634e4-b965-40cf-b60f-9c122ec59050 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Start _get_guest_xml network_info=[{"id": "281634e4-b965-40cf-b60f-9c122ec59050", "address": "fa:16:3e:18:f9:c0", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281634e4-b9", "ovs_interfaceid": "281634e4-b965-40cf-b60f-9c122ec59050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:18:45 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:18:45 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:18:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-781402979',display_name='tempest-VolumesSnapshotTestJSON-instance-781402979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-781402979',id=11,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd+9r5zIYSoU2xDqoNQDWikI3+IQKPE0XDwDyBa5ZxoE2wB1FZuNLpBS7ELhNP65xFQbr8HwTwHz4wbnRcEQ5HVK1EeJt/a09RCZggAX+f8wt3zuF/Wgmah4HAccPOD8A==',key_name='tempest-keypair-2063945134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='065226f254df40baaf230ccd5f13f62a',ramdisk_id='',reservation_id='r-ec27d4ld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1243118890',owner_user_name='tempest-VolumesSnapshotTestJSON-1243118890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2471145e3ea84645bcfa51f4fcf4cbbc',uuid=8aa1e777-f613-457a-9458-d36b2b6010e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "281634e4-b965-40cf-b60f-9c122ec59050", "address": "fa:16:3e:18:f9:c0", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281634e4-b9", "ovs_interfaceid": "281634e4-b965-40cf-b60f-9c122ec59050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Converting VIF {"id": "281634e4-b965-40cf-b60f-9c122ec59050", "address": "fa:16:3e:18:f9:c0", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281634e4-b9", "ovs_interfaceid": "281634e4-b965-40cf-b60f-9c122ec59050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:f9:c0,bridge_name='br-int',has_traffic_filtering=True,id=281634e4-b965-40cf-b60f-9c122ec59050,network=Network(ea172a57-fdfb-45f3-b3df-e6f4751eb20b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281634e4-b9') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.objects.instance [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lazy-loading 'pci_devices' on Instance uuid 8aa1e777-f613-457a-9458-d36b2b6010e9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:18:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:18:45 user nova-compute[72849]:   <uuid>8aa1e777-f613-457a-9458-d36b2b6010e9</uuid>
Aug 15 16:18:45 user nova-compute[72849]:   <name>instance-0000000b</name>
Aug 15 16:18:45 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:18:45 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:18:45 user nova-compute[72849]:   <metadata>
Aug 15 16:18:45 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:18:45 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:18:45 user nova-compute[72849]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-781402979</nova:name>
Aug 15 16:18:45 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:18:45</nova:creationTime>
Aug 15 16:18:45 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:18:45 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:18:45 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:18:45 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:18:45 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:18:45 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:18:45 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:18:45 user nova-compute[72849]:       <nova:owner>
Aug 15 16:18:45 user nova-compute[72849]:         <nova:user uuid="2471145e3ea84645bcfa51f4fcf4cbbc">tempest-VolumesSnapshotTestJSON-1243118890-project-member</nova:user>
Aug 15 16:18:45 user nova-compute[72849]:         <nova:project uuid="065226f254df40baaf230ccd5f13f62a">tempest-VolumesSnapshotTestJSON-1243118890</nova:project>
Aug 15 16:18:45 user nova-compute[72849]:       </nova:owner>
Aug 15 16:18:45 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:18:45 user nova-compute[72849]:       <nova:ports>
Aug 15 16:18:45 user nova-compute[72849]:         <nova:port uuid="281634e4-b965-40cf-b60f-9c122ec59050">
Aug 15 16:18:45 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:18:45 user nova-compute[72849]:         </nova:port>
Aug 15 16:18:45 user nova-compute[72849]:       </nova:ports>
Aug 15 16:18:45 user nova-compute[72849]:     </nova:instance>
Aug 15 16:18:45 user nova-compute[72849]:   </metadata>
Aug 15 16:18:45 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:18:45 user nova-compute[72849]:     <system>
Aug 15 16:18:45 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:18:45 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:18:45 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:18:45 user nova-compute[72849]:       <entry name="serial">8aa1e777-f613-457a-9458-d36b2b6010e9</entry>
Aug 15 16:18:45 user nova-compute[72849]:       <entry name="uuid">8aa1e777-f613-457a-9458-d36b2b6010e9</entry>
Aug 15 16:18:45 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:18:45 user nova-compute[72849]:     </system>
Aug 15 16:18:45 user nova-compute[72849]:   </sysinfo>
Aug 15 16:18:45 user nova-compute[72849]:   <os>
Aug 15 16:18:45 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:18:45 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:18:45 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:18:45 user nova-compute[72849]:   </os>
Aug 15 16:18:45 user nova-compute[72849]:   <features>
Aug 15 16:18:45 user nova-compute[72849]:     <acpi/>
Aug 15 16:18:45 user nova-compute[72849]:     <apic/>
Aug 15 16:18:45 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:18:45 user nova-compute[72849]:   </features>
Aug 15 16:18:45 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:18:45 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:18:45 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:18:45 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:18:45 user nova-compute[72849]:   </clock>
Aug 15 16:18:45 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:18:45 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:18:45 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:18:45 user nova-compute[72849]:   </cpu>
Aug 15 16:18:45 user nova-compute[72849]:   <devices>
Aug 15 16:18:45 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:18:45 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:18:45 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk"/>
Aug 15 16:18:45 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:18:45 user nova-compute[72849]:     </disk>
Aug 15 16:18:45 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:18:45 user nova-compute[72849]:       <mac address="fa:16:3e:18:f9:c0"/>
Aug 15 16:18:45 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:18:45 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:18:45 user nova-compute[72849]:       <target dev="tap281634e4-b9"/>
Aug 15 16:18:45 user nova-compute[72849]:     </interface>
Aug 15 16:18:45 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:18:45 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/console.log" append="off"/>
Aug 15 16:18:45 user nova-compute[72849]:     </serial>
Aug 15 16:18:45 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:18:45 user nova-compute[72849]:     <video>
Aug 15 16:18:45 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:18:45 user nova-compute[72849]:     </video>
Aug 15 16:18:45 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:18:45 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:18:45 user nova-compute[72849]:     </rng>
Aug 15 16:18:45 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:18:45 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:18:45 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:18:45 user nova-compute[72849]:     </memballoon>
Aug 15 16:18:45 user nova-compute[72849]:   </devices>
Aug 15 16:18:45 user nova-compute[72849]: </domain>
Aug 15 16:18:45 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:18:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-781402979',display_name='tempest-VolumesSnapshotTestJSON-instance-781402979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-781402979',id=11,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd+9r5zIYSoU2xDqoNQDWikI3+IQKPE0XDwDyBa5ZxoE2wB1FZuNLpBS7ELhNP65xFQbr8HwTwHz4wbnRcEQ5HVK1EeJt/a09RCZggAX+f8wt3zuF/Wgmah4HAccPOD8A==',key_name='tempest-keypair-2063945134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='065226f254df40baaf230ccd5f13f62a',ramdisk_id='',reservation_id='r-ec27d4ld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1243118890',owner_user_name='tempest-VolumesSnapshotTestJSON-1243118890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2471145e3ea84645bcfa51f4fcf4cbbc',uuid=8aa1e777-f613-457a-9458-d36b2b6010e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "281634e4-b965-40cf-b60f-9c122ec59050", "address": "fa:16:3e:18:f9:c0", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281634e4-b9", "ovs_interfaceid": "281634e4-b965-40cf-b60f-9c122ec59050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:18:46 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Converting VIF {"id": "281634e4-b965-40cf-b60f-9c122ec59050", "address": "fa:16:3e:18:f9:c0", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281634e4-b9", "ovs_interfaceid": "281634e4-b965-40cf-b60f-9c122ec59050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:46 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:f9:c0,bridge_name='br-int',has_traffic_filtering=True,id=281634e4-b965-40cf-b60f-9c122ec59050,network=Network(ea172a57-fdfb-45f3-b3df-e6f4751eb20b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281634e4-b9') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:46 user nova-compute[72849]: DEBUG os_vif [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:f9:c0,bridge_name='br-int',has_traffic_filtering=True,id=281634e4-b965-40cf-b60f-9c122ec59050,network=Network(ea172a57-fdfb-45f3-b3df-e6f4751eb20b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281634e4-b9') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:18:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:18:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap281634e4-b9, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap281634e4-b9, col_values=(('external_ids', {'iface-id': '281634e4-b965-40cf-b60f-9c122ec59050', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:f9:c0', 'vm-uuid': '8aa1e777-f613-457a-9458-d36b2b6010e9'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:18:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:46 user nova-compute[72849]: INFO os_vif [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:f9:c0,bridge_name='br-int',has_traffic_filtering=True,id=281634e4-b965-40cf-b60f-9c122ec59050,network=Network(ea172a57-fdfb-45f3-b3df-e6f4751eb20b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281634e4-b9')
Aug 15 16:18:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:18:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] No VIF found with MAC fa:16:3e:18:f9:c0, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:18:46 user nova-compute[72849]: DEBUG nova.network.neutron [req-8c35bcf2-295c-4b56-959c-4b0fc2ed8983 req-1ebff573-fab7-40c5-a805-020da5fe45da service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Updated VIF entry in instance network info cache for port 281634e4-b965-40cf-b60f-9c122ec59050. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:18:46 user nova-compute[72849]: DEBUG nova.network.neutron [req-8c35bcf2-295c-4b56-959c-4b0fc2ed8983 req-1ebff573-fab7-40c5-a805-020da5fe45da service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Updating instance_info_cache with network_info: [{"id": "281634e4-b965-40cf-b60f-9c122ec59050", "address": "fa:16:3e:18:f9:c0", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281634e4-b9", "ovs_interfaceid": "281634e4-b965-40cf-b60f-9c122ec59050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:18:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8c35bcf2-295c-4b56-959c-4b0fc2ed8983 req-1ebff573-fab7-40c5-a805-020da5fe45da service nova] Releasing lock "refresh_cache-8aa1e777-f613-457a-9458-d36b2b6010e9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:18:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Acquiring lock "3a3a822c-230a-47a6-9658-8879957455de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lock "3a3a822c-230a-47a6-9658-8879957455de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:18:49 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116329.7293286, 8aa1e777-f613-457a-9458-d36b2b6010e9 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:18:49 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] VM Resumed (Lifecycle Event)
Aug 15 16:18:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:18:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:18:49 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:18:49 user nova-compute[72849]: INFO nova.compute.claims [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Claim successful on node user
Aug 15 16:18:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:18:49 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Instance spawned successfully.
Aug 15 16:18:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:18:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:18:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:18:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:18:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:18:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:18:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:18:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:18:49 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:18:49 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116329.7320895, 8aa1e777-f613-457a-9458-d36b2b6010e9 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:18:49 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] VM Started (Lifecycle Event)
Aug 15 16:18:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:18:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:18:49 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:18:49 user nova-compute[72849]: INFO nova.compute.manager [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Took 6.18 seconds to spawn the instance on the hypervisor.
Aug 15 16:18:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:18:49 user nova-compute[72849]: INFO nova.compute.manager [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Took 7.01 seconds to build instance.
Aug 15 16:18:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-500c18ce-10c5-4ac4-ab29-eb42e3ca70bc tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.133s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:50 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:18:50 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:18:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:50 user nova-compute[72849]: DEBUG nova.compute.manager [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:18:50 user nova-compute[72849]: DEBUG nova.compute.manager [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:18:50 user nova-compute[72849]: DEBUG nova.network.neutron [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:18:50 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:18:50 user nova-compute[72849]: DEBUG nova.compute.manager [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:18:50 user nova-compute[72849]: DEBUG nova.policy [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1bd2b852f1ae4a1b9e379632a2aa0ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1a6b448bb4977a32e860f74031e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:18:50 user nova-compute[72849]: DEBUG nova.compute.manager [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:18:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:18:50 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Creating image(s)
Aug 15 16:18:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lock "/opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lock "/opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.208s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.249s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG nova.network.neutron [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Successfully created port: cd7e0007-7124-4f85-a443-a8235d548f2c {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/disk 1073741824" returned: 0 in 0.060s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.192s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Cannot resize image /opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG nova.objects.instance [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lazy-loading 'migration_context' on Instance uuid 3a3a822c-230a-47a6-9658-8879957455de {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Ensure instance console log exists: /opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG nova.network.neutron [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Successfully updated port: cd7e0007-7124-4f85-a443-a8235d548f2c {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Acquiring lock "refresh_cache-3a3a822c-230a-47a6-9658-8879957455de" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Acquired lock "refresh_cache-3a3a822c-230a-47a6-9658-8879957455de" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG nova.network.neutron [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG nova.compute.manager [req-6c0f7039-2934-4b54-914d-35b721eb3ddd req-c6593efe-d43f-4a7e-b33e-fe327f47f5a9 service nova] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Received event network-changed-cd7e0007-7124-4f85-a443-a8235d548f2c {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG nova.compute.manager [req-6c0f7039-2934-4b54-914d-35b721eb3ddd req-c6593efe-d43f-4a7e-b33e-fe327f47f5a9 service nova] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Refreshing instance network info cache due to event network-changed-cd7e0007-7124-4f85-a443-a8235d548f2c. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6c0f7039-2934-4b54-914d-35b721eb3ddd req-c6593efe-d43f-4a7e-b33e-fe327f47f5a9 service nova] Acquiring lock "refresh_cache-3a3a822c-230a-47a6-9658-8879957455de" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:18:51 user nova-compute[72849]: DEBUG nova.network.neutron [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.network.neutron [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Updating instance_info_cache with network_info: [{"id": "cd7e0007-7124-4f85-a443-a8235d548f2c", "address": "fa:16:3e:35:3a:88", "network": {"id": "cceef6cd-453d-4e81-b737-d1b78ad420e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-628785557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e1a6b448bb4977a32e860f74031e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7e0007-71", "ovs_interfaceid": "cd7e0007-7124-4f85-a443-a8235d548f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Releasing lock "refresh_cache-3a3a822c-230a-47a6-9658-8879957455de" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Instance network_info: |[{"id": "cd7e0007-7124-4f85-a443-a8235d548f2c", "address": "fa:16:3e:35:3a:88", "network": {"id": "cceef6cd-453d-4e81-b737-d1b78ad420e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-628785557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e1a6b448bb4977a32e860f74031e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7e0007-71", "ovs_interfaceid": "cd7e0007-7124-4f85-a443-a8235d548f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6c0f7039-2934-4b54-914d-35b721eb3ddd req-c6593efe-d43f-4a7e-b33e-fe327f47f5a9 service nova] Acquired lock "refresh_cache-3a3a822c-230a-47a6-9658-8879957455de" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.network.neutron [req-6c0f7039-2934-4b54-914d-35b721eb3ddd req-c6593efe-d43f-4a7e-b33e-fe327f47f5a9 service nova] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Refreshing network info cache for port cd7e0007-7124-4f85-a443-a8235d548f2c {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Start _get_guest_xml network_info=[{"id": "cd7e0007-7124-4f85-a443-a8235d548f2c", "address": "fa:16:3e:35:3a:88", "network": {"id": "cceef6cd-453d-4e81-b737-d1b78ad420e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-628785557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e1a6b448bb4977a32e860f74031e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7e0007-71", "ovs_interfaceid": "cd7e0007-7124-4f85-a443-a8235d548f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:18:52 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:18:52 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:18:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-90235108',display_name='tempest-VolumesActionsTest-instance-90235108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-90235108',id=12,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93e1a6b448bb4977a32e860f74031e08',ramdisk_id='',reservation_id='r-230htpye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-130541901',owner_user_name='tempest-VolumesActionsTest-130541901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:18:50Z,user_data=None,user_id='1bd2b852f1ae4a1b9e379632a2aa0ce4',uuid=3a3a822c-230a-47a6-9658-8879957455de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd7e0007-7124-4f85-a443-a8235d548f2c", "address": "fa:16:3e:35:3a:88", "network": {"id": "cceef6cd-453d-4e81-b737-d1b78ad420e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-628785557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e1a6b448bb4977a32e860f74031e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7e0007-71", "ovs_interfaceid": "cd7e0007-7124-4f85-a443-a8235d548f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Converting VIF {"id": "cd7e0007-7124-4f85-a443-a8235d548f2c", "address": "fa:16:3e:35:3a:88", "network": {"id": "cceef6cd-453d-4e81-b737-d1b78ad420e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-628785557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e1a6b448bb4977a32e860f74031e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7e0007-71", "ovs_interfaceid": "cd7e0007-7124-4f85-a443-a8235d548f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:3a:88,bridge_name='br-int',has_traffic_filtering=True,id=cd7e0007-7124-4f85-a443-a8235d548f2c,network=Network(cceef6cd-453d-4e81-b737-d1b78ad420e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7e0007-71') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.objects.instance [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a3a822c-230a-47a6-9658-8879957455de {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:18:52 user nova-compute[72849]:   <uuid>3a3a822c-230a-47a6-9658-8879957455de</uuid>
Aug 15 16:18:52 user nova-compute[72849]:   <name>instance-0000000c</name>
Aug 15 16:18:52 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:18:52 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:18:52 user nova-compute[72849]:   <metadata>
Aug 15 16:18:52 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:18:52 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:18:52 user nova-compute[72849]:       <nova:name>tempest-VolumesActionsTest-instance-90235108</nova:name>
Aug 15 16:18:52 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:18:52</nova:creationTime>
Aug 15 16:18:52 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:18:52 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:18:52 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:18:52 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:18:52 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:18:52 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:18:52 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:18:52 user nova-compute[72849]:       <nova:owner>
Aug 15 16:18:52 user nova-compute[72849]:         <nova:user uuid="1bd2b852f1ae4a1b9e379632a2aa0ce4">tempest-VolumesActionsTest-130541901-project-member</nova:user>
Aug 15 16:18:52 user nova-compute[72849]:         <nova:project uuid="93e1a6b448bb4977a32e860f74031e08">tempest-VolumesActionsTest-130541901</nova:project>
Aug 15 16:18:52 user nova-compute[72849]:       </nova:owner>
Aug 15 16:18:52 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:18:52 user nova-compute[72849]:       <nova:ports>
Aug 15 16:18:52 user nova-compute[72849]:         <nova:port uuid="cd7e0007-7124-4f85-a443-a8235d548f2c">
Aug 15 16:18:52 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 16:18:52 user nova-compute[72849]:         </nova:port>
Aug 15 16:18:52 user nova-compute[72849]:       </nova:ports>
Aug 15 16:18:52 user nova-compute[72849]:     </nova:instance>
Aug 15 16:18:52 user nova-compute[72849]:   </metadata>
Aug 15 16:18:52 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:18:52 user nova-compute[72849]:     <system>
Aug 15 16:18:52 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:18:52 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:18:52 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:18:52 user nova-compute[72849]:       <entry name="serial">3a3a822c-230a-47a6-9658-8879957455de</entry>
Aug 15 16:18:52 user nova-compute[72849]:       <entry name="uuid">3a3a822c-230a-47a6-9658-8879957455de</entry>
Aug 15 16:18:52 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:18:52 user nova-compute[72849]:     </system>
Aug 15 16:18:52 user nova-compute[72849]:   </sysinfo>
Aug 15 16:18:52 user nova-compute[72849]:   <os>
Aug 15 16:18:52 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:18:52 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:18:52 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:18:52 user nova-compute[72849]:   </os>
Aug 15 16:18:52 user nova-compute[72849]:   <features>
Aug 15 16:18:52 user nova-compute[72849]:     <acpi/>
Aug 15 16:18:52 user nova-compute[72849]:     <apic/>
Aug 15 16:18:52 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:18:52 user nova-compute[72849]:   </features>
Aug 15 16:18:52 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:18:52 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:18:52 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:18:52 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:18:52 user nova-compute[72849]:   </clock>
Aug 15 16:18:52 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:18:52 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:18:52 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:18:52 user nova-compute[72849]:   </cpu>
Aug 15 16:18:52 user nova-compute[72849]:   <devices>
Aug 15 16:18:52 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:18:52 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:18:52 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/disk"/>
Aug 15 16:18:52 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:18:52 user nova-compute[72849]:     </disk>
Aug 15 16:18:52 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:18:52 user nova-compute[72849]:       <mac address="fa:16:3e:35:3a:88"/>
Aug 15 16:18:52 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:18:52 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:18:52 user nova-compute[72849]:       <target dev="tapcd7e0007-71"/>
Aug 15 16:18:52 user nova-compute[72849]:     </interface>
Aug 15 16:18:52 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:18:52 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/console.log" append="off"/>
Aug 15 16:18:52 user nova-compute[72849]:     </serial>
Aug 15 16:18:52 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:18:52 user nova-compute[72849]:     <video>
Aug 15 16:18:52 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:18:52 user nova-compute[72849]:     </video>
Aug 15 16:18:52 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:18:52 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:18:52 user nova-compute[72849]:     </rng>
Aug 15 16:18:52 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:18:52 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:18:52 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:18:52 user nova-compute[72849]:     </memballoon>
Aug 15 16:18:52 user nova-compute[72849]:   </devices>
Aug 15 16:18:52 user nova-compute[72849]: </domain>
Aug 15 16:18:52 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:18:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-90235108',display_name='tempest-VolumesActionsTest-instance-90235108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-90235108',id=12,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93e1a6b448bb4977a32e860f74031e08',ramdisk_id='',reservation_id='r-230htpye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-130541901',owner_user_name='tempest-VolumesActionsTest-130541901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:18:50Z,user_data=None,user_id='1bd2b852f1ae4a1b9e379632a2aa0ce4',uuid=3a3a822c-230a-47a6-9658-8879957455de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd7e0007-7124-4f85-a443-a8235d548f2c", "address": "fa:16:3e:35:3a:88", "network": {"id": "cceef6cd-453d-4e81-b737-d1b78ad420e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-628785557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e1a6b448bb4977a32e860f74031e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7e0007-71", "ovs_interfaceid": "cd7e0007-7124-4f85-a443-a8235d548f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Converting VIF {"id": "cd7e0007-7124-4f85-a443-a8235d548f2c", "address": "fa:16:3e:35:3a:88", "network": {"id": "cceef6cd-453d-4e81-b737-d1b78ad420e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-628785557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e1a6b448bb4977a32e860f74031e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7e0007-71", "ovs_interfaceid": "cd7e0007-7124-4f85-a443-a8235d548f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:3a:88,bridge_name='br-int',has_traffic_filtering=True,id=cd7e0007-7124-4f85-a443-a8235d548f2c,network=Network(cceef6cd-453d-4e81-b737-d1b78ad420e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7e0007-71') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG os_vif [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3a:88,bridge_name='br-int',has_traffic_filtering=True,id=cd7e0007-7124-4f85-a443-a8235d548f2c,network=Network(cceef6cd-453d-4e81-b737-d1b78ad420e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7e0007-71') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd7e0007-71, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcd7e0007-71, col_values=(('external_ids', {'iface-id': 'cd7e0007-7124-4f85-a443-a8235d548f2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:3a:88', 'vm-uuid': '3a3a822c-230a-47a6-9658-8879957455de'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:52 user nova-compute[72849]: INFO os_vif [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3a:88,bridge_name='br-int',has_traffic_filtering=True,id=cd7e0007-7124-4f85-a443-a8235d548f2c,network=Network(cceef6cd-453d-4e81-b737-d1b78ad420e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7e0007-71')
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] No VIF found with MAC fa:16:3e:35:3a:88, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.network.neutron [req-6c0f7039-2934-4b54-914d-35b721eb3ddd req-c6593efe-d43f-4a7e-b33e-fe327f47f5a9 service nova] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Updated VIF entry in instance network info cache for port cd7e0007-7124-4f85-a443-a8235d548f2c. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG nova.network.neutron [req-6c0f7039-2934-4b54-914d-35b721eb3ddd req-c6593efe-d43f-4a7e-b33e-fe327f47f5a9 service nova] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Updating instance_info_cache with network_info: [{"id": "cd7e0007-7124-4f85-a443-a8235d548f2c", "address": "fa:16:3e:35:3a:88", "network": {"id": "cceef6cd-453d-4e81-b737-d1b78ad420e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-628785557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e1a6b448bb4977a32e860f74031e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7e0007-71", "ovs_interfaceid": "cd7e0007-7124-4f85-a443-a8235d548f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6c0f7039-2934-4b54-914d-35b721eb3ddd req-c6593efe-d43f-4a7e-b33e-fe327f47f5a9 service nova] Releasing lock "refresh_cache-3a3a822c-230a-47a6-9658-8879957455de" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:18:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-899660b5-5b54-4ec3-ab93-76cdac96a528 req-5de2b98e-d98c-49ec-b675-48906bf51957 service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Received event network-changed-4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-899660b5-5b54-4ec3-ab93-76cdac96a528 req-5de2b98e-d98c-49ec-b675-48906bf51957 service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Refreshing instance network info cache due to event network-changed-4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:18:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-899660b5-5b54-4ec3-ab93-76cdac96a528 req-5de2b98e-d98c-49ec-b675-48906bf51957 service nova] Acquiring lock "refresh_cache-c47e8572-bf45-4f91-9ca7-2dbee7972113" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:18:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-899660b5-5b54-4ec3-ab93-76cdac96a528 req-5de2b98e-d98c-49ec-b675-48906bf51957 service nova] Acquired lock "refresh_cache-c47e8572-bf45-4f91-9ca7-2dbee7972113" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:18:53 user nova-compute[72849]: DEBUG nova.network.neutron [req-899660b5-5b54-4ec3-ab93-76cdac96a528 req-5de2b98e-d98c-49ec-b675-48906bf51957 service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Refreshing network info cache for port 4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:18:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-f53abdbe-5c4c-4a10-964d-ba0bfb82780f req-129db934-2854-434a-8353-f38be70febdd service nova] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Received event network-vif-plugged-cd7e0007-7124-4f85-a443-a8235d548f2c {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f53abdbe-5c4c-4a10-964d-ba0bfb82780f req-129db934-2854-434a-8353-f38be70febdd service nova] Acquiring lock "3a3a822c-230a-47a6-9658-8879957455de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f53abdbe-5c4c-4a10-964d-ba0bfb82780f req-129db934-2854-434a-8353-f38be70febdd service nova] Lock "3a3a822c-230a-47a6-9658-8879957455de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f53abdbe-5c4c-4a10-964d-ba0bfb82780f req-129db934-2854-434a-8353-f38be70febdd service nova] Lock "3a3a822c-230a-47a6-9658-8879957455de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-f53abdbe-5c4c-4a10-964d-ba0bfb82780f req-129db934-2854-434a-8353-f38be70febdd service nova] [instance: 3a3a822c-230a-47a6-9658-8879957455de] No waiting events found dispatching network-vif-plugged-cd7e0007-7124-4f85-a443-a8235d548f2c {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:18:53 user nova-compute[72849]: WARNING nova.compute.manager [req-f53abdbe-5c4c-4a10-964d-ba0bfb82780f req-129db934-2854-434a-8353-f38be70febdd service nova] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Received unexpected event network-vif-plugged-cd7e0007-7124-4f85-a443-a8235d548f2c for instance with vm_state building and task_state spawning.
Aug 15 16:18:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-42e2cb67-b6ce-48a4-b437-8a5f81dda8e7 req-997a28b5-fab2-46e6-b173-6eda162bc60f service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received event network-changed-888d8da9-c8a5-40fd-a421-1a8ec1890f25 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-42e2cb67-b6ce-48a4-b437-8a5f81dda8e7 req-997a28b5-fab2-46e6-b173-6eda162bc60f service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Refreshing instance network info cache due to event network-changed-888d8da9-c8a5-40fd-a421-1a8ec1890f25. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:18:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-42e2cb67-b6ce-48a4-b437-8a5f81dda8e7 req-997a28b5-fab2-46e6-b173-6eda162bc60f service nova] Acquiring lock "refresh_cache-7d843493-eda8-46a9-bb1b-3cc80eed7488" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:18:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-42e2cb67-b6ce-48a4-b437-8a5f81dda8e7 req-997a28b5-fab2-46e6-b173-6eda162bc60f service nova] Acquired lock "refresh_cache-7d843493-eda8-46a9-bb1b-3cc80eed7488" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:18:54 user nova-compute[72849]: DEBUG nova.network.neutron [req-42e2cb67-b6ce-48a4-b437-8a5f81dda8e7 req-997a28b5-fab2-46e6-b173-6eda162bc60f service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Refreshing network info cache for port 888d8da9-c8a5-40fd-a421-1a8ec1890f25 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:18:54 user nova-compute[72849]: DEBUG nova.network.neutron [req-899660b5-5b54-4ec3-ab93-76cdac96a528 req-5de2b98e-d98c-49ec-b675-48906bf51957 service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Updated VIF entry in instance network info cache for port 4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:18:54 user nova-compute[72849]: DEBUG nova.network.neutron [req-899660b5-5b54-4ec3-ab93-76cdac96a528 req-5de2b98e-d98c-49ec-b675-48906bf51957 service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Updating instance_info_cache with network_info: [{"id": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "address": "fa:16:3e:10:4d:2c", "network": {"id": "a6cd3415-3bb0-4caf-85a3-e9090d778c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531227145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc588100f2fa46a0b57d24b0708a625e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7fb39b-6b", "ovs_interfaceid": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:18:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-899660b5-5b54-4ec3-ab93-76cdac96a528 req-5de2b98e-d98c-49ec-b675-48906bf51957 service nova] Releasing lock "refresh_cache-c47e8572-bf45-4f91-9ca7-2dbee7972113" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:18:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "interface-7d843493-eda8-46a9-bb1b-3cc80eed7488-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "interface-7d843493-eda8-46a9-bb1b-3cc80eed7488-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:55 user nova-compute[72849]: DEBUG nova.objects.instance [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lazy-loading 'flavor' on Instance uuid 7d843493-eda8-46a9-bb1b-3cc80eed7488 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:18:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Acquiring lock "3954da38-0292-40f7-8ace-6987d0248a44" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Lock "3954da38-0292-40f7-8ace-6987d0248a44" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:55 user nova-compute[72849]: DEBUG nova.objects.instance [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Lazy-loading 'flavor' on Instance uuid 3954da38-0292-40f7-8ace-6987d0248a44 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:18:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Received event network-vif-plugged-281634e4-b965-40cf-b60f-9c122ec59050 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] Acquiring lock "8aa1e777-f613-457a-9458-d36b2b6010e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] No waiting events found dispatching network-vif-plugged-281634e4-b965-40cf-b60f-9c122ec59050 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:18:55 user nova-compute[72849]: WARNING nova.compute.manager [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Received unexpected event network-vif-plugged-281634e4-b965-40cf-b60f-9c122ec59050 for instance with vm_state active and task_state None.
Aug 15 16:18:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Received event network-changed-9312a7dc-cae1-498e-8151-5dea468286d0 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Refreshing instance network info cache due to event network-changed-9312a7dc-cae1-498e-8151-5dea468286d0. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:18:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] Acquiring lock "refresh_cache-3954da38-0292-40f7-8ace-6987d0248a44" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:18:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] Acquired lock "refresh_cache-3954da38-0292-40f7-8ace-6987d0248a44" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:18:55 user nova-compute[72849]: DEBUG nova.network.neutron [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Refreshing network info cache for port 9312a7dc-cae1-498e-8151-5dea468286d0 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Lock "3954da38-0292-40f7-8ace-6987d0248a44" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.139s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116336.0417209, 3a3a822c-230a-47a6-9658-8879957455de => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:18:56 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3a3a822c-230a-47a6-9658-8879957455de] VM Resumed (Lifecycle Event)
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:18:56 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Instance spawned successfully.
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.network.neutron [req-42e2cb67-b6ce-48a4-b437-8a5f81dda8e7 req-997a28b5-fab2-46e6-b173-6eda162bc60f service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Updated VIF entry in instance network info cache for port 888d8da9-c8a5-40fd-a421-1a8ec1890f25. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.network.neutron [req-42e2cb67-b6ce-48a4-b437-8a5f81dda8e7 req-997a28b5-fab2-46e6-b173-6eda162bc60f service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Updating instance_info_cache with network_info: [{"id": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "address": "fa:16:3e:7d:a6:b4", "network": {"id": "2d0a7c86-1e60-4ea6-93d7-c66b552d95e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1960989403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888d8da9-c8", "ovs_interfaceid": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-42e2cb67-b6ce-48a4-b437-8a5f81dda8e7 req-997a28b5-fab2-46e6-b173-6eda162bc60f service nova] Releasing lock "refresh_cache-7d843493-eda8-46a9-bb1b-3cc80eed7488" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:18:56 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3a3a822c-230a-47a6-9658-8879957455de] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116336.0472357, 3a3a822c-230a-47a6-9658-8879957455de => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:18:56 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3a3a822c-230a-47a6-9658-8879957455de] VM Started (Lifecycle Event)
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.compute.manager [req-a9c0f35f-0f39-4c92-9f5b-e71c8ed134d7 req-964a25ba-39b9-4b73-b17c-2b2403d28b8a service nova] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Received event network-vif-plugged-cd7e0007-7124-4f85-a443-a8235d548f2c {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a9c0f35f-0f39-4c92-9f5b-e71c8ed134d7 req-964a25ba-39b9-4b73-b17c-2b2403d28b8a service nova] Acquiring lock "3a3a822c-230a-47a6-9658-8879957455de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a9c0f35f-0f39-4c92-9f5b-e71c8ed134d7 req-964a25ba-39b9-4b73-b17c-2b2403d28b8a service nova] Lock "3a3a822c-230a-47a6-9658-8879957455de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a9c0f35f-0f39-4c92-9f5b-e71c8ed134d7 req-964a25ba-39b9-4b73-b17c-2b2403d28b8a service nova] Lock "3a3a822c-230a-47a6-9658-8879957455de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.compute.manager [req-a9c0f35f-0f39-4c92-9f5b-e71c8ed134d7 req-964a25ba-39b9-4b73-b17c-2b2403d28b8a service nova] [instance: 3a3a822c-230a-47a6-9658-8879957455de] No waiting events found dispatching network-vif-plugged-cd7e0007-7124-4f85-a443-a8235d548f2c {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:18:56 user nova-compute[72849]: WARNING nova.compute.manager [req-a9c0f35f-0f39-4c92-9f5b-e71c8ed134d7 req-964a25ba-39b9-4b73-b17c-2b2403d28b8a service nova] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Received unexpected event network-vif-plugged-cd7e0007-7124-4f85-a443-a8235d548f2c for instance with vm_state building and task_state spawning.
Aug 15 16:18:56 user nova-compute[72849]: INFO nova.compute.manager [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Took 5.71 seconds to spawn the instance on the hypervisor.
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:18:56 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3a3a822c-230a-47a6-9658-8879957455de] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Acquiring lock "3954da38-0292-40f7-8ace-6987d0248a44" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Lock "3954da38-0292-40f7-8ace-6987d0248a44" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:56 user nova-compute[72849]: INFO nova.compute.manager [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Attaching volume d77b941f-ca2d-48d6-bd21-109489bf74a1 to /dev/vdb
Aug 15 16:18:56 user nova-compute[72849]: INFO nova.compute.manager [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Took 6.59 seconds to build instance.
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.utils [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8c17d5f8-4496-401a-987a-d8520223e584 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lock "3a3a822c-230a-47a6-9658-8879957455de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.752s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[604d3530-4904-42a3-87a1-ff0a04974fe8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3a1a8e-4e00-4e02-8efa-538a8395ecf6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8803e29c-b63e-479d-9cd1-293d1b372c21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[28890858-570a-4acc-b40d-0065b7a98582]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.objects.instance [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lazy-loading 'pci_requests' on Instance uuid 7d843493-eda8-46a9-bb1b-3cc80eed7488 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.network.neutron [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:18:56 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0aeb923-77ce-4bbc-b2fb-265042517f37]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.utils [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Updating existing volume attachment record: 6c484621-e6ae-4388-8850-a22945a57d8b {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.policy [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a442003f0164870905327b6b5f1a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de78e6bddce4402d9829b94e9bd6cf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMlEreNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:18:56 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:18:56 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:18:56 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bfb5d4-65f8-4fa4-b96e-ae03fb65a903]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:18:56 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfbbc7e-9f4b-4586-babc-926b1fe9179c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd] added
Aug 15 16:18:56 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[447def9b-b677-4280-8f10-ddef240b73fe]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[877f7750-8cd7-479c-b3da-08f44b61490b]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uMlEreNt {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uMlEreNt" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9343862e-0a04-41f8-b7f7-13aa5693816b]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uMlEreNt'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8e478a-bf79-4057-860a-8006b1476fef]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a619f-1941-41cd-9e7f-daa20c34f754]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:18:56 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:18:56 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:18:56 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:18:56 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:18:56 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:18:56 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[05123084-5f6f-494c-9501-045c5c426cb8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd, portal: 172.16.0.220,3260]
Aug 15 16:18:56 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd, portal: 172.16.0.220,3260] successful.
Aug 15 16:18:56 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adbf998-7d92-4ca4-8eac-2d62272a8b60]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:18:56 user nova-compute[72849]: DEBUG nova.network.neutron [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Updated VIF entry in instance network info cache for port 9312a7dc-cae1-498e-8151-5dea468286d0. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG nova.network.neutron [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Updating instance_info_cache with network_info: [{"id": "9312a7dc-cae1-498e-8151-5dea468286d0", "address": "fa:16:3e:be:cc:d8", "network": {"id": "343457d5-3929-410d-a486-16e7ca4ef8f2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-695787955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "574b067543464efcbb6701547c90a91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9312a7dc-ca", "ovs_interfaceid": "9312a7dc-cae1-498e-8151-5dea468286d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad0cf66-27df-46b0-b281-b57e47330853]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:18:57 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:18:57 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:18:57 user nova-compute[72849]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd (non-flash)
Aug 15 16:18:57 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:18:57 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:18:57 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:18:57 user nova-compute[72849]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd (non-flash)
Aug 15 16:18:57 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] Releasing lock "refresh_cache-3954da38-0292-40f7-8ace-6987d0248a44" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Received event network-vif-plugged-281634e4-b965-40cf-b60f-9c122ec59050 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] Acquiring lock "8aa1e777-f613-457a-9458-d36b2b6010e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] No waiting events found dispatching network-vif-plugged-281634e4-b965-40cf-b60f-9c122ec59050 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:18:57 user nova-compute[72849]: WARNING nova.compute.manager [req-2b2c784e-ebee-4356-be1b-13bf8743668a req-907af527-cd13-44bf-8039-21d079ddaaf3 service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Received unexpected event network-vif-plugged-281634e4-b965-40cf-b60f-9c122ec59050 for instance with vm_state active and task_state None.
Aug 15 16:18:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdd5cd3-1c41-45ed-b485-bef7c704a02d]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMlEreNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG nova.network.neutron [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Successfully created port: cc094456-8e0d-4269-b99b-5bfd5297a4f7 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:18:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26563386265646330', 'path': '/dev/sde'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563386265646330', 'path': '/dev/sde'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lazy-loading 'flavor' on Instance uuid 341edacc-b44b-4d92-9fcd-982c252fcdd6 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:18:58 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:18:58 user nova-compute[72849]:   <source dev="/dev/sde"/>
Aug 15 16:18:58 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:18:58 user nova-compute[72849]:   <serial>fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd</serial>
Aug 15 16:18:58 user nova-compute[72849]: </disk>
Aug 15 16:18:58 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG nova.network.neutron [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Successfully updated port: cc094456-8e0d-4269-b99b-5bfd5297a4f7 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "refresh_cache-7d843493-eda8-46a9-bb1b-3cc80eed7488" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquired lock "refresh_cache-7d843493-eda8-46a9-bb1b-3cc80eed7488" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG nova.network.neutron [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG nova.compute.manager [req-ef911d80-0202-4543-ad08-5f528554af8d req-4bd7f8b4-795f-44c0-b8da-7842b4466799 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received event network-changed-cc094456-8e0d-4269-b99b-5bfd5297a4f7 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG nova.compute.manager [req-ef911d80-0202-4543-ad08-5f528554af8d req-4bd7f8b4-795f-44c0-b8da-7842b4466799 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Refreshing instance network info cache due to event network-changed-cc094456-8e0d-4269-b99b-5bfd5297a4f7. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ef911d80-0202-4543-ad08-5f528554af8d req-4bd7f8b4-795f-44c0-b8da-7842b4466799 service nova] Acquiring lock "refresh_cache-7d843493-eda8-46a9-bb1b-3cc80eed7488" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Acquiring lock "c47e8572-bf45-4f91-9ca7-2dbee7972113" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lazy-loading 'flavor' on Instance uuid c47e8572-bf45-4f91-9ca7-2dbee7972113 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] No VIF found with MAC fa:16:3e:0a:d9:a5, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:18:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7c7e1045-efc4-406f-8ffb-4e99d364d8a8 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.726s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Acquiring lock "c47e8572-bf45-4f91-9ca7-2dbee7972113" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:18:59 user nova-compute[72849]: INFO nova.compute.manager [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Attaching volume 844a2e12-d1c2-4c98-89c3-88484fd0f329 to /dev/sdc
Aug 15 16:18:59 user nova-compute[72849]: DEBUG os_brick.utils [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d96e8c-911b-49c3-b02a-c71d5c4225a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc34df0f-d1a8-447e-bdce-79f2d84f0703]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f95ed7b-64b5-4314-91a5-5ed233e2be3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[80163282-beb6-4913-8477-95e489f5a583]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:18:59 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[497f5cae-6d25-4940-a54f-a0d0227d1775]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG os_brick.utils [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Updating existing volume attachment record: 684576aa-39bc-4981-9005-b6897a170292 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG nova.network.neutron [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Updating instance_info_cache with network_info: [{"id": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "address": "fa:16:3e:7d:a6:b4", "network": {"id": "2d0a7c86-1e60-4ea6-93d7-c66b552d95e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1960989403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888d8da9-c8", "ovs_interfaceid": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "address": "fa:16:3e:ec:5a:1c", "network": {"id": "a62f6239-f231-4224-ac26-db5fbdedefe4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1068433324", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc094456-8e", "ovs_interfaceid": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Releasing lock "refresh_cache-7d843493-eda8-46a9-bb1b-3cc80eed7488" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ef911d80-0202-4543-ad08-5f528554af8d req-4bd7f8b4-795f-44c0-b8da-7842b4466799 service nova] Acquired lock "refresh_cache-7d843493-eda8-46a9-bb1b-3cc80eed7488" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG nova.network.neutron [req-ef911d80-0202-4543-ad08-5f528554af8d req-4bd7f8b4-795f-44c0-b8da-7842b4466799 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Refreshing network info cache for port cc094456-8e0d-4269-b99b-5bfd5297a4f7 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-215597638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-215597638',id=7,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdbWakgm9rkhjBkOdQBASg9y5tRST/eN38nlLPxQcgrQZwoqRDKC9b5dSss1Yo4J4gifxLRY6ThnnWU08v57v9/fZXdXuUr1hxB2yLXnfesqIyRH5q7Iz1U8TLWUXIMbw==',key_name='tempest-keypair-627680743',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:17:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='de78e6bddce4402d9829b94e9bd6cf05',ramdisk_id='',reservation_id='r-aag6oo7v',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-415257394',owner_user_name='tempest-TaggedAttachmentsTest-415257394-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:17:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a442003f0164870905327b6b5f1a0b2',uuid=7d843493-eda8-46a9-bb1b-3cc80eed7488,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "address": "fa:16:3e:ec:5a:1c", "network": {"id": "a62f6239-f231-4224-ac26-db5fbdedefe4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1068433324", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc094456-8e", "ovs_interfaceid": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Converting VIF {"id": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "address": "fa:16:3e:ec:5a:1c", "network": {"id": "a62f6239-f231-4224-ac26-db5fbdedefe4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1068433324", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc094456-8e", "ovs_interfaceid": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:5a:1c,bridge_name='br-int',has_traffic_filtering=True,id=cc094456-8e0d-4269-b99b-5bfd5297a4f7,network=Network(a62f6239-f231-4224-ac26-db5fbdedefe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc094456-8e') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG os_vif [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:5a:1c,bridge_name='br-int',has_traffic_filtering=True,id=cc094456-8e0d-4269-b99b-5bfd5297a4f7,network=Network(a62f6239-f231-4224-ac26-db5fbdedefe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc094456-8e') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc094456-8e, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc094456-8e, col_values=(('external_ids', {'iface-id': 'cc094456-8e0d-4269-b99b-5bfd5297a4f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:5a:1c', 'vm-uuid': '7d843493-eda8-46a9-bb1b-3cc80eed7488'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:59 user nova-compute[72849]: INFO os_vif [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:5a:1c,bridge_name='br-int',has_traffic_filtering=True,id=cc094456-8e0d-4269-b99b-5bfd5297a4f7,network=Network(a62f6239-f231-4224-ac26-db5fbdedefe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc094456-8e')
Aug 15 16:18:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-215597638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-215597638',id=7,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdbWakgm9rkhjBkOdQBASg9y5tRST/eN38nlLPxQcgrQZwoqRDKC9b5dSss1Yo4J4gifxLRY6ThnnWU08v57v9/fZXdXuUr1hxB2yLXnfesqIyRH5q7Iz1U8TLWUXIMbw==',key_name='tempest-keypair-627680743',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:17:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='de78e6bddce4402d9829b94e9bd6cf05',ramdisk_id='',reservation_id='r-aag6oo7v',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-415257394',owner_user_name='tempest-TaggedAttachmentsTest-415257394-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:17:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a442003f0164870905327b6b5f1a0b2',uuid=7d843493-eda8-46a9-bb1b-3cc80eed7488,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "address": "fa:16:3e:ec:5a:1c", "network": {"id": "a62f6239-f231-4224-ac26-db5fbdedefe4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1068433324", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc094456-8e", "ovs_interfaceid": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Converting VIF {"id": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "address": "fa:16:3e:ec:5a:1c", "network": {"id": "a62f6239-f231-4224-ac26-db5fbdedefe4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1068433324", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc094456-8e", "ovs_interfaceid": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:5a:1c,bridge_name='br-int',has_traffic_filtering=True,id=cc094456-8e0d-4269-b99b-5bfd5297a4f7,network=Network(a62f6239-f231-4224-ac26-db5fbdedefe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc094456-8e') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] attach device xml: <interface type="ethernet">
Aug 15 16:18:59 user nova-compute[72849]:   <mac address="fa:16:3e:ec:5a:1c"/>
Aug 15 16:18:59 user nova-compute[72849]:   <model type="virtio"/>
Aug 15 16:18:59 user nova-compute[72849]:   <mtu size="1442"/>
Aug 15 16:18:59 user nova-compute[72849]:   <target dev="tapcc094456-8e"/>
Aug 15 16:18:59 user nova-compute[72849]: </interface>
Aug 15 16:18:59 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG nova.compute.manager [req-5eeaf3cd-b856-46fd-ba6c-98cb118ee2af req-cd02e194-4e72-444d-979a-0ce6f6e6a4af service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received event network-changed-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG nova.compute.manager [req-5eeaf3cd-b856-46fd-ba6c-98cb118ee2af req-cd02e194-4e72-444d-979a-0ce6f6e6a4af service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Refreshing instance network info cache due to event network-changed-9c27980b-1f4d-4a61-9648-9ed67abcb551. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5eeaf3cd-b856-46fd-ba6c-98cb118ee2af req-cd02e194-4e72-444d-979a-0ce6f6e6a4af service nova] Acquiring lock "refresh_cache-5c64c95c-74b3-4883-94d2-ee99ff27434e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5eeaf3cd-b856-46fd-ba6c-98cb118ee2af req-cd02e194-4e72-444d-979a-0ce6f6e6a4af service nova] Acquired lock "refresh_cache-5c64c95c-74b3-4883-94d2-ee99ff27434e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:18:59 user nova-compute[72849]: DEBUG nova.network.neutron [req-5eeaf3cd-b856-46fd-ba6c-98cb118ee2af req-cd02e194-4e72-444d-979a-0ce6f6e6a4af service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Refreshing network info cache for port 9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] No BDM found with device name hda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] No VIF found with MAC fa:16:3e:7d:a6:b4, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:19:00 user nova-compute[72849]:   <nova:package version="0.0.0"/>
Aug 15 16:19:00 user nova-compute[72849]:   <nova:name>tempest-device-tagging-server-215597638</nova:name>
Aug 15 16:19:00 user nova-compute[72849]:   <nova:creationTime>2023-08-15 16:19:00</nova:creationTime>
Aug 15 16:19:00 user nova-compute[72849]:   <nova:flavor name="m1.tiny">
Aug 15 16:19:00 user nova-compute[72849]:     <nova:memory>512</nova:memory>
Aug 15 16:19:00 user nova-compute[72849]:     <nova:disk>1</nova:disk>
Aug 15 16:19:00 user nova-compute[72849]:     <nova:swap>0</nova:swap>
Aug 15 16:19:00 user nova-compute[72849]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:19:00 user nova-compute[72849]:     <nova:vcpus>1</nova:vcpus>
Aug 15 16:19:00 user nova-compute[72849]:   </nova:flavor>
Aug 15 16:19:00 user nova-compute[72849]:   <nova:owner>
Aug 15 16:19:00 user nova-compute[72849]:     <nova:user uuid="9a442003f0164870905327b6b5f1a0b2">tempest-TaggedAttachmentsTest-415257394-project-member</nova:user>
Aug 15 16:19:00 user nova-compute[72849]:     <nova:project uuid="de78e6bddce4402d9829b94e9bd6cf05">tempest-TaggedAttachmentsTest-415257394</nova:project>
Aug 15 16:19:00 user nova-compute[72849]:   </nova:owner>
Aug 15 16:19:00 user nova-compute[72849]:   <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:19:00 user nova-compute[72849]:   <nova:ports>
Aug 15 16:19:00 user nova-compute[72849]:     <nova:port uuid="888d8da9-c8a5-40fd-a421-1a8ec1890f25">
Aug 15 16:19:00 user nova-compute[72849]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:19:00 user nova-compute[72849]:     </nova:port>
Aug 15 16:19:00 user nova-compute[72849]:     <nova:port uuid="cc094456-8e0d-4269-b99b-5bfd5297a4f7">
Aug 15 16:19:00 user nova-compute[72849]:       <nova:ip type="fixed" address="10.10.10.32" ipVersion="4"/>
Aug 15 16:19:00 user nova-compute[72849]:     </nova:port>
Aug 15 16:19:00 user nova-compute[72849]:   </nova:ports>
Aug 15 16:19:00 user nova-compute[72849]: </nova:instance>
Aug 15 16:19:00 user nova-compute[72849]:  {{(pid=72849) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Acquiring lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG nova.objects.instance [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lazy-loading 'flavor' on Instance uuid 5c64c95c-74b3-4883-94d2-ee99ff27434e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-344fecb6-545b-4150-b9a2-f180d5e46538 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "interface-7d843493-eda8-46a9-bb1b-3cc80eed7488-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.620s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG nova.compute.manager [req-ee0c8e90-cc86-4b9f-b935-f20e82c63d93 req-0d3e9fc2-423e-48b4-bd56-7aa78ca2bdc5 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received event network-vif-plugged-cc094456-8e0d-4269-b99b-5bfd5297a4f7 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ee0c8e90-cc86-4b9f-b935-f20e82c63d93 req-0d3e9fc2-423e-48b4-bd56-7aa78ca2bdc5 service nova] Acquiring lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ee0c8e90-cc86-4b9f-b935-f20e82c63d93 req-0d3e9fc2-423e-48b4-bd56-7aa78ca2bdc5 service nova] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ee0c8e90-cc86-4b9f-b935-f20e82c63d93 req-0d3e9fc2-423e-48b4-bd56-7aa78ca2bdc5 service nova] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG nova.compute.manager [req-ee0c8e90-cc86-4b9f-b935-f20e82c63d93 req-0d3e9fc2-423e-48b4-bd56-7aa78ca2bdc5 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] No waiting events found dispatching network-vif-plugged-cc094456-8e0d-4269-b99b-5bfd5297a4f7 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:00 user nova-compute[72849]: WARNING nova.compute.manager [req-ee0c8e90-cc86-4b9f-b935-f20e82c63d93 req-0d3e9fc2-423e-48b4-bd56-7aa78ca2bdc5 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received unexpected event network-vif-plugged-cc094456-8e0d-4269-b99b-5bfd5297a4f7 for instance with vm_state active and task_state None.
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Acquiring lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:00 user nova-compute[72849]: INFO nova.compute.manager [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Attaching volume f5c8896d-2002-4d25-8300-3baccb73538d to /dev/vdb
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "341edacc-b44b-4d92-9fcd-982c252fcdd6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:00 user nova-compute[72849]: INFO nova.compute.manager [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Detaching volume fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd
Aug 15 16:19:00 user nova-compute[72849]: DEBUG os_brick.utils [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b36c6a-e252-417f-81a4-ca3324092928]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f5ac1f-e515-4a78-a895-44728b413027]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade47280-63a3-45f6-b033-df905944765b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5ebce4-84cc-48db-be56-37e76fcd8674]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:19:00 user nova-compute[72849]: INFO nova.virt.block_device [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Attempting to driver detach volume fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd from mountpoint /dev/vdb
Aug 15 16:19:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:19:00 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:19:00 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ca2a7e-9336-4b02-a194-bf6f99ad17ad]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG os_brick.utils [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Updating existing volume attachment record: cdb932e7-9444-4344-997b-d8e2ad955794 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Attempting to detach device vdb from instance 341edacc-b44b-4d92-9fcd-982c252fcdd6 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:19:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:19:00 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:19:00 user nova-compute[72849]:   <source dev="/dev/sde"/>
Aug 15 16:19:00 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:19:00 user nova-compute[72849]:   <serial>fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd</serial>
Aug 15 16:19:00 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:19:00 user nova-compute[72849]: </disk>
Aug 15 16:19:00 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG nova.network.neutron [req-ef911d80-0202-4543-ad08-5f528554af8d req-4bd7f8b4-795f-44c0-b8da-7842b4466799 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Updated VIF entry in instance network info cache for port cc094456-8e0d-4269-b99b-5bfd5297a4f7. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG nova.network.neutron [req-ef911d80-0202-4543-ad08-5f528554af8d req-4bd7f8b4-795f-44c0-b8da-7842b4466799 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Updating instance_info_cache with network_info: [{"id": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "address": "fa:16:3e:7d:a6:b4", "network": {"id": "2d0a7c86-1e60-4ea6-93d7-c66b552d95e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1960989403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888d8da9-c8", "ovs_interfaceid": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "address": "fa:16:3e:ec:5a:1c", "network": {"id": "a62f6239-f231-4224-ac26-db5fbdedefe4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1068433324", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc094456-8e", "ovs_interfaceid": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:19:01 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Successfully detached device vdb from instance 341edacc-b44b-4d92-9fcd-982c252fcdd6 from the persistent domain config.
Aug 15 16:19:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 341edacc-b44b-4d92-9fcd-982c252fcdd6 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:19:01 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:19:01 user nova-compute[72849]:   <source dev="/dev/sde"/>
Aug 15 16:19:01 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:19:01 user nova-compute[72849]:   <serial>fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd</serial>
Aug 15 16:19:01 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:19:01 user nova-compute[72849]: </disk>
Aug 15 16:19:01 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ef911d80-0202-4543-ad08-5f528554af8d req-4bd7f8b4-795f-44c0-b8da-7842b4466799 service nova] Releasing lock "refresh_cache-7d843493-eda8-46a9-bb1b-3cc80eed7488" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG nova.network.neutron [req-5eeaf3cd-b856-46fd-ba6c-98cb118ee2af req-cd02e194-4e72-444d-979a-0ce6f6e6a4af service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Updated VIF entry in instance network info cache for port 9c27980b-1f4d-4a61-9648-9ed67abcb551. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG nova.network.neutron [req-5eeaf3cd-b856-46fd-ba6c-98cb118ee2af req-cd02e194-4e72-444d-979a-0ce6f6e6a4af service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Updating instance_info_cache with network_info: [{"id": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "address": "fa:16:3e:64:08:de", "network": {"id": "367bc2da-ca51-4fa8-a4f9-70a3344f28b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-621548180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8f1c82bdf46429a93a6dd2973b7f919", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c27980b-1f", "ovs_interfaceid": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5eeaf3cd-b856-46fd-ba6c-98cb118ee2af req-cd02e194-4e72-444d-979a-0ce6f6e6a4af service nova] Releasing lock "refresh_cache-5c64c95c-74b3-4883-94d2-ee99ff27434e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692116341.5406961, 341edacc-b44b-4d92-9fcd-982c252fcdd6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 341edacc-b44b-4d92-9fcd-982c252fcdd6 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:19:01 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Successfully detached device vdb from instance 341edacc-b44b-4d92-9fcd-982c252fcdd6 from the live domain config.
Aug 15 16:19:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMlEreNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:01 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7334d6e1-d4ba-4b93-b42d-15d40e229ca7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5ab86f-126b-4515-88d9-dd508f9934f9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:01 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:01 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:01 user nova-compute[72849]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd (non-flash)
Aug 15 16:19:01 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:01 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:01 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:01 user nova-compute[72849]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd (non-flash)
Aug 15 16:19:01 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc37819acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd'): ({'sde'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Removing single pathed devices sde {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed13fdf2-ebae-4b1d-9932-f77444b3bafa]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b5e319-fbe9-43b5-a2bf-8f89e36c034c]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Flushing IO for device /dev/sde {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2b61da-17e8-4286-91fb-9c2dd65a9268]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5355951-89b6-4583-8f72-fbdf790b25dc]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] SCSI volumes sde have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad1ed5e-1567-4ac1-8168-bf783317c1a2]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9098966-7dbe-4757-9777-568cd1a1c06a]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd, portal: 172.16.0.220,3260]
Aug 15 16:19:01 user nova-compute[72849]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd, portal: 172.16.0.220,3260] successful.
Aug 15 16:19:01 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbec8a82-7bf3-40fa-bed1-1999ecf4e4dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[611b815d-6c22-455b-b227-e7cc04ecfecd]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] <== disconnect_volume: return (349ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:19:02 user nova-compute[72849]: DEBUG nova.compute.manager [req-68c64c21-1d24-49c9-9160-01d97ffad952 req-fdb81742-1a34-4ed8-8f44-8d65fddf2814 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received event network-vif-plugged-cc094456-8e0d-4269-b99b-5bfd5297a4f7 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-68c64c21-1d24-49c9-9160-01d97ffad952 req-fdb81742-1a34-4ed8-8f44-8d65fddf2814 service nova] Acquiring lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-68c64c21-1d24-49c9-9160-01d97ffad952 req-fdb81742-1a34-4ed8-8f44-8d65fddf2814 service nova] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-68c64c21-1d24-49c9-9160-01d97ffad952 req-fdb81742-1a34-4ed8-8f44-8d65fddf2814 service nova] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:02 user nova-compute[72849]: DEBUG nova.compute.manager [req-68c64c21-1d24-49c9-9160-01d97ffad952 req-fdb81742-1a34-4ed8-8f44-8d65fddf2814 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] No waiting events found dispatching network-vif-plugged-cc094456-8e0d-4269-b99b-5bfd5297a4f7 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:02 user nova-compute[72849]: WARNING nova.compute.manager [req-68c64c21-1d24-49c9-9160-01d97ffad952 req-fdb81742-1a34-4ed8-8f44-8d65fddf2814 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received unexpected event network-vif-plugged-cc094456-8e0d-4269-b99b-5bfd5297a4f7 for instance with vm_state active and task_state None.
Aug 15 16:19:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXbkpQhg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:07 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:07 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:07 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e86e781-8601-4c54-b0d0-7d5a44c4cc56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:19:07 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1bfead-e7f9-4983-a508-faccc509aea0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1] added
Aug 15 16:19:07 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b17d89-ef8b-4538-85c3-5d518b43968e]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "7d843493-eda8-46a9-bb1b-3cc80eed7488" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG nova.objects.instance [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lazy-loading 'flavor' on Instance uuid 7d843493-eda8-46a9-bb1b-3cc80eed7488 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6b3aee-c06c-4fcd-bb9d-5e7380ffcc04]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXbkpQhg {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXbkpQhg" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a741ab7c-2e27-43e6-8476-15d35b3b3699]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rXbkpQhg'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dad5ddb-b171-4770-928b-e133e7c78748]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[87368b78-37ea-4cb4-9254-42514168d063]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:07 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:07 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:07 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:07 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:07 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:07 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ffec82-cffd-407b-a6f7-adcadb5d9868]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1, portal: 172.16.0.220,3260]
Aug 15 16:19:07 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1, portal: 172.16.0.220,3260] successful.
Aug 15 16:19:07 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[756abd40-d8ab-46bf-a80d-55c01d5e47ff]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef64c963-2d91-4990-ab01-692f1782f089]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:07 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:07 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:07 user nova-compute[72849]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 (non-flash)
Aug 15 16:19:07 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:07 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:07 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:07 user nova-compute[72849]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 (non-flash)
Aug 15 16:19:07 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce32fcd-997a-4318-bebb-435256565d00]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:19:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXbkpQhg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:19:08 user nova-compute[72849]: DEBUG nova.objects.instance [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lazy-loading 'flavor' on Instance uuid 341edacc-b44b-4d92-9fcd-982c252fcdd6 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d10d6e54-d865-495a-ad4c-a4b14fb72634 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.802s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "7d843493-eda8-46a9-bb1b-3cc80eed7488" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:08 user nova-compute[72849]: INFO nova.compute.manager [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Attaching volume 92b11d3f-77f6-492d-975b-629f39aa2e5d to /dev/vdb
Aug 15 16:19:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26138656638323764', 'path': '/dev/sde'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138656638323764', 'path': '/dev/sde'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:19:08 user nova-compute[72849]: DEBUG nova.objects.instance [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Lazy-loading 'flavor' on Instance uuid 3954da38-0292-40f7-8ace-6987d0248a44 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] attach device xml: <disk type="block" device="disk">
Aug 15 16:19:08 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:19:08 user nova-compute[72849]:   <source dev="/dev/sde"/>
Aug 15 16:19:08 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:19:08 user nova-compute[72849]:   <serial>d77b941f-ca2d-48d6-bd21-109489bf74a1</serial>
Aug 15 16:19:08 user nova-compute[72849]: </disk>
Aug 15 16:19:08 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:19:08 user nova-compute[72849]: DEBUG os_brick.utils [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b8d294-3728-4fe6-8eeb-aee4c0fce063]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4232dbbb-1514-4e1a-ad97-13de53196e44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa795c52-2d6e-4e9e-b044-60957d64db1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e7797f-71c1-4705-a481-712e703fb18c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:19:09 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:19:09 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dcaac4-f9a7-4a52-889d-272554b43d9b]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG os_brick.utils [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Updating existing volume attachment record: fb6e14bf-6a80-444e-935e-7d71c4abea1b {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] No VIF found with MAC fa:16:3e:be:cc:d8, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:19:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjhvnmYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:10 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:10 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:10 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f47fe76-1288-4178-a232-392df4ed281d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:19:10 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[370c3eed-2bc6-4fe2-96f0-3434399f305f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329] added
Aug 15 16:19:10 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.050s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9332cb92-2381-424c-a597-2d0764d743d4]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-72868a9c-30de-4045-af6c-06d0b730f0c4 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Lock "3954da38-0292-40f7-8ace-6987d0248a44" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.289s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.091s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1337353a-3b5b-4086-b328-bf830557fd9d]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pjhvnmYK {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pjhvnmYK" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b9d5f0-9f29-4515-91a6-8c45c862a55d]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pjhvnmYK'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[721e12d0-0e13-476b-b0f9-23b04045f7f3]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.066s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3951fc13-95fc-42aa-bdce-4ecc3b2b0d14]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:10 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:10 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:10 user nova-compute[72849]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 (non-flash)
Aug 15 16:19:10 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:10 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:10 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:10 user nova-compute[72849]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 (non-flash)
Aug 15 16:19:10 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[61af15f2-6bb0-4039-86df-6b76a2762730]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329, portal: 172.16.0.220,3260]
Aug 15 16:19:10 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329, portal: 172.16.0.220,3260] successful.
Aug 15 16:19:10 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbbb67e-6976-4b13-b27d-2472fd60f419]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8ae18c-6c76-464c-a032-a57a234ee503]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:10 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:10 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:10 user nova-compute[72849]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 (non-flash)
Aug 15 16:19:10 user nova-compute[72849]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 (non-flash)
Aug 15 16:19:10 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:10 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:10 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:10 user nova-compute[72849]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 (non-flash)
Aug 15 16:19:10 user nova-compute[72849]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 (non-flash)
Aug 15 16:19:10 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.624s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[440f25e3-d9d0-458f-810b-1faef5555d60]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:19:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjhvnmYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:19:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ae1b9a9e-8a85-44de-8e7e-04b9640c5295 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] volume_snapshot_create: create_info: {'snapshot_id': 'ab469d70-7336-473b-a73e-dd6775c4ecaf', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72849) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 15 16:19:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ae1b9a9e-8a85-44de-8e7e-04b9640c5295 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] snap xml: <domainsnapshot>
Aug 15 16:19:11 user nova-compute[72849]:   <disks>
Aug 15 16:19:11 user nova-compute[72849]:     <disk name="/dev/sde" snapshot="external" type="file">
Aug 15 16:19:11 user nova-compute[72849]:       <source file="/dev/new_file"/>
Aug 15 16:19:11 user nova-compute[72849]:     </disk>
Aug 15 16:19:11 user nova-compute[72849]:     <disk name="vda" snapshot="no"/>
Aug 15 16:19:11 user nova-compute[72849]:   </disks>
Aug 15 16:19:11 user nova-compute[72849]: </domainsnapshot>
Aug 15 16:19:11 user nova-compute[72849]:  {{(pid=72849) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 15 16:19:11 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ae1b9a9e-8a85-44de-8e7e-04b9640c5295 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Lazy-loading 'system_metadata' on Instance uuid 3954da38-0292-40f7-8ace-6987d0248a44 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:11 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-ae1b9a9e-8a85-44de-8e7e-04b9640c5295 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 16:19:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3197c47d-f325-45c1-98c0-14001d295bd0 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] volume_snapshot_delete: delete_info: {'volume_id': 'd77b941f-ca2d-48d6-bd21-109489bf74a1'} {{(pid=72849) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [None req-3197c47d-f325-45c1-98c0-14001d295bd0 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Traceback (most recent call last):
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     if delete_info['type'] != 'qcow2':
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44] KeyError: 'type'
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44] 
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [None req-ae1b9a9e-8a85-44de-8e7e-04b9640c5295 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Traceback (most recent call last):
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     rv = execute(f, *args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     six.reraise(c, e, tb)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     raise value
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     rv = meth(*args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44] 
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [None req-ae1b9a9e-8a85-44de-8e7e-04b9640c5295 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Traceback (most recent call last):
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     self._volume_snapshot_create(context, instance, guest,
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     rv = execute(f, *args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     six.reraise(c, e, tb)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     raise value
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     rv = meth(*args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [instance: 3954da38-0292-40f7-8ace-6987d0248a44] 
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [None req-3197c47d-f325-45c1-98c0-14001d295bd0 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver 
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver 
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-05260a7b-8f9d-4eb9-81a0-480f5adef105)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver 
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver 
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver 
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server [None req-3197c47d-f325-45c1-98c0-14001d295bd0 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Exception during message handling: KeyError: 'type'
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server 
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver [None req-ae1b9a9e-8a85-44de-8e7e-04b9640c5295 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot ab469d70-7336-473b-a73e-dd6775c4ecaf could not be found.
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     raise value
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver 
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver 
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot ab469d70-7336-473b-a73e-dd6775c4ecaf could not be found. (HTTP 404) (Request-ID: req-647eb1b1-b182-4968-9495-ce88fdee4538)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver 
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver 
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot ab469d70-7336-473b-a73e-dd6775c4ecaf could not be found.
Aug 15 16:19:11 user nova-compute[72849]: ERROR nova.virt.libvirt.driver 
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server [None req-ae1b9a9e-8a85-44de-8e7e-04b9640c5295 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     raise value
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 16:19:11 user nova-compute[72849]: ERROR oslo_messaging.rpc.server 
Aug 15 16:19:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Acquiring lock "3954da38-0292-40f7-8ace-6987d0248a44" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Lock "3954da38-0292-40f7-8ace-6987d0248a44" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:11 user nova-compute[72849]: INFO nova.compute.manager [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Detaching volume d77b941f-ca2d-48d6-bd21-109489bf74a1
Aug 15 16:19:11 user nova-compute[72849]: INFO nova.virt.block_device [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Attempting to driver detach volume d77b941f-ca2d-48d6-bd21-109489bf74a1 from mountpoint /dev/vdb
Aug 15 16:19:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Attempting to detach device vdb from instance 3954da38-0292-40f7-8ace-6987d0248a44 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:19:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] detach device xml: <disk type="block" device="disk">
Aug 15 16:19:11 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:19:11 user nova-compute[72849]:   <source dev="/dev/sde"/>
Aug 15 16:19:11 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:19:11 user nova-compute[72849]:   <serial>d77b941f-ca2d-48d6-bd21-109489bf74a1</serial>
Aug 15 16:19:11 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:19:11 user nova-compute[72849]: </disk>
Aug 15 16:19:11 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:19:11 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Successfully detached device vdb from instance 3954da38-0292-40f7-8ace-6987d0248a44 from the persistent domain config.
Aug 15 16:19:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3954da38-0292-40f7-8ace-6987d0248a44 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:19:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] detach device xml: <disk type="block" device="disk">
Aug 15 16:19:11 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:19:11 user nova-compute[72849]:   <source dev="/dev/sde"/>
Aug 15 16:19:11 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:19:11 user nova-compute[72849]:   <serial>d77b941f-ca2d-48d6-bd21-109489bf74a1</serial>
Aug 15 16:19:11 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:19:11 user nova-compute[72849]: </disk>
Aug 15 16:19:11 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:19:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.670s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] <== connect_volume: return (1672ms) {'type': 'block', 'scsi_wwn': '23162363534613832', 'path': '/dev/sdf'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162363534613832', 'path': '/dev/sdf'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:19:11 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lazy-loading 'flavor' on Instance uuid c47e8572-bf45-4f91-9ca7-2dbee7972113 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:19:11 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:19:11 user nova-compute[72849]:   <source dev="/dev/sdf"/>
Aug 15 16:19:11 user nova-compute[72849]:   <target dev="sdc" bus="scsi"/>
Aug 15 16:19:11 user nova-compute[72849]:   <serial>844a2e12-d1c2-4c98-89c3-88484fd0f329</serial>
Aug 15 16:19:11 user nova-compute[72849]:   <address type="drive" controller="0" unit="2"/>
Aug 15 16:19:11 user nova-compute[72849]: </disk>
Aug 15 16:19:11 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZkqEjfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:12 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:12 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:12 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2494225-1923-4fd6-9869-6f40feff30dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:19:12 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae78b34d-fbae-4b23-a613-e12fa298319e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d] added
Aug 15 16:19:12 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52f99bf-0904-4373-9858-ed67a3e55f7d]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[699edee9-360f-48eb-85cf-d82567a6a062]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GZkqEjfB {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GZkqEjfB" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed2fd9a-fb3a-4fa7-834d-fece8e242941]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GZkqEjfB'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e71b21-faad-4348-9e20-a06bf52169e7]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[167538c0-3ca7-49a4-9c7a-ec6bd1bfc95c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96fd951-8591-4acf-a070-692b2b5ccd88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d, portal: 172.16.0.220,3260]
Aug 15 16:19:12 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d, portal: 172.16.0.220,3260] successful.
Aug 15 16:19:12 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692116352.2857614, 3954da38-0292-40f7-8ace-6987d0248a44 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3954da38-0292-40f7-8ace-6987d0248a44 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:19:12 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Successfully detached device vdb from instance 3954da38-0292-40f7-8ace-6987d0248a44 from the live domain config.
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec46b5b-2d58-4e88-b7df-91a50d2601f1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXbkpQhg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:12 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e782e5a0-91fe-4c2d-86b5-86964a8f9d5b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:12 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 (non-flash)
Aug 15 16:19:12 user nova-compute[72849]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:12 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7e487a-8af9-434b-8724-6fd205782a28]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZkqEjfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] No BDM found with device name sda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] No VIF found with MAC fa:16:3e:10:4d:2c, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:19:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ec550e01-c0b0-4337-804d-b31c3ff3a055 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.770s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23330383838326663', 'path': '/dev/sdg'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330383838326663', 'path': '/dev/sdg'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.066s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG nova.objects.instance [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lazy-loading 'flavor' on Instance uuid 5c64c95c-74b3-4883-94d2-ee99ff27434e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2d2340-9d44-462a-838f-a892913d2ea3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:19:13 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:19:13 user nova-compute[72849]:   <source dev="/dev/sdg"/>
Aug 15 16:19:13 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:19:13 user nova-compute[72849]:   <serial>f5c8896d-2002-4d25-8300-3baccb73538d</serial>
Aug 15 16:19:13 user nova-compute[72849]: </disk>
Aug 15 16:19:13 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7c5bf2-8dc3-4492-b4b6-7705c07ad7fd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:13 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:13 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:13 user nova-compute[72849]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 (non-flash)
Aug 15 16:19:13 user nova-compute[72849]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 (non-flash)
Aug 15 16:19:13 user nova-compute[72849]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:13 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:13 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:13 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:13 user nova-compute[72849]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 (non-flash)
Aug 15 16:19:13 user nova-compute[72849]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 (non-flash)
Aug 15 16:19:13 user nova-compute[72849]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:13 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc35827df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1'): ({'sde'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Removing single pathed devices sde {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a8c2a1-db27-4714-8274-930eb1866522]: (4, ('path checker states:\nup                  4\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0334e8-bbf7-4aa8-a50b-6fbb5171590d]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Flushing IO for device /dev/sde {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac65dc33-34c4-4307-93c8-0fee79b269ff]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5beb5571-197d-41e0-ac7c-f1e5f298c9cd]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] SCSI volumes sde have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd5a088-63cf-4b2d-b8bd-e0239d6b0963]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[845992b5-0c12-4985-942b-ef4c4ed93425]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1, portal: 172.16.0.220,3260]
Aug 15 16:19:13 user nova-compute[72849]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1, portal: 172.16.0.220,3260] successful.
Aug 15 16:19:13 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b941f-ca2d-48d6-bd21-109489bf74a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[db44e5d0-0f88-4153-a4a1-44c3a69c94aa]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] <== disconnect_volume: return (1394ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] No VIF found with MAC fa:16:3e:64:08:de, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:19:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-60063794-a92c-4b0d-af80-6980c24c76f9 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.410s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Acquiring lock "c47e8572-bf45-4f91-9ca7-2dbee7972113" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:14 user nova-compute[72849]: INFO nova.compute.manager [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Detaching volume 844a2e12-d1c2-4c98-89c3-88484fd0f329
Aug 15 16:19:14 user nova-compute[72849]: INFO nova.virt.block_device [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Attempting to driver detach volume 844a2e12-d1c2-4c98-89c3-88484fd0f329 from mountpoint /dev/sdc
Aug 15 16:19:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Attempting to detach device sdc from instance c47e8572-bf45-4f91-9ca7-2dbee7972113 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:19:14 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:19:14 user nova-compute[72849]:   <source dev="/dev/sdf"/>
Aug 15 16:19:14 user nova-compute[72849]:   <target dev="sdc" bus="scsi"/>
Aug 15 16:19:14 user nova-compute[72849]:   <serial>844a2e12-d1c2-4c98-89c3-88484fd0f329</serial>
Aug 15 16:19:14 user nova-compute[72849]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 15 16:19:14 user nova-compute[72849]: </disk>
Aug 15 16:19:14 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:19:14 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Successfully detached device sdc from instance c47e8572-bf45-4f91-9ca7-2dbee7972113 from the persistent domain config.
Aug 15 16:19:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance c47e8572-bf45-4f91-9ca7-2dbee7972113 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:19:14 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:19:14 user nova-compute[72849]:   <source dev="/dev/sdf"/>
Aug 15 16:19:14 user nova-compute[72849]:   <target dev="sdc" bus="scsi"/>
Aug 15 16:19:14 user nova-compute[72849]:   <serial>844a2e12-d1c2-4c98-89c3-88484fd0f329</serial>
Aug 15 16:19:14 user nova-compute[72849]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 15 16:19:14 user nova-compute[72849]: </disk>
Aug 15 16:19:14 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG nova.objects.instance [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Lazy-loading 'flavor' on Instance uuid 3954da38-0292-40f7-8ace-6987d0248a44 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6ed4b8db-5101-4adb-ae13-58651a82afe9 tempest-VolumesAssistedSnapshotsTest-402520226 tempest-VolumesAssistedSnapshotsTest-402520226-project-admin] Lock "3954da38-0292-40f7-8ace-6987d0248a44" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.785s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Acquiring lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG os_brick.utils [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee207ee4-30e7-48af-83ef-59e99b4ebbf1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fb0da0-b325-4c35-9f1d-cb5de3568ae0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24c8eea-0297-4d02-b2a6-2259a74ebb55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97cff0a-5d13-4e82-ad41-2e362428fdde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692116354.83816, c47e8572-bf45-4f91-9ca7-2dbee7972113 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance c47e8572-bf45-4f91-9ca7-2dbee7972113 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:14 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Successfully detached device sdc from instance c47e8572-bf45-4f91-9ca7-2dbee7972113 from the live domain config.
Aug 15 16:19:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjhvnmYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:14 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:19:14 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf756e2f-9b8d-43a1-913c-4ccda95256d4]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG os_brick.utils [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89b33b1-d96d-40c8-9980-d7d97b9af4a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc39080e-1658-4370-a211-7002be54c8d0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:14 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:14 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:14 user nova-compute[72849]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 (non-flash)
Aug 15 16:19:14 user nova-compute[72849]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:14 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:14 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:14 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:14 user nova-compute[72849]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 (non-flash)
Aug 15 16:19:14 user nova-compute[72849]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:14 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3587a6560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329'): ({'sdf'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Removing single pathed devices sdf {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78022e7-51f4-4f8a-b160-fb313502c123]: (4, ('path checker states:\nup                  3\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3d6e89-0499-4235-9c24-95500fc157ac]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Flushing IO for device /dev/sdf {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:14 user nova-compute[72849]: INFO nova.compute.manager [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Swapping volume f5c8896d-2002-4d25-8300-3baccb73538d for 85d5ae6c-b97b-43e9-89b3-11c3b6a0e135
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be93ac4-1fa2-4786-9ff0-09c3f225ec04]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:19:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9140830-e3f4-495b-a305-34759ecec62e]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] SCSI volumes sdf have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c98935-3280-46ee-9af5-ba1ae6c6c039]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d65df20-6084-41af-a565-4c51b7406daf]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329, portal: 172.16.0.220,3260]
Aug 15 16:19:15 user nova-compute[72849]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329, portal: 172.16.0.220,3260] successful.
Aug 15 16:19:15 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:844a2e12-d1c2-4c98-89c3-88484fd0f329 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e59ffb-4bcc-4b3f-a9ba-d04c063f2a67]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] <== disconnect_volume: return (290ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG nova.objects.instance [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lazy-loading 'flavor' on Instance uuid c47e8572-bf45-4f91-9ca7-2dbee7972113 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-04cb7dcd-a48d-4a6c-8e94-97bcd7f3e522 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.578s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Acquiring lock "c47e8572-bf45-4f91-9ca7-2dbee7972113" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Acquiring lock "c47e8572-bf45-4f91-9ca7-2dbee7972113-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:16 user nova-compute[72849]: INFO nova.compute.manager [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Terminating instance
Aug 15 16:19:16 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:19:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-fc1050b7-3cdf-4a20-9c49-dd6c226f5559 req-a2af55c2-4f8c-4a3c-ae6c-840d44427ac1 service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Received event network-vif-unplugged-4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fc1050b7-3cdf-4a20-9c49-dd6c226f5559 req-a2af55c2-4f8c-4a3c-ae6c-840d44427ac1 service nova] Acquiring lock "c47e8572-bf45-4f91-9ca7-2dbee7972113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fc1050b7-3cdf-4a20-9c49-dd6c226f5559 req-a2af55c2-4f8c-4a3c-ae6c-840d44427ac1 service nova] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fc1050b7-3cdf-4a20-9c49-dd6c226f5559 req-a2af55c2-4f8c-4a3c-ae6c-840d44427ac1 service nova] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-fc1050b7-3cdf-4a20-9c49-dd6c226f5559 req-a2af55c2-4f8c-4a3c-ae6c-840d44427ac1 service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] No waiting events found dispatching network-vif-unplugged-4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-fc1050b7-3cdf-4a20-9c49-dd6c226f5559 req-a2af55c2-4f8c-4a3c-ae6c-840d44427ac1 service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Received event network-vif-unplugged-4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:19:17 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Instance destroyed successfully.
Aug 15 16:19:17 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lazy-loading 'resources' on Instance uuid c47e8572-bf45-4f91-9ca7-2dbee7972113 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1204643519',display_name='tempest-AttachSCSIVolumeTestJSON-server-1204643519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1204643519',id=6,image_ref='75000139-9517-47c6-8da4-a7356e8a0e71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7nC9mdVdXDpufcb5elFqWYO79JYEWAuMaKMurScp2UeDSh5MEDjA0U14425I+qO1C/M3mvK0NhWw+i0jh3IBdG2j92gPQ4SS2/oIotm/TY4AMZsjX84SQYoP1oXgc7Zw==',key_name='tempest-keypair-7359329',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:17:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc588100f2fa46a0b57d24b0708a625e',ramdisk_id='',reservation_id='r-wd27upr3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='75000139-9517-47c6-8da4-a7356e8a0e71',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1692749068',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1692749068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:17:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f60d32b341f4e3c9add19af0d2a4e5f',uuid=c47e8572-bf45-4f91-9ca7-2dbee7972113,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "address": "fa:16:3e:10:4d:2c", "network": {"id": "a6cd3415-3bb0-4caf-85a3-e9090d778c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531227145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc588100f2fa46a0b57d24b0708a625e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7fb39b-6b", "ovs_interfaceid": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:19:17 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Converting VIF {"id": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "address": "fa:16:3e:10:4d:2c", "network": {"id": "a6cd3415-3bb0-4caf-85a3-e9090d778c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531227145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc588100f2fa46a0b57d24b0708a625e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e7fb39b-6b", "ovs_interfaceid": "4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:19:17 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:4d:2c,bridge_name='br-int',has_traffic_filtering=True,id=4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e,network=Network(a6cd3415-3bb0-4caf-85a3-e9090d778c17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7fb39b-6b') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:19:17 user nova-compute[72849]: DEBUG os_vif [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:4d:2c,bridge_name='br-int',has_traffic_filtering=True,id=4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e,network=Network(a6cd3415-3bb0-4caf-85a3-e9090d778c17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7fb39b-6b') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:19:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e7fb39b-6b, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:19:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:17 user nova-compute[72849]: INFO os_vif [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:4d:2c,bridge_name='br-int',has_traffic_filtering=True,id=4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e,network=Network(a6cd3415-3bb0-4caf-85a3-e9090d778c17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e7fb39b-6b')
Aug 15 16:19:17 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Deleting instance files /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113_del
Aug 15 16:19:17 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Deletion of /opt/stack/data/nova/instances/c47e8572-bf45-4f91-9ca7-2dbee7972113_del complete
Aug 15 16:19:17 user nova-compute[72849]: INFO nova.compute.manager [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 16:19:17 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:19:17 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:19:17 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:19:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:18 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:19:18 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Took 1.12 seconds to deallocate network for instance.
Aug 15 16:19:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-6645cc6d-6fb7-4392-92b1-1a9733268886 req-f3646bc5-41ff-4371-bd75-5a3b7106c6a6 service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Received event network-vif-deleted-4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:18 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:19:18 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:19:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:18 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Deleted allocations for instance c47e8572-bf45-4f91-9ca7-2dbee7972113
Aug 15 16:19:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7bc2e446-07bb-4ba3-8f4d-8349c1db4ae0 tempest-AttachSCSIVolumeTestJSON-1692749068 tempest-AttachSCSIVolumeTestJSON-1692749068-project-member] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.573s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-c07a740b-f4ea-4c91-96d3-27df33def851 req-d7a3e566-2d1d-460e-a6fc-048e05974a61 service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Received event network-vif-plugged-4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c07a740b-f4ea-4c91-96d3-27df33def851 req-d7a3e566-2d1d-460e-a6fc-048e05974a61 service nova] Acquiring lock "c47e8572-bf45-4f91-9ca7-2dbee7972113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c07a740b-f4ea-4c91-96d3-27df33def851 req-d7a3e566-2d1d-460e-a6fc-048e05974a61 service nova] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c07a740b-f4ea-4c91-96d3-27df33def851 req-d7a3e566-2d1d-460e-a6fc-048e05974a61 service nova] Lock "c47e8572-bf45-4f91-9ca7-2dbee7972113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-c07a740b-f4ea-4c91-96d3-27df33def851 req-d7a3e566-2d1d-460e-a6fc-048e05974a61 service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] No waiting events found dispatching network-vif-plugged-4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:19 user nova-compute[72849]: WARNING nova.compute.manager [req-c07a740b-f4ea-4c91-96d3-27df33def851 req-d7a3e566-2d1d-460e-a6fc-048e05974a61 service nova] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Received unexpected event network-vif-plugged-4e7fb39b-6b39-4a33-8bc6-1ecfebdf446e for instance with vm_state deleted and task_state None.
Aug 15 16:19:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amBMyTGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:19 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:19 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:19 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[35efa47a-1456-47ba-a76b-45ccb3726a7c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:19:19 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb8773f-59a3-48f7-904c-ede8fae92bc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d] added
Aug 15 16:19:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff47fb27-3808-4aa2-a68d-8412e8095a84]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8ea52a-9c4b-465f-bea6-7239411d8703]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v amBMyTGX {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v amBMyTGX" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[753a6ebb-0a78-4365-be40-d200be3b9b96]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'amBMyTGX'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[edda75d0-fe26-4d8e-92e6-efa20f07d4a7]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3611eaac-b104-4064-ba41-9950c624ad37]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:19 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:19 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:19 user nova-compute[72849]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:19 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:19 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:19 user nova-compute[72849]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82d8bdc-9bf3-4d14-b9da-93ceb756c51e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d, portal: 172.16.0.220,3260]
Aug 15 16:19:19 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d, portal: 172.16.0.220,3260] successful.
Aug 15 16:19:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f73f4d-aada-4d31-b551-11aa14fa833d]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[43774734-6996-4e9a-adc9-dbd5025cd634]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:19 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:19 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:19 user nova-compute[72849]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:19 user nova-compute[72849]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d (non-flash)
Aug 15 16:19:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:19 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:19 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:19 user nova-compute[72849]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:19 user nova-compute[72849]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d (non-flash)
Aug 15 16:19:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] HCTL ('36', '-', '-', 0) found on session 9 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b415833e-cbc0-4db9-83a3-a130ba75f446]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Searching for a device in session 9 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:19:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amBMyTGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:19:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23438653364306430', 'path': '/dev/sde'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438653364306430', 'path': '/dev/sde'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:19:20 user nova-compute[72849]: DEBUG nova.objects.instance [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lazy-loading 'flavor' on Instance uuid 7d843493-eda8-46a9-bb1b-3cc80eed7488 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:19:20 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:19:20 user nova-compute[72849]:   <source dev="/dev/sde"/>
Aug 15 16:19:20 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:19:20 user nova-compute[72849]:   <serial>92b11d3f-77f6-492d-975b-629f39aa2e5d</serial>
Aug 15 16:19:20 user nova-compute[72849]: </disk>
Aug 15 16:19:20 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:19:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:19:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] No BDM found with device name hda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:19:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] No VIF found with MAC fa:16:3e:7d:a6:b4, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:19:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6dfe9479-47fd-44bf-9f96-42747a9ed103 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.633s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "7d843493-eda8-46a9-bb1b-3cc80eed7488" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:22 user nova-compute[72849]: INFO nova.compute.manager [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Detaching volume 92b11d3f-77f6-492d-975b-629f39aa2e5d
Aug 15 16:19:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:22 user nova-compute[72849]: INFO nova.virt.block_device [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Attempting to driver detach volume 92b11d3f-77f6-492d-975b-629f39aa2e5d from mountpoint /dev/vdb
Aug 15 16:19:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Attempting to detach device vdb from instance 7d843493-eda8-46a9-bb1b-3cc80eed7488 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:19:22 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:19:22 user nova-compute[72849]:   <source dev="/dev/sde"/>
Aug 15 16:19:22 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:19:22 user nova-compute[72849]:   <serial>92b11d3f-77f6-492d-975b-629f39aa2e5d</serial>
Aug 15 16:19:22 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 16:19:22 user nova-compute[72849]: </disk>
Aug 15 16:19:22 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:19:22 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Successfully detached device vdb from instance 7d843493-eda8-46a9-bb1b-3cc80eed7488 from the persistent domain config.
Aug 15 16:19:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7d843493-eda8-46a9-bb1b-3cc80eed7488 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:19:22 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:19:22 user nova-compute[72849]:   <source dev="/dev/sde"/>
Aug 15 16:19:22 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:19:22 user nova-compute[72849]:   <serial>92b11d3f-77f6-492d-975b-629f39aa2e5d</serial>
Aug 15 16:19:22 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 16:19:22 user nova-compute[72849]: </disk>
Aug 15 16:19:22 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692116362.633641, 7d843493-eda8-46a9-bb1b-3cc80eed7488 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7d843493-eda8-46a9-bb1b-3cc80eed7488 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:19:22 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Successfully detached device vdb from instance 7d843493-eda8-46a9-bb1b-3cc80eed7488 from the live domain config.
Aug 15 16:19:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amBMyTGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:22 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e12ccb-4c33-4d6d-81e7-cc6551c8725e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[543923f1-10bb-42a3-a1c1-89f064161715]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:22 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:22 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:22 user nova-compute[72849]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:22 user nova-compute[72849]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d (non-flash)
Aug 15 16:19:22 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:22 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:22 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:22 user nova-compute[72849]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:22 user nova-compute[72849]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d (non-flash)
Aug 15 16:19:22 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3780b85e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d'): ({'sde'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Removing single pathed devices sde {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7fe03c-9936-41fa-a18c-c4e886407bfb]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[133b76b7-4d1b-4044-b226-bfa1affa5089]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Flushing IO for device /dev/sde {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[268266aa-3615-455e-bf84-b28cf5a062f9]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa1912d-7ec0-462f-b7e6-81f32f77d5f3]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] SCSI volumes sde have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[01605d90-4f44-4672-98da-4b49b8e581bd]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5494e711-fc01-4935-872c-8f59d55e6a48]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d, portal: 172.16.0.220,3260]
Aug 15 16:19:22 user nova-compute[72849]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d, portal: 172.16.0.220,3260] successful.
Aug 15 16:19:22 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b11d3f-77f6-492d-975b-629f39aa2e5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d4284c-9e91-4724-9cac-76cd60a229af]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] <== disconnect_volume: return (277ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:19:23 user nova-compute[72849]: DEBUG nova.objects.instance [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lazy-loading 'flavor' on Instance uuid 7d843493-eda8-46a9-bb1b-3cc80eed7488 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0779de6c-989b-4b01-a3d7-19d032393ee7 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.657s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "interface-7d843493-eda8-46a9-bb1b-3cc80eed7488-cc094456-8e0d-4269-b99b-5bfd5297a4f7" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "interface-7d843493-eda8-46a9-bb1b-3cc80eed7488-cc094456-8e0d-4269-b99b-5bfd5297a4f7" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.objects.instance [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lazy-loading 'flavor' on Instance uuid 7d843493-eda8-46a9-bb1b-3cc80eed7488 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-215597638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-215597638',id=7,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdbWakgm9rkhjBkOdQBASg9y5tRST/eN38nlLPxQcgrQZwoqRDKC9b5dSss1Yo4J4gifxLRY6ThnnWU08v57v9/fZXdXuUr1hxB2yLXnfesqIyRH5q7Iz1U8TLWUXIMbw==',key_name='tempest-keypair-627680743',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:17:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de78e6bddce4402d9829b94e9bd6cf05',ramdisk_id='',reservation_id='r-aag6oo7v',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-415257394',owner_user_name='tempest-TaggedAttachmentsTest-415257394-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:17:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a442003f0164870905327b6b5f1a0b2',uuid=7d843493-eda8-46a9-bb1b-3cc80eed7488,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "address": "fa:16:3e:ec:5a:1c", "network": {"id": "a62f6239-f231-4224-ac26-db5fbdedefe4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1068433324", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc094456-8e", "ovs_interfaceid": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Converting VIF {"id": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "address": "fa:16:3e:ec:5a:1c", "network": {"id": "a62f6239-f231-4224-ac26-db5fbdedefe4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1068433324", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc094456-8e", "ovs_interfaceid": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:5a:1c,bridge_name='br-int',has_traffic_filtering=True,id=cc094456-8e0d-4269-b99b-5bfd5297a4f7,network=Network(a62f6239-f231-4224-ac26-db5fbdedefe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc094456-8e') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ec:5a:1c"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc094456-8e"/></interface> {{(pid=72849) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ec:5a:1c"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc094456-8e"/></interface> {{(pid=72849) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Attempting to detach device tapcc094456-8e from instance 7d843493-eda8-46a9-bb1b-3cc80eed7488 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] detach device xml: <interface type="ethernet">
Aug 15 16:19:24 user nova-compute[72849]:   <mac address="fa:16:3e:ec:5a:1c"/>
Aug 15 16:19:24 user nova-compute[72849]:   <model type="virtio"/>
Aug 15 16:19:24 user nova-compute[72849]:   <mtu size="1442"/>
Aug 15 16:19:24 user nova-compute[72849]:   <target dev="tapcc094456-8e"/>
Aug 15 16:19:24 user nova-compute[72849]: </interface>
Aug 15 16:19:24 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ec:5a:1c"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc094456-8e"/></interface> {{(pid=72849) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ec:5a:1c"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc094456-8e"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 15 16:19:24 user nova-compute[72849]:   <name>instance-00000007</name>
Aug 15 16:19:24 user nova-compute[72849]:   <uuid>7d843493-eda8-46a9-bb1b-3cc80eed7488</uuid>
Aug 15 16:19:24 user nova-compute[72849]:   <metadata>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:19:24 user nova-compute[72849]:   <nova:package version="0.0.0"/>
Aug 15 16:19:24 user nova-compute[72849]:   <nova:name>tempest-device-tagging-server-215597638</nova:name>
Aug 15 16:19:24 user nova-compute[72849]:   <nova:creationTime>2023-08-15 16:19:00</nova:creationTime>
Aug 15 16:19:24 user nova-compute[72849]:   <nova:flavor name="m1.tiny">
Aug 15 16:19:24 user nova-compute[72849]:     <nova:memory>512</nova:memory>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:disk>1</nova:disk>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:swap>0</nova:swap>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:vcpus>1</nova:vcpus>
Aug 15 16:19:24 user nova-compute[72849]:   </nova:flavor>
Aug 15 16:19:24 user nova-compute[72849]:   <nova:owner>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:user uuid="9a442003f0164870905327b6b5f1a0b2">tempest-TaggedAttachmentsTest-415257394-project-member</nova:user>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:project uuid="de78e6bddce4402d9829b94e9bd6cf05">tempest-TaggedAttachmentsTest-415257394</nova:project>
Aug 15 16:19:24 user nova-compute[72849]:   </nova:owner>
Aug 15 16:19:24 user nova-compute[72849]:   <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:19:24 user nova-compute[72849]:   <nova:ports>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:port uuid="888d8da9-c8a5-40fd-a421-1a8ec1890f25">
Aug 15 16:19:24 user nova-compute[72849]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:19:24 user nova-compute[72849]:     </nova:port>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:port uuid="cc094456-8e0d-4269-b99b-5bfd5297a4f7">
Aug 15 16:19:24 user nova-compute[72849]:       <nova:ip type="fixed" address="10.10.10.32" ipVersion="4"/>
Aug 15 16:19:24 user nova-compute[72849]:     </nova:port>
Aug 15 16:19:24 user nova-compute[72849]:   </nova:ports>
Aug 15 16:19:24 user nova-compute[72849]: </nova:instance>
Aug 15 16:19:24 user nova-compute[72849]:   </metadata>
Aug 15 16:19:24 user nova-compute[72849]:   <memory unit='KiB'>524288</memory>
Aug 15 16:19:24 user nova-compute[72849]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 16:19:24 user nova-compute[72849]:   <vcpu placement='static'>1</vcpu>
Aug 15 16:19:24 user nova-compute[72849]:   <resource>
Aug 15 16:19:24 user nova-compute[72849]:     <partition>/machine</partition>
Aug 15 16:19:24 user nova-compute[72849]:   </resource>
Aug 15 16:19:24 user nova-compute[72849]:   <sysinfo type='smbios'>
Aug 15 16:19:24 user nova-compute[72849]:     <system>
Aug 15 16:19:24 user nova-compute[72849]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 16:19:24 user nova-compute[72849]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 16:19:24 user nova-compute[72849]:       <entry name='version'>0.0.0</entry>
Aug 15 16:19:24 user nova-compute[72849]:       <entry name='serial'>7d843493-eda8-46a9-bb1b-3cc80eed7488</entry>
Aug 15 16:19:24 user nova-compute[72849]:       <entry name='uuid'>7d843493-eda8-46a9-bb1b-3cc80eed7488</entry>
Aug 15 16:19:24 user nova-compute[72849]:       <entry name='family'>Virtual Machine</entry>
Aug 15 16:19:24 user nova-compute[72849]:     </system>
Aug 15 16:19:24 user nova-compute[72849]:   </sysinfo>
Aug 15 16:19:24 user nova-compute[72849]:   <os>
Aug 15 16:19:24 user nova-compute[72849]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 16:19:24 user nova-compute[72849]:     <boot dev='hd'/>
Aug 15 16:19:24 user nova-compute[72849]:     <smbios mode='sysinfo'/>
Aug 15 16:19:24 user nova-compute[72849]:   </os>
Aug 15 16:19:24 user nova-compute[72849]:   <features>
Aug 15 16:19:24 user nova-compute[72849]:     <acpi/>
Aug 15 16:19:24 user nova-compute[72849]:     <apic/>
Aug 15 16:19:24 user nova-compute[72849]:     <vmcoreinfo state='on'/>
Aug 15 16:19:24 user nova-compute[72849]:   </features>
Aug 15 16:19:24 user nova-compute[72849]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 16:19:24 user nova-compute[72849]:     <model fallback='forbid'>Nehalem</model>
Aug 15 16:19:24 user nova-compute[72849]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 16:19:24 user nova-compute[72849]:     <feature policy='require' name='vme'/>
Aug 15 16:19:24 user nova-compute[72849]:     <feature policy='require' name='x2apic'/>
Aug 15 16:19:24 user nova-compute[72849]:     <feature policy='require' name='hypervisor'/>
Aug 15 16:19:24 user nova-compute[72849]:   </cpu>
Aug 15 16:19:24 user nova-compute[72849]:   <clock offset='utc'>
Aug 15 16:19:24 user nova-compute[72849]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 16:19:24 user nova-compute[72849]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 16:19:24 user nova-compute[72849]:     <timer name='hpet' present='no'/>
Aug 15 16:19:24 user nova-compute[72849]:   </clock>
Aug 15 16:19:24 user nova-compute[72849]:   <on_poweroff>destroy</on_poweroff>
Aug 15 16:19:24 user nova-compute[72849]:   <on_reboot>restart</on_reboot>
Aug 15 16:19:24 user nova-compute[72849]:   <on_crash>destroy</on_crash>
Aug 15 16:19:24 user nova-compute[72849]:   <devices>
Aug 15 16:19:24 user nova-compute[72849]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 16:19:24 user nova-compute[72849]:     <disk type='file' device='disk'>
Aug 15 16:19:24 user nova-compute[72849]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 16:19:24 user nova-compute[72849]:       <source file='/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk' index='2'/>
Aug 15 16:19:24 user nova-compute[72849]:       <backingStore type='file' index='3'>
Aug 15 16:19:24 user nova-compute[72849]:         <format type='raw'/>
Aug 15 16:19:24 user nova-compute[72849]:         <source file='/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374'/>
Aug 15 16:19:24 user nova-compute[72849]:         <backingStore/>
Aug 15 16:19:24 user nova-compute[72849]:       </backingStore>
Aug 15 16:19:24 user nova-compute[72849]:       <target dev='vda' bus='virtio'/>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='virtio-disk0'/>
Aug 15 16:19:24 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </disk>
Aug 15 16:19:24 user nova-compute[72849]:     <disk type='file' device='cdrom'>
Aug 15 16:19:24 user nova-compute[72849]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 16:19:24 user nova-compute[72849]:       <source file='/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk.config' index='1'/>
Aug 15 16:19:24 user nova-compute[72849]:       <backingStore/>
Aug 15 16:19:24 user nova-compute[72849]:       <target dev='hda' bus='ide'/>
Aug 15 16:19:24 user nova-compute[72849]:       <readonly/>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='ide0-0-0'/>
Aug 15 16:19:24 user nova-compute[72849]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </disk>
Aug 15 16:19:24 user nova-compute[72849]:     <controller type='usb' index='0' model='none'>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='usb'/>
Aug 15 16:19:24 user nova-compute[72849]:     </controller>
Aug 15 16:19:24 user nova-compute[72849]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='pci.0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </controller>
Aug 15 16:19:24 user nova-compute[72849]:     <controller type='ide' index='0'>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='ide'/>
Aug 15 16:19:24 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 16:19:24 user nova-compute[72849]:     </controller>
Aug 15 16:19:24 user nova-compute[72849]:     <interface type='ethernet'>
Aug 15 16:19:24 user nova-compute[72849]:       <mac address='fa:16:3e:7d:a6:b4'/>
Aug 15 16:19:24 user nova-compute[72849]:       <target dev='tap888d8da9-c8'/>
Aug 15 16:19:24 user nova-compute[72849]:       <model type='virtio'/>
Aug 15 16:19:24 user nova-compute[72849]:       <mtu size='1442'/>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='net0'/>
Aug 15 16:19:24 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </interface>
Aug 15 16:19:24 user nova-compute[72849]:     <interface type='ethernet'>
Aug 15 16:19:24 user nova-compute[72849]:       <mac address='fa:16:3e:ec:5a:1c'/>
Aug 15 16:19:24 user nova-compute[72849]:       <target dev='tapcc094456-8e'/>
Aug 15 16:19:24 user nova-compute[72849]:       <model type='virtio'/>
Aug 15 16:19:24 user nova-compute[72849]:       <mtu size='1442'/>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='net1'/>
Aug 15 16:19:24 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </interface>
Aug 15 16:19:24 user nova-compute[72849]:     <serial type='pty'>
Aug 15 16:19:24 user nova-compute[72849]:       <source path='/dev/pts/7'/>
Aug 15 16:19:24 user nova-compute[72849]:       <log file='/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/console.log' append='off'/>
Aug 15 16:19:24 user nova-compute[72849]:       <target type='isa-serial' port='0'>
Aug 15 16:19:24 user nova-compute[72849]:         <model name='isa-serial'/>
Aug 15 16:19:24 user nova-compute[72849]:       </target>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='serial0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </serial>
Aug 15 16:19:24 user nova-compute[72849]:     <console type='pty' tty='/dev/pts/7'>
Aug 15 16:19:24 user nova-compute[72849]:       <source path='/dev/pts/7'/>
Aug 15 16:19:24 user nova-compute[72849]:       <log file='/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/console.log' append='off'/>
Aug 15 16:19:24 user nova-compute[72849]:       <target type='serial' port='0'/>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='serial0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </console>
Aug 15 16:19:24 user nova-compute[72849]:     <input type='mouse' bus='ps2'>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='input0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </input>
Aug 15 16:19:24 user nova-compute[72849]:     <input type='keyboard' bus='ps2'>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='input1'/>
Aug 15 16:19:24 user nova-compute[72849]:     </input>
Aug 15 16:19:24 user nova-compute[72849]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 15 16:19:24 user nova-compute[72849]:       <listen type='address' address='0.0.0.0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </graphics>
Aug 15 16:19:24 user nova-compute[72849]:     <audio id='1' type='none'/>
Aug 15 16:19:24 user nova-compute[72849]:     <video>
Aug 15 16:19:24 user nova-compute[72849]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='video0'/>
Aug 15 16:19:24 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </video>
Aug 15 16:19:24 user nova-compute[72849]:     <memballoon model='virtio'>
Aug 15 16:19:24 user nova-compute[72849]:       <stats period='10'/>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='balloon0'/>
Aug 15 16:19:24 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </memballoon>
Aug 15 16:19:24 user nova-compute[72849]:     <rng model='virtio'>
Aug 15 16:19:24 user nova-compute[72849]:       <backend model='random'>/dev/urandom</backend>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='rng0'/>
Aug 15 16:19:24 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </rng>
Aug 15 16:19:24 user nova-compute[72849]:   </devices>
Aug 15 16:19:24 user nova-compute[72849]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 16:19:24 user nova-compute[72849]:     <label>libvirt-7d843493-eda8-46a9-bb1b-3cc80eed7488</label>
Aug 15 16:19:24 user nova-compute[72849]:     <imagelabel>libvirt-7d843493-eda8-46a9-bb1b-3cc80eed7488</imagelabel>
Aug 15 16:19:24 user nova-compute[72849]:   </seclabel>
Aug 15 16:19:24 user nova-compute[72849]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 16:19:24 user nova-compute[72849]:     <label>+64055:+108</label>
Aug 15 16:19:24 user nova-compute[72849]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 16:19:24 user nova-compute[72849]:   </seclabel>
Aug 15 16:19:24 user nova-compute[72849]: </domain>
Aug 15 16:19:24 user nova-compute[72849]:  {{(pid=72849) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 16:19:24 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Successfully detached device tapcc094456-8e from instance 7d843493-eda8-46a9-bb1b-3cc80eed7488 from the persistent domain config.
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] (1/8): Attempting to detach device tapcc094456-8e with device alias net1 from instance 7d843493-eda8-46a9-bb1b-3cc80eed7488 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] detach device xml: <interface type="ethernet">
Aug 15 16:19:24 user nova-compute[72849]:   <mac address="fa:16:3e:ec:5a:1c"/>
Aug 15 16:19:24 user nova-compute[72849]:   <model type="virtio"/>
Aug 15 16:19:24 user nova-compute[72849]:   <mtu size="1442"/>
Aug 15 16:19:24 user nova-compute[72849]:   <target dev="tapcc094456-8e"/>
Aug 15 16:19:24 user nova-compute[72849]: </interface>
Aug 15 16:19:24 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJwpUeoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5c64c95c-74b3-4883-94d2-ee99ff27434e', 'attached_at': '', 'detached_at': '', 'volume_id': '85d5ae6c-b97b-43e9-89b3-11c3b6a0e135', 'serial': '85d5ae6c-b97b-43e9-89b3-11c3b6a0e135'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZkqEjfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '5c64c95c-74b3-4883-94d2-ee99ff27434e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5c8896d-2002-4d25-8300-3baccb73538d', 'serial'} {{(pid=72849) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJwpUeoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:24 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:24 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:24 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[876b0916-10bb-46fe-bb95-e3258a4185f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:19:24 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692116364.709301, 7d843493-eda8-46a9-bb1b-3cc80eed7488 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Start waiting for the detach event from libvirt for device tapcc094456-8e with device alias net1 for instance 7d843493-eda8-46a9-bb1b-3cc80eed7488 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ec:5a:1c"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc094456-8e"/></interface> {{(pid=72849) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b17fff-40e7-4fd9-bba9-90cae6412a25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135] added
Aug 15 16:19:24 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ec:5a:1c"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc094456-8e"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 15 16:19:24 user nova-compute[72849]:   <name>instance-00000007</name>
Aug 15 16:19:24 user nova-compute[72849]:   <uuid>7d843493-eda8-46a9-bb1b-3cc80eed7488</uuid>
Aug 15 16:19:24 user nova-compute[72849]:   <metadata>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:19:24 user nova-compute[72849]:   <nova:package version="0.0.0"/>
Aug 15 16:19:24 user nova-compute[72849]:   <nova:name>tempest-device-tagging-server-215597638</nova:name>
Aug 15 16:19:24 user nova-compute[72849]:   <nova:creationTime>2023-08-15 16:19:00</nova:creationTime>
Aug 15 16:19:24 user nova-compute[72849]:   <nova:flavor name="m1.tiny">
Aug 15 16:19:24 user nova-compute[72849]:     <nova:memory>512</nova:memory>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:disk>1</nova:disk>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:swap>0</nova:swap>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:vcpus>1</nova:vcpus>
Aug 15 16:19:24 user nova-compute[72849]:   </nova:flavor>
Aug 15 16:19:24 user nova-compute[72849]:   <nova:owner>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:user uuid="9a442003f0164870905327b6b5f1a0b2">tempest-TaggedAttachmentsTest-415257394-project-member</nova:user>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:project uuid="de78e6bddce4402d9829b94e9bd6cf05">tempest-TaggedAttachmentsTest-415257394</nova:project>
Aug 15 16:19:24 user nova-compute[72849]:   </nova:owner>
Aug 15 16:19:24 user nova-compute[72849]:   <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:19:24 user nova-compute[72849]:   <nova:ports>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:port uuid="888d8da9-c8a5-40fd-a421-1a8ec1890f25">
Aug 15 16:19:24 user nova-compute[72849]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:19:24 user nova-compute[72849]:     </nova:port>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:port uuid="cc094456-8e0d-4269-b99b-5bfd5297a4f7">
Aug 15 16:19:24 user nova-compute[72849]:       <nova:ip type="fixed" address="10.10.10.32" ipVersion="4"/>
Aug 15 16:19:24 user nova-compute[72849]:     </nova:port>
Aug 15 16:19:24 user nova-compute[72849]:   </nova:ports>
Aug 15 16:19:24 user nova-compute[72849]: </nova:instance>
Aug 15 16:19:24 user nova-compute[72849]:   </metadata>
Aug 15 16:19:24 user nova-compute[72849]:   <memory unit='KiB'>524288</memory>
Aug 15 16:19:24 user nova-compute[72849]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 16:19:24 user nova-compute[72849]:   <vcpu placement='static'>1</vcpu>
Aug 15 16:19:24 user nova-compute[72849]:   <resource>
Aug 15 16:19:24 user nova-compute[72849]:     <partition>/machine</partition>
Aug 15 16:19:24 user nova-compute[72849]:   </resource>
Aug 15 16:19:24 user nova-compute[72849]:   <sysinfo type='smbios'>
Aug 15 16:19:24 user nova-compute[72849]:     <system>
Aug 15 16:19:24 user nova-compute[72849]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 16:19:24 user nova-compute[72849]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 16:19:24 user nova-compute[72849]:       <entry name='version'>0.0.0</entry>
Aug 15 16:19:24 user nova-compute[72849]:       <entry name='serial'>7d843493-eda8-46a9-bb1b-3cc80eed7488</entry>
Aug 15 16:19:24 user nova-compute[72849]:       <entry name='uuid'>7d843493-eda8-46a9-bb1b-3cc80eed7488</entry>
Aug 15 16:19:24 user nova-compute[72849]:       <entry name='family'>Virtual Machine</entry>
Aug 15 16:19:24 user nova-compute[72849]:     </system>
Aug 15 16:19:24 user nova-compute[72849]:   </sysinfo>
Aug 15 16:19:24 user nova-compute[72849]:   <os>
Aug 15 16:19:24 user nova-compute[72849]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 16:19:24 user nova-compute[72849]:     <boot dev='hd'/>
Aug 15 16:19:24 user nova-compute[72849]:     <smbios mode='sysinfo'/>
Aug 15 16:19:24 user nova-compute[72849]:   </os>
Aug 15 16:19:24 user nova-compute[72849]:   <features>
Aug 15 16:19:24 user nova-compute[72849]:     <acpi/>
Aug 15 16:19:24 user nova-compute[72849]:     <apic/>
Aug 15 16:19:24 user nova-compute[72849]:     <vmcoreinfo state='on'/>
Aug 15 16:19:24 user nova-compute[72849]:   </features>
Aug 15 16:19:24 user nova-compute[72849]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 16:19:24 user nova-compute[72849]:     <model fallback='forbid'>Nehalem</model>
Aug 15 16:19:24 user nova-compute[72849]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 16:19:24 user nova-compute[72849]:     <feature policy='require' name='vme'/>
Aug 15 16:19:24 user nova-compute[72849]:     <feature policy='require' name='x2apic'/>
Aug 15 16:19:24 user nova-compute[72849]:     <feature policy='require' name='hypervisor'/>
Aug 15 16:19:24 user nova-compute[72849]:   </cpu>
Aug 15 16:19:24 user nova-compute[72849]:   <clock offset='utc'>
Aug 15 16:19:24 user nova-compute[72849]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 16:19:24 user nova-compute[72849]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 16:19:24 user nova-compute[72849]:     <timer name='hpet' present='no'/>
Aug 15 16:19:24 user nova-compute[72849]:   </clock>
Aug 15 16:19:24 user nova-compute[72849]:   <on_poweroff>destroy</on_poweroff>
Aug 15 16:19:24 user nova-compute[72849]:   <on_reboot>restart</on_reboot>
Aug 15 16:19:24 user nova-compute[72849]:   <on_crash>destroy</on_crash>
Aug 15 16:19:24 user nova-compute[72849]:   <devices>
Aug 15 16:19:24 user nova-compute[72849]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 16:19:24 user nova-compute[72849]:     <disk type='file' device='disk'>
Aug 15 16:19:24 user nova-compute[72849]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 16:19:24 user nova-compute[72849]:       <source file='/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk' index='2'/>
Aug 15 16:19:24 user nova-compute[72849]:       <backingStore type='file' index='3'>
Aug 15 16:19:24 user nova-compute[72849]:         <format type='raw'/>
Aug 15 16:19:24 user nova-compute[72849]:         <source file='/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374'/>
Aug 15 16:19:24 user nova-compute[72849]:         <backingStore/>
Aug 15 16:19:24 user nova-compute[72849]:       </backingStore>
Aug 15 16:19:24 user nova-compute[72849]:       <target dev='vda' bus='virtio'/>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='virtio-disk0'/>
Aug 15 16:19:24 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </disk>
Aug 15 16:19:24 user nova-compute[72849]:     <disk type='file' device='cdrom'>
Aug 15 16:19:24 user nova-compute[72849]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 16:19:24 user nova-compute[72849]:       <source file='/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk.config' index='1'/>
Aug 15 16:19:24 user nova-compute[72849]:       <backingStore/>
Aug 15 16:19:24 user nova-compute[72849]:       <target dev='hda' bus='ide'/>
Aug 15 16:19:24 user nova-compute[72849]:       <readonly/>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='ide0-0-0'/>
Aug 15 16:19:24 user nova-compute[72849]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </disk>
Aug 15 16:19:24 user nova-compute[72849]:     <controller type='usb' index='0' model='none'>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='usb'/>
Aug 15 16:19:24 user nova-compute[72849]:     </controller>
Aug 15 16:19:24 user nova-compute[72849]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='pci.0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </controller>
Aug 15 16:19:24 user nova-compute[72849]:     <controller type='ide' index='0'>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='ide'/>
Aug 15 16:19:24 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 16:19:24 user nova-compute[72849]:     </controller>
Aug 15 16:19:24 user nova-compute[72849]:     <interface type='ethernet'>
Aug 15 16:19:24 user nova-compute[72849]:       <mac address='fa:16:3e:7d:a6:b4'/>
Aug 15 16:19:24 user nova-compute[72849]:       <target dev='tap888d8da9-c8'/>
Aug 15 16:19:24 user nova-compute[72849]:       <model type='virtio'/>
Aug 15 16:19:24 user nova-compute[72849]:       <mtu size='1442'/>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='net0'/>
Aug 15 16:19:24 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </interface>
Aug 15 16:19:24 user nova-compute[72849]:     <serial type='pty'>
Aug 15 16:19:24 user nova-compute[72849]:       <source path='/dev/pts/7'/>
Aug 15 16:19:24 user nova-compute[72849]:       <log file='/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/console.log' append='off'/>
Aug 15 16:19:24 user nova-compute[72849]:       <target type='isa-serial' port='0'>
Aug 15 16:19:24 user nova-compute[72849]:         <model name='isa-serial'/>
Aug 15 16:19:24 user nova-compute[72849]:       </target>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='serial0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </serial>
Aug 15 16:19:24 user nova-compute[72849]:     <console type='pty' tty='/dev/pts/7'>
Aug 15 16:19:24 user nova-compute[72849]:       <source path='/dev/pts/7'/>
Aug 15 16:19:24 user nova-compute[72849]:       <log file='/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/console.log' append='off'/>
Aug 15 16:19:24 user nova-compute[72849]:       <target type='serial' port='0'/>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='serial0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </console>
Aug 15 16:19:24 user nova-compute[72849]:     <input type='mouse' bus='ps2'>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='input0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </input>
Aug 15 16:19:24 user nova-compute[72849]:     <input type='keyboard' bus='ps2'>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='input1'/>
Aug 15 16:19:24 user nova-compute[72849]:     </input>
Aug 15 16:19:24 user nova-compute[72849]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 15 16:19:24 user nova-compute[72849]:       <listen type='address' address='0.0.0.0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </graphics>
Aug 15 16:19:24 user nova-compute[72849]:     <audio id='1' type='none'/>
Aug 15 16:19:24 user nova-compute[72849]:     <video>
Aug 15 16:19:24 user nova-compute[72849]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='video0'/>
Aug 15 16:19:24 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </video>
Aug 15 16:19:24 user nova-compute[72849]:     <memballoon model='virtio'>
Aug 15 16:19:24 user nova-compute[72849]:       <stats period='10'/>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='balloon0'/>
Aug 15 16:19:24 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </memballoon>
Aug 15 16:19:24 user nova-compute[72849]:     <rng model='virtio'>
Aug 15 16:19:24 user nova-compute[72849]:       <backend model='random'>/dev/urandom</backend>
Aug 15 16:19:24 user nova-compute[72849]:       <alias name='rng0'/>
Aug 15 16:19:24 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 16:19:24 user nova-compute[72849]:     </rng>
Aug 15 16:19:24 user nova-compute[72849]:   </devices>
Aug 15 16:19:24 user nova-compute[72849]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 16:19:24 user nova-compute[72849]:     <label>libvirt-7d843493-eda8-46a9-bb1b-3cc80eed7488</label>
Aug 15 16:19:24 user nova-compute[72849]:     <imagelabel>libvirt-7d843493-eda8-46a9-bb1b-3cc80eed7488</imagelabel>
Aug 15 16:19:24 user nova-compute[72849]:   </seclabel>
Aug 15 16:19:24 user nova-compute[72849]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 16:19:24 user nova-compute[72849]:     <label>+64055:+108</label>
Aug 15 16:19:24 user nova-compute[72849]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 16:19:24 user nova-compute[72849]:   </seclabel>
Aug 15 16:19:24 user nova-compute[72849]: </domain>
Aug 15 16:19:24 user nova-compute[72849]:  {{(pid=72849) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 16:19:24 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Successfully detached device tapcc094456-8e from instance 7d843493-eda8-46a9-bb1b-3cc80eed7488 from the live domain config.
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-215597638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-215597638',id=7,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdbWakgm9rkhjBkOdQBASg9y5tRST/eN38nlLPxQcgrQZwoqRDKC9b5dSss1Yo4J4gifxLRY6ThnnWU08v57v9/fZXdXuUr1hxB2yLXnfesqIyRH5q7Iz1U8TLWUXIMbw==',key_name='tempest-keypair-627680743',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:17:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de78e6bddce4402d9829b94e9bd6cf05',ramdisk_id='',reservation_id='r-aag6oo7v',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-415257394',owner_user_name='tempest-TaggedAttachmentsTest-415257394-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:17:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a442003f0164870905327b6b5f1a0b2',uuid=7d843493-eda8-46a9-bb1b-3cc80eed7488,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "address": "fa:16:3e:ec:5a:1c", "network": {"id": "a62f6239-f231-4224-ac26-db5fbdedefe4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1068433324", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc094456-8e", "ovs_interfaceid": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Converting VIF {"id": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "address": "fa:16:3e:ec:5a:1c", "network": {"id": "a62f6239-f231-4224-ac26-db5fbdedefe4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1068433324", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc094456-8e", "ovs_interfaceid": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:5a:1c,bridge_name='br-int',has_traffic_filtering=True,id=cc094456-8e0d-4269-b99b-5bfd5297a4f7,network=Network(a62f6239-f231-4224-ac26-db5fbdedefe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc094456-8e') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_vif [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:5a:1c,bridge_name='br-int',has_traffic_filtering=True,id=cc094456-8e0d-4269-b99b-5bfd5297a4f7,network=Network(a62f6239-f231-4224-ac26-db5fbdedefe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc094456-8e') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc094456-8e, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dacb722-320b-45a5-a0ec-31d93a863fc4]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:24 user nova-compute[72849]: INFO os_vif [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:5a:1c,bridge_name='br-int',has_traffic_filtering=True,id=cc094456-8e0d-4269-b99b-5bfd5297a4f7,network=Network(a62f6239-f231-4224-ac26-db5fbdedefe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc094456-8e')
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:19:24 user nova-compute[72849]:   <nova:package version="0.0.0"/>
Aug 15 16:19:24 user nova-compute[72849]:   <nova:name>tempest-device-tagging-server-215597638</nova:name>
Aug 15 16:19:24 user nova-compute[72849]:   <nova:creationTime>2023-08-15 16:19:24</nova:creationTime>
Aug 15 16:19:24 user nova-compute[72849]:   <nova:flavor name="m1.tiny">
Aug 15 16:19:24 user nova-compute[72849]:     <nova:memory>512</nova:memory>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:disk>1</nova:disk>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:swap>0</nova:swap>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:vcpus>1</nova:vcpus>
Aug 15 16:19:24 user nova-compute[72849]:   </nova:flavor>
Aug 15 16:19:24 user nova-compute[72849]:   <nova:owner>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:user uuid="9a442003f0164870905327b6b5f1a0b2">tempest-TaggedAttachmentsTest-415257394-project-member</nova:user>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:project uuid="de78e6bddce4402d9829b94e9bd6cf05">tempest-TaggedAttachmentsTest-415257394</nova:project>
Aug 15 16:19:24 user nova-compute[72849]:   </nova:owner>
Aug 15 16:19:24 user nova-compute[72849]:   <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:19:24 user nova-compute[72849]:   <nova:ports>
Aug 15 16:19:24 user nova-compute[72849]:     <nova:port uuid="888d8da9-c8a5-40fd-a421-1a8ec1890f25">
Aug 15 16:19:24 user nova-compute[72849]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:19:24 user nova-compute[72849]:     </nova:port>
Aug 15 16:19:24 user nova-compute[72849]:   </nova:ports>
Aug 15 16:19:24 user nova-compute[72849]: </nova:instance>
Aug 15 16:19:24 user nova-compute[72849]:  {{(pid=72849) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d45c7cc-77c1-4634-8eb9-1a6fc835eed9]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJwpUeoR {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJwpUeoR" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eca0e12-9f8f-4ec6-8d45-8be2c3a0d0b1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QJwpUeoR'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5dd641-f4c6-408e-bf2e-45864e57f48e]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-0aef4302-dc39-4c9f-97b3-2fb4bfb87a94 req-02c49465-a69e-462f-a5aa-ca8c78c0a56b service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received event network-vif-unplugged-cc094456-8e0d-4269-b99b-5bfd5297a4f7 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0aef4302-dc39-4c9f-97b3-2fb4bfb87a94 req-02c49465-a69e-462f-a5aa-ca8c78c0a56b service nova] Acquiring lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0aef4302-dc39-4c9f-97b3-2fb4bfb87a94 req-02c49465-a69e-462f-a5aa-ca8c78c0a56b service nova] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0aef4302-dc39-4c9f-97b3-2fb4bfb87a94 req-02c49465-a69e-462f-a5aa-ca8c78c0a56b service nova] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-0aef4302-dc39-4c9f-97b3-2fb4bfb87a94 req-02c49465-a69e-462f-a5aa-ca8c78c0a56b service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] No waiting events found dispatching network-vif-unplugged-cc094456-8e0d-4269-b99b-5bfd5297a4f7 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:24 user nova-compute[72849]: WARNING nova.compute.manager [req-0aef4302-dc39-4c9f-97b3-2fb4bfb87a94 req-02c49465-a69e-462f-a5aa-ca8c78c0a56b service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received unexpected event network-vif-unplugged-cc094456-8e0d-4269-b99b-5bfd5297a4f7 for instance with vm_state active and task_state None.
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8d64b8-aa49-4758-b889-b151653961ba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:24 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:24 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:24 user nova-compute[72849]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:24 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:24 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:24 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:24 user nova-compute[72849]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:24 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c8f7cd-4bc1-4a1d-a8da-32b11cfbc413]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135, portal: 172.16.0.220,3260]
Aug 15 16:19:24 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135, portal: 172.16.0.220,3260] successful.
Aug 15 16:19:24 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[251f6776-db2d-44f6-a87b-3caade368fe1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[85103d36-6ab9-4e12-9b45-8590e05fb1c6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:24 user nova-compute[72849]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:24 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:24 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:24 user nova-compute[72849]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:24 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:24 user nova-compute[72849]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:24 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:24 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:24 user nova-compute[72849]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:24 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] HCTL ('36', '-', '-', 0) found on session 10 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:19:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fde919-5726-4a68-889e-40796c61fce8]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJwpUeoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received event network-vif-deleted-cc094456-8e0d-4269-b99b-5bfd5297a4f7 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:25 user nova-compute[72849]: INFO nova.compute.manager [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Neutron deleted interface cc094456-8e0d-4269-b99b-5bfd5297a4f7; detaching it from the instance and deleting it from the info cache
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.network.neutron [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Updating instance_info_cache with network_info: [{"id": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "address": "fa:16:3e:7d:a6:b4", "network": {"id": "2d0a7c86-1e60-4ea6-93d7-c66b552d95e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1960989403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888d8da9-c8", "ovs_interfaceid": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "refresh_cache-7d843493-eda8-46a9-bb1b-3cc80eed7488" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquired lock "refresh_cache-7d843493-eda8-46a9-bb1b-3cc80eed7488" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.objects.instance [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] Lazy-loading 'system_metadata' on Instance uuid 7d843493-eda8-46a9-bb1b-3cc80eed7488 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.objects.instance [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] Lazy-loading 'flavor' on Instance uuid 7d843493-eda8-46a9-bb1b-3cc80eed7488 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-215597638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-215597638',id=7,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdbWakgm9rkhjBkOdQBASg9y5tRST/eN38nlLPxQcgrQZwoqRDKC9b5dSss1Yo4J4gifxLRY6ThnnWU08v57v9/fZXdXuUr1hxB2yLXnfesqIyRH5q7Iz1U8TLWUXIMbw==',key_name='tempest-keypair-627680743',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:17:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de78e6bddce4402d9829b94e9bd6cf05',ramdisk_id='',reservation_id='r-aag6oo7v',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-415257394',owner_user_name='tempest-TaggedAttachmentsTest-415257394-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:17:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a442003f0164870905327b6b5f1a0b2',uuid=7d843493-eda8-46a9-bb1b-3cc80eed7488,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "address": "fa:16:3e:ec:5a:1c", "network": {"id": "a62f6239-f231-4224-ac26-db5fbdedefe4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1068433324", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc094456-8e", "ovs_interfaceid": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.network.os_vif_util [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] Converting VIF {"id": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "address": "fa:16:3e:ec:5a:1c", "network": {"id": "a62f6239-f231-4224-ac26-db5fbdedefe4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1068433324", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc094456-8e", "ovs_interfaceid": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.network.os_vif_util [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:5a:1c,bridge_name='br-int',has_traffic_filtering=True,id=cc094456-8e0d-4269-b99b-5bfd5297a4f7,network=Network(a62f6239-f231-4224-ac26-db5fbdedefe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc094456-8e') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ec:5a:1c"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc094456-8e"/></interface> {{(pid=72849) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ec:5a:1c"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc094456-8e"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 15 16:19:25 user nova-compute[72849]:   <name>instance-00000007</name>
Aug 15 16:19:25 user nova-compute[72849]:   <uuid>7d843493-eda8-46a9-bb1b-3cc80eed7488</uuid>
Aug 15 16:19:25 user nova-compute[72849]:   <metadata>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:19:25 user nova-compute[72849]:   <nova:package version="0.0.0"/>
Aug 15 16:19:25 user nova-compute[72849]:   <nova:name>tempest-device-tagging-server-215597638</nova:name>
Aug 15 16:19:25 user nova-compute[72849]:   <nova:creationTime>2023-08-15 16:19:24</nova:creationTime>
Aug 15 16:19:25 user nova-compute[72849]:   <nova:flavor name="m1.tiny">
Aug 15 16:19:25 user nova-compute[72849]:     <nova:memory>512</nova:memory>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:disk>1</nova:disk>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:swap>0</nova:swap>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:vcpus>1</nova:vcpus>
Aug 15 16:19:25 user nova-compute[72849]:   </nova:flavor>
Aug 15 16:19:25 user nova-compute[72849]:   <nova:owner>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:user uuid="9a442003f0164870905327b6b5f1a0b2">tempest-TaggedAttachmentsTest-415257394-project-member</nova:user>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:project uuid="de78e6bddce4402d9829b94e9bd6cf05">tempest-TaggedAttachmentsTest-415257394</nova:project>
Aug 15 16:19:25 user nova-compute[72849]:   </nova:owner>
Aug 15 16:19:25 user nova-compute[72849]:   <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:19:25 user nova-compute[72849]:   <nova:ports>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:port uuid="888d8da9-c8a5-40fd-a421-1a8ec1890f25">
Aug 15 16:19:25 user nova-compute[72849]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:19:25 user nova-compute[72849]:     </nova:port>
Aug 15 16:19:25 user nova-compute[72849]:   </nova:ports>
Aug 15 16:19:25 user nova-compute[72849]: </nova:instance>
Aug 15 16:19:25 user nova-compute[72849]:   </metadata>
Aug 15 16:19:25 user nova-compute[72849]:   <memory unit='KiB'>524288</memory>
Aug 15 16:19:25 user nova-compute[72849]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 16:19:25 user nova-compute[72849]:   <vcpu placement='static'>1</vcpu>
Aug 15 16:19:25 user nova-compute[72849]:   <resource>
Aug 15 16:19:25 user nova-compute[72849]:     <partition>/machine</partition>
Aug 15 16:19:25 user nova-compute[72849]:   </resource>
Aug 15 16:19:25 user nova-compute[72849]:   <sysinfo type='smbios'>
Aug 15 16:19:25 user nova-compute[72849]:     <system>
Aug 15 16:19:25 user nova-compute[72849]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 16:19:25 user nova-compute[72849]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 16:19:25 user nova-compute[72849]:       <entry name='version'>0.0.0</entry>
Aug 15 16:19:25 user nova-compute[72849]:       <entry name='serial'>7d843493-eda8-46a9-bb1b-3cc80eed7488</entry>
Aug 15 16:19:25 user nova-compute[72849]:       <entry name='uuid'>7d843493-eda8-46a9-bb1b-3cc80eed7488</entry>
Aug 15 16:19:25 user nova-compute[72849]:       <entry name='family'>Virtual Machine</entry>
Aug 15 16:19:25 user nova-compute[72849]:     </system>
Aug 15 16:19:25 user nova-compute[72849]:   </sysinfo>
Aug 15 16:19:25 user nova-compute[72849]:   <os>
Aug 15 16:19:25 user nova-compute[72849]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 16:19:25 user nova-compute[72849]:     <boot dev='hd'/>
Aug 15 16:19:25 user nova-compute[72849]:     <smbios mode='sysinfo'/>
Aug 15 16:19:25 user nova-compute[72849]:   </os>
Aug 15 16:19:25 user nova-compute[72849]:   <features>
Aug 15 16:19:25 user nova-compute[72849]:     <acpi/>
Aug 15 16:19:25 user nova-compute[72849]:     <apic/>
Aug 15 16:19:25 user nova-compute[72849]:     <vmcoreinfo state='on'/>
Aug 15 16:19:25 user nova-compute[72849]:   </features>
Aug 15 16:19:25 user nova-compute[72849]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 16:19:25 user nova-compute[72849]:     <model fallback='forbid'>Nehalem</model>
Aug 15 16:19:25 user nova-compute[72849]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 16:19:25 user nova-compute[72849]:     <feature policy='require' name='vme'/>
Aug 15 16:19:25 user nova-compute[72849]:     <feature policy='require' name='x2apic'/>
Aug 15 16:19:25 user nova-compute[72849]:     <feature policy='require' name='hypervisor'/>
Aug 15 16:19:25 user nova-compute[72849]:   </cpu>
Aug 15 16:19:25 user nova-compute[72849]:   <clock offset='utc'>
Aug 15 16:19:25 user nova-compute[72849]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 16:19:25 user nova-compute[72849]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 16:19:25 user nova-compute[72849]:     <timer name='hpet' present='no'/>
Aug 15 16:19:25 user nova-compute[72849]:   </clock>
Aug 15 16:19:25 user nova-compute[72849]:   <on_poweroff>destroy</on_poweroff>
Aug 15 16:19:25 user nova-compute[72849]:   <on_reboot>restart</on_reboot>
Aug 15 16:19:25 user nova-compute[72849]:   <on_crash>destroy</on_crash>
Aug 15 16:19:25 user nova-compute[72849]:   <devices>
Aug 15 16:19:25 user nova-compute[72849]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 16:19:25 user nova-compute[72849]:     <disk type='file' device='disk'>
Aug 15 16:19:25 user nova-compute[72849]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 16:19:25 user nova-compute[72849]:       <source file='/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk' index='2'/>
Aug 15 16:19:25 user nova-compute[72849]:       <backingStore type='file' index='3'>
Aug 15 16:19:25 user nova-compute[72849]:         <format type='raw'/>
Aug 15 16:19:25 user nova-compute[72849]:         <source file='/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374'/>
Aug 15 16:19:25 user nova-compute[72849]:         <backingStore/>
Aug 15 16:19:25 user nova-compute[72849]:       </backingStore>
Aug 15 16:19:25 user nova-compute[72849]:       <target dev='vda' bus='virtio'/>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='virtio-disk0'/>
Aug 15 16:19:25 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </disk>
Aug 15 16:19:25 user nova-compute[72849]:     <disk type='file' device='cdrom'>
Aug 15 16:19:25 user nova-compute[72849]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 16:19:25 user nova-compute[72849]:       <source file='/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk.config' index='1'/>
Aug 15 16:19:25 user nova-compute[72849]:       <backingStore/>
Aug 15 16:19:25 user nova-compute[72849]:       <target dev='hda' bus='ide'/>
Aug 15 16:19:25 user nova-compute[72849]:       <readonly/>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='ide0-0-0'/>
Aug 15 16:19:25 user nova-compute[72849]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </disk>
Aug 15 16:19:25 user nova-compute[72849]:     <controller type='usb' index='0' model='none'>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='usb'/>
Aug 15 16:19:25 user nova-compute[72849]:     </controller>
Aug 15 16:19:25 user nova-compute[72849]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='pci.0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </controller>
Aug 15 16:19:25 user nova-compute[72849]:     <controller type='ide' index='0'>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='ide'/>
Aug 15 16:19:25 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 16:19:25 user nova-compute[72849]:     </controller>
Aug 15 16:19:25 user nova-compute[72849]:     <interface type='ethernet'>
Aug 15 16:19:25 user nova-compute[72849]:       <mac address='fa:16:3e:7d:a6:b4'/>
Aug 15 16:19:25 user nova-compute[72849]:       <target dev='tap888d8da9-c8'/>
Aug 15 16:19:25 user nova-compute[72849]:       <model type='virtio'/>
Aug 15 16:19:25 user nova-compute[72849]:       <mtu size='1442'/>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='net0'/>
Aug 15 16:19:25 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </interface>
Aug 15 16:19:25 user nova-compute[72849]:     <serial type='pty'>
Aug 15 16:19:25 user nova-compute[72849]:       <source path='/dev/pts/7'/>
Aug 15 16:19:25 user nova-compute[72849]:       <log file='/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/console.log' append='off'/>
Aug 15 16:19:25 user nova-compute[72849]:       <target type='isa-serial' port='0'>
Aug 15 16:19:25 user nova-compute[72849]:         <model name='isa-serial'/>
Aug 15 16:19:25 user nova-compute[72849]:       </target>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='serial0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </serial>
Aug 15 16:19:25 user nova-compute[72849]:     <console type='pty' tty='/dev/pts/7'>
Aug 15 16:19:25 user nova-compute[72849]:       <source path='/dev/pts/7'/>
Aug 15 16:19:25 user nova-compute[72849]:       <log file='/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/console.log' append='off'/>
Aug 15 16:19:25 user nova-compute[72849]:       <target type='serial' port='0'/>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='serial0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </console>
Aug 15 16:19:25 user nova-compute[72849]:     <input type='mouse' bus='ps2'>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='input0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </input>
Aug 15 16:19:25 user nova-compute[72849]:     <input type='keyboard' bus='ps2'>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='input1'/>
Aug 15 16:19:25 user nova-compute[72849]:     </input>
Aug 15 16:19:25 user nova-compute[72849]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 15 16:19:25 user nova-compute[72849]:       <listen type='address' address='0.0.0.0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </graphics>
Aug 15 16:19:25 user nova-compute[72849]:     <audio id='1' type='none'/>
Aug 15 16:19:25 user nova-compute[72849]:     <video>
Aug 15 16:19:25 user nova-compute[72849]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='video0'/>
Aug 15 16:19:25 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </video>
Aug 15 16:19:25 user nova-compute[72849]:     <memballoon model='virtio'>
Aug 15 16:19:25 user nova-compute[72849]:       <stats period='10'/>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='balloon0'/>
Aug 15 16:19:25 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </memballoon>
Aug 15 16:19:25 user nova-compute[72849]:     <rng model='virtio'>
Aug 15 16:19:25 user nova-compute[72849]:       <backend model='random'>/dev/urandom</backend>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='rng0'/>
Aug 15 16:19:25 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </rng>
Aug 15 16:19:25 user nova-compute[72849]:   </devices>
Aug 15 16:19:25 user nova-compute[72849]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 16:19:25 user nova-compute[72849]:     <label>libvirt-7d843493-eda8-46a9-bb1b-3cc80eed7488</label>
Aug 15 16:19:25 user nova-compute[72849]:     <imagelabel>libvirt-7d843493-eda8-46a9-bb1b-3cc80eed7488</imagelabel>
Aug 15 16:19:25 user nova-compute[72849]:   </seclabel>
Aug 15 16:19:25 user nova-compute[72849]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 16:19:25 user nova-compute[72849]:     <label>+64055:+108</label>
Aug 15 16:19:25 user nova-compute[72849]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 16:19:25 user nova-compute[72849]:   </seclabel>
Aug 15 16:19:25 user nova-compute[72849]: </domain>
Aug 15 16:19:25 user nova-compute[72849]:  {{(pid=72849) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ec:5a:1c"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc094456-8e"/></interface> {{(pid=72849) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ec:5a:1c"/><model type="virtio"/><mtu size="1442"/><target dev="tapcc094456-8e"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 15 16:19:25 user nova-compute[72849]:   <name>instance-00000007</name>
Aug 15 16:19:25 user nova-compute[72849]:   <uuid>7d843493-eda8-46a9-bb1b-3cc80eed7488</uuid>
Aug 15 16:19:25 user nova-compute[72849]:   <metadata>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:19:25 user nova-compute[72849]:   <nova:package version="0.0.0"/>
Aug 15 16:19:25 user nova-compute[72849]:   <nova:name>tempest-device-tagging-server-215597638</nova:name>
Aug 15 16:19:25 user nova-compute[72849]:   <nova:creationTime>2023-08-15 16:19:24</nova:creationTime>
Aug 15 16:19:25 user nova-compute[72849]:   <nova:flavor name="m1.tiny">
Aug 15 16:19:25 user nova-compute[72849]:     <nova:memory>512</nova:memory>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:disk>1</nova:disk>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:swap>0</nova:swap>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:vcpus>1</nova:vcpus>
Aug 15 16:19:25 user nova-compute[72849]:   </nova:flavor>
Aug 15 16:19:25 user nova-compute[72849]:   <nova:owner>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:user uuid="9a442003f0164870905327b6b5f1a0b2">tempest-TaggedAttachmentsTest-415257394-project-member</nova:user>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:project uuid="de78e6bddce4402d9829b94e9bd6cf05">tempest-TaggedAttachmentsTest-415257394</nova:project>
Aug 15 16:19:25 user nova-compute[72849]:   </nova:owner>
Aug 15 16:19:25 user nova-compute[72849]:   <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:19:25 user nova-compute[72849]:   <nova:ports>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:port uuid="888d8da9-c8a5-40fd-a421-1a8ec1890f25">
Aug 15 16:19:25 user nova-compute[72849]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:19:25 user nova-compute[72849]:     </nova:port>
Aug 15 16:19:25 user nova-compute[72849]:   </nova:ports>
Aug 15 16:19:25 user nova-compute[72849]: </nova:instance>
Aug 15 16:19:25 user nova-compute[72849]:   </metadata>
Aug 15 16:19:25 user nova-compute[72849]:   <memory unit='KiB'>524288</memory>
Aug 15 16:19:25 user nova-compute[72849]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 16:19:25 user nova-compute[72849]:   <vcpu placement='static'>1</vcpu>
Aug 15 16:19:25 user nova-compute[72849]:   <resource>
Aug 15 16:19:25 user nova-compute[72849]:     <partition>/machine</partition>
Aug 15 16:19:25 user nova-compute[72849]:   </resource>
Aug 15 16:19:25 user nova-compute[72849]:   <sysinfo type='smbios'>
Aug 15 16:19:25 user nova-compute[72849]:     <system>
Aug 15 16:19:25 user nova-compute[72849]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 16:19:25 user nova-compute[72849]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 16:19:25 user nova-compute[72849]:       <entry name='version'>0.0.0</entry>
Aug 15 16:19:25 user nova-compute[72849]:       <entry name='serial'>7d843493-eda8-46a9-bb1b-3cc80eed7488</entry>
Aug 15 16:19:25 user nova-compute[72849]:       <entry name='uuid'>7d843493-eda8-46a9-bb1b-3cc80eed7488</entry>
Aug 15 16:19:25 user nova-compute[72849]:       <entry name='family'>Virtual Machine</entry>
Aug 15 16:19:25 user nova-compute[72849]:     </system>
Aug 15 16:19:25 user nova-compute[72849]:   </sysinfo>
Aug 15 16:19:25 user nova-compute[72849]:   <os>
Aug 15 16:19:25 user nova-compute[72849]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 16:19:25 user nova-compute[72849]:     <boot dev='hd'/>
Aug 15 16:19:25 user nova-compute[72849]:     <smbios mode='sysinfo'/>
Aug 15 16:19:25 user nova-compute[72849]:   </os>
Aug 15 16:19:25 user nova-compute[72849]:   <features>
Aug 15 16:19:25 user nova-compute[72849]:     <acpi/>
Aug 15 16:19:25 user nova-compute[72849]:     <apic/>
Aug 15 16:19:25 user nova-compute[72849]:     <vmcoreinfo state='on'/>
Aug 15 16:19:25 user nova-compute[72849]:   </features>
Aug 15 16:19:25 user nova-compute[72849]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 16:19:25 user nova-compute[72849]:     <model fallback='forbid'>Nehalem</model>
Aug 15 16:19:25 user nova-compute[72849]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 16:19:25 user nova-compute[72849]:     <feature policy='require' name='vme'/>
Aug 15 16:19:25 user nova-compute[72849]:     <feature policy='require' name='x2apic'/>
Aug 15 16:19:25 user nova-compute[72849]:     <feature policy='require' name='hypervisor'/>
Aug 15 16:19:25 user nova-compute[72849]:   </cpu>
Aug 15 16:19:25 user nova-compute[72849]:   <clock offset='utc'>
Aug 15 16:19:25 user nova-compute[72849]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 16:19:25 user nova-compute[72849]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 16:19:25 user nova-compute[72849]:     <timer name='hpet' present='no'/>
Aug 15 16:19:25 user nova-compute[72849]:   </clock>
Aug 15 16:19:25 user nova-compute[72849]:   <on_poweroff>destroy</on_poweroff>
Aug 15 16:19:25 user nova-compute[72849]:   <on_reboot>restart</on_reboot>
Aug 15 16:19:25 user nova-compute[72849]:   <on_crash>destroy</on_crash>
Aug 15 16:19:25 user nova-compute[72849]:   <devices>
Aug 15 16:19:25 user nova-compute[72849]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 16:19:25 user nova-compute[72849]:     <disk type='file' device='disk'>
Aug 15 16:19:25 user nova-compute[72849]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 16:19:25 user nova-compute[72849]:       <source file='/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk' index='2'/>
Aug 15 16:19:25 user nova-compute[72849]:       <backingStore type='file' index='3'>
Aug 15 16:19:25 user nova-compute[72849]:         <format type='raw'/>
Aug 15 16:19:25 user nova-compute[72849]:         <source file='/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374'/>
Aug 15 16:19:25 user nova-compute[72849]:         <backingStore/>
Aug 15 16:19:25 user nova-compute[72849]:       </backingStore>
Aug 15 16:19:25 user nova-compute[72849]:       <target dev='vda' bus='virtio'/>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='virtio-disk0'/>
Aug 15 16:19:25 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </disk>
Aug 15 16:19:25 user nova-compute[72849]:     <disk type='file' device='cdrom'>
Aug 15 16:19:25 user nova-compute[72849]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 16:19:25 user nova-compute[72849]:       <source file='/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk.config' index='1'/>
Aug 15 16:19:25 user nova-compute[72849]:       <backingStore/>
Aug 15 16:19:25 user nova-compute[72849]:       <target dev='hda' bus='ide'/>
Aug 15 16:19:25 user nova-compute[72849]:       <readonly/>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='ide0-0-0'/>
Aug 15 16:19:25 user nova-compute[72849]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </disk>
Aug 15 16:19:25 user nova-compute[72849]:     <controller type='usb' index='0' model='none'>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='usb'/>
Aug 15 16:19:25 user nova-compute[72849]:     </controller>
Aug 15 16:19:25 user nova-compute[72849]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='pci.0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </controller>
Aug 15 16:19:25 user nova-compute[72849]:     <controller type='ide' index='0'>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='ide'/>
Aug 15 16:19:25 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 16:19:25 user nova-compute[72849]:     </controller>
Aug 15 16:19:25 user nova-compute[72849]:     <interface type='ethernet'>
Aug 15 16:19:25 user nova-compute[72849]:       <mac address='fa:16:3e:7d:a6:b4'/>
Aug 15 16:19:25 user nova-compute[72849]:       <target dev='tap888d8da9-c8'/>
Aug 15 16:19:25 user nova-compute[72849]:       <model type='virtio'/>
Aug 15 16:19:25 user nova-compute[72849]:       <mtu size='1442'/>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='net0'/>
Aug 15 16:19:25 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </interface>
Aug 15 16:19:25 user nova-compute[72849]:     <serial type='pty'>
Aug 15 16:19:25 user nova-compute[72849]:       <source path='/dev/pts/7'/>
Aug 15 16:19:25 user nova-compute[72849]:       <log file='/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/console.log' append='off'/>
Aug 15 16:19:25 user nova-compute[72849]:       <target type='isa-serial' port='0'>
Aug 15 16:19:25 user nova-compute[72849]:         <model name='isa-serial'/>
Aug 15 16:19:25 user nova-compute[72849]:       </target>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='serial0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </serial>
Aug 15 16:19:25 user nova-compute[72849]:     <console type='pty' tty='/dev/pts/7'>
Aug 15 16:19:25 user nova-compute[72849]:       <source path='/dev/pts/7'/>
Aug 15 16:19:25 user nova-compute[72849]:       <log file='/opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/console.log' append='off'/>
Aug 15 16:19:25 user nova-compute[72849]:       <target type='serial' port='0'/>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='serial0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </console>
Aug 15 16:19:25 user nova-compute[72849]:     <input type='mouse' bus='ps2'>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='input0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </input>
Aug 15 16:19:25 user nova-compute[72849]:     <input type='keyboard' bus='ps2'>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='input1'/>
Aug 15 16:19:25 user nova-compute[72849]:     </input>
Aug 15 16:19:25 user nova-compute[72849]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 15 16:19:25 user nova-compute[72849]:       <listen type='address' address='0.0.0.0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </graphics>
Aug 15 16:19:25 user nova-compute[72849]:     <audio id='1' type='none'/>
Aug 15 16:19:25 user nova-compute[72849]:     <video>
Aug 15 16:19:25 user nova-compute[72849]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='video0'/>
Aug 15 16:19:25 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </video>
Aug 15 16:19:25 user nova-compute[72849]:     <memballoon model='virtio'>
Aug 15 16:19:25 user nova-compute[72849]:       <stats period='10'/>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='balloon0'/>
Aug 15 16:19:25 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </memballoon>
Aug 15 16:19:25 user nova-compute[72849]:     <rng model='virtio'>
Aug 15 16:19:25 user nova-compute[72849]:       <backend model='random'>/dev/urandom</backend>
Aug 15 16:19:25 user nova-compute[72849]:       <alias name='rng0'/>
Aug 15 16:19:25 user nova-compute[72849]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 16:19:25 user nova-compute[72849]:     </rng>
Aug 15 16:19:25 user nova-compute[72849]:   </devices>
Aug 15 16:19:25 user nova-compute[72849]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 16:19:25 user nova-compute[72849]:     <label>libvirt-7d843493-eda8-46a9-bb1b-3cc80eed7488</label>
Aug 15 16:19:25 user nova-compute[72849]:     <imagelabel>libvirt-7d843493-eda8-46a9-bb1b-3cc80eed7488</imagelabel>
Aug 15 16:19:25 user nova-compute[72849]:   </seclabel>
Aug 15 16:19:25 user nova-compute[72849]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 16:19:25 user nova-compute[72849]:     <label>+64055:+108</label>
Aug 15 16:19:25 user nova-compute[72849]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 16:19:25 user nova-compute[72849]:   </seclabel>
Aug 15 16:19:25 user nova-compute[72849]: </domain>
Aug 15 16:19:25 user nova-compute[72849]:  {{(pid=72849) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 16:19:25 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Detaching interface fa:16:3e:ec:5a:1c failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapcc094456-8e' not found.
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-215597638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-215597638',id=7,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdbWakgm9rkhjBkOdQBASg9y5tRST/eN38nlLPxQcgrQZwoqRDKC9b5dSss1Yo4J4gifxLRY6ThnnWU08v57v9/fZXdXuUr1hxB2yLXnfesqIyRH5q7Iz1U8TLWUXIMbw==',key_name='tempest-keypair-627680743',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:17:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de78e6bddce4402d9829b94e9bd6cf05',ramdisk_id='',reservation_id='r-aag6oo7v',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-415257394',owner_user_name='tempest-TaggedAttachmentsTest-415257394-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:17:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a442003f0164870905327b6b5f1a0b2',uuid=7d843493-eda8-46a9-bb1b-3cc80eed7488,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "address": "fa:16:3e:ec:5a:1c", "network": {"id": "a62f6239-f231-4224-ac26-db5fbdedefe4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1068433324", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc094456-8e", "ovs_interfaceid": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.network.os_vif_util [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] Converting VIF {"id": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "address": "fa:16:3e:ec:5a:1c", "network": {"id": "a62f6239-f231-4224-ac26-db5fbdedefe4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1068433324", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc094456-8e", "ovs_interfaceid": "cc094456-8e0d-4269-b99b-5bfd5297a4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.network.os_vif_util [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:5a:1c,bridge_name='br-int',has_traffic_filtering=True,id=cc094456-8e0d-4269-b99b-5bfd5297a4f7,network=Network(a62f6239-f231-4224-ac26-db5fbdedefe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc094456-8e') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG os_vif [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:5a:1c,bridge_name='br-int',has_traffic_filtering=True,id=cc094456-8e0d-4269-b99b-5bfd5297a4f7,network=Network(a62f6239-f231-4224-ac26-db5fbdedefe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc094456-8e') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc094456-8e, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:19:25 user nova-compute[72849]: INFO os_vif [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:5a:1c,bridge_name='br-int',has_traffic_filtering=True,id=cc094456-8e0d-4269-b99b-5bfd5297a4f7,network=Network(a62f6239-f231-4224-ac26-db5fbdedefe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc094456-8e')
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [req-f91ee1c9-9a4c-4f1a-a652-7c8fc529d6c5 req-bbc29f55-479a-4ca9-995d-654356dadb13 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:19:25 user nova-compute[72849]:   <nova:package version="0.0.0"/>
Aug 15 16:19:25 user nova-compute[72849]:   <nova:name>tempest-device-tagging-server-215597638</nova:name>
Aug 15 16:19:25 user nova-compute[72849]:   <nova:creationTime>2023-08-15 16:19:25</nova:creationTime>
Aug 15 16:19:25 user nova-compute[72849]:   <nova:flavor name="m1.tiny">
Aug 15 16:19:25 user nova-compute[72849]:     <nova:memory>512</nova:memory>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:disk>1</nova:disk>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:swap>0</nova:swap>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:vcpus>1</nova:vcpus>
Aug 15 16:19:25 user nova-compute[72849]:   </nova:flavor>
Aug 15 16:19:25 user nova-compute[72849]:   <nova:owner>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:user uuid="9a442003f0164870905327b6b5f1a0b2">tempest-TaggedAttachmentsTest-415257394-project-member</nova:user>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:project uuid="de78e6bddce4402d9829b94e9bd6cf05">tempest-TaggedAttachmentsTest-415257394</nova:project>
Aug 15 16:19:25 user nova-compute[72849]:   </nova:owner>
Aug 15 16:19:25 user nova-compute[72849]:   <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:19:25 user nova-compute[72849]:   <nova:ports>
Aug 15 16:19:25 user nova-compute[72849]:     <nova:port uuid="888d8da9-c8a5-40fd-a421-1a8ec1890f25">
Aug 15 16:19:25 user nova-compute[72849]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:19:25 user nova-compute[72849]:     </nova:port>
Aug 15 16:19:25 user nova-compute[72849]:   </nova:ports>
Aug 15 16:19:25 user nova-compute[72849]: </nova:instance>
Aug 15 16:19:25 user nova-compute[72849]:  {{(pid=72849) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.compute.manager [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Updating instance_info_cache with network_info: [{"id": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "address": "fa:16:3e:7d:a6:b4", "network": {"id": "2d0a7c86-1e60-4ea6-93d7-c66b552d95e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1960989403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888d8da9-c8", "ovs_interfaceid": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Releasing lock "refresh_cache-7d843493-eda8-46a9-bb1b-3cc80eed7488" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:25 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:19:25 user nova-compute[72849]: INFO nova.compute.claims [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Claim successful on node user
Aug 15 16:19:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c47d6eea-bf8d-4131-a26e-c2a9658cad57 tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "interface-7d843493-eda8-46a9-bb1b-3cc80eed7488-cc094456-8e0d-4269-b99b-5bfd5297a4f7" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.429s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23333386430653731', 'path': '/dev/sde'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333386430653731', 'path': '/dev/sde'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:19:26 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Lazy-loading 'flavor' on Instance uuid 5c64c95c-74b3-4883-94d2-ee99ff27434e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:26 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:19:26 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:19:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:19:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:19:26 user nova-compute[72849]: DEBUG nova.network.neutron [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:19:26 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:19:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:19:26 user nova-compute[72849]: INFO nova.virt.block_device [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Booting with blank volume at /dev/vda
Aug 15 16:19:26 user nova-compute[72849]: DEBUG nova.policy [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd6279423b7f43c4aac7956aec43efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51f800c0ca74e149a2f8ed9718b221f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:19:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:19:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-5c89c562-83c5-407a-b0fa-cce4f118ed80 req-c9b0ab0e-42f9-4c33-8571-edf8618ab538 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received event network-vif-plugged-cc094456-8e0d-4269-b99b-5bfd5297a4f7 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5c89c562-83c5-407a-b0fa-cce4f118ed80 req-c9b0ab0e-42f9-4c33-8571-edf8618ab538 service nova] Acquiring lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5c89c562-83c5-407a-b0fa-cce4f118ed80 req-c9b0ab0e-42f9-4c33-8571-edf8618ab538 service nova] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5c89c562-83c5-407a-b0fa-cce4f118ed80 req-c9b0ab0e-42f9-4c33-8571-edf8618ab538 service nova] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-5c89c562-83c5-407a-b0fa-cce4f118ed80 req-c9b0ab0e-42f9-4c33-8571-edf8618ab538 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] No waiting events found dispatching network-vif-plugged-cc094456-8e0d-4269-b99b-5bfd5297a4f7 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:26 user nova-compute[72849]: WARNING nova.compute.manager [req-5c89c562-83c5-407a-b0fa-cce4f118ed80 req-c9b0ab0e-42f9-4c33-8571-edf8618ab538 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received unexpected event network-vif-plugged-cc094456-8e0d-4269-b99b-5bfd5297a4f7 for instance with vm_state active and task_state None.
Aug 15 16:19:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] COPY block job progress, current cursor: 168820736 final cursor: 1073741824 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:19:26 user nova-compute[72849]: DEBUG nova.network.neutron [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Successfully created port: 993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:19:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] COPY block job progress, current cursor: 336592896 final cursor: 1073741824 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:19:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] COPY block job progress, current cursor: 503316480 final cursor: 1073741824 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:19:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] COPY block job progress, current cursor: 667942912 final cursor: 1073741824 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:19:28 user nova-compute[72849]: DEBUG nova.network.neutron [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Successfully updated port: 993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:19:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "refresh_cache-84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:19:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquired lock "refresh_cache-84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:19:28 user nova-compute[72849]: DEBUG nova.network.neutron [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:19:28 user nova-compute[72849]: DEBUG nova.compute.manager [req-7f4d8355-c276-40fa-b1bc-34b0fe8dfc2f req-842c1263-26e0-4783-a52c-35b56675488f service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-changed-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:28 user nova-compute[72849]: DEBUG nova.compute.manager [req-7f4d8355-c276-40fa-b1bc-34b0fe8dfc2f req-842c1263-26e0-4783-a52c-35b56675488f service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Refreshing instance network info cache due to event network-changed-993c798d-2a87-4ee5-80ea-484b8848ca54. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:19:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7f4d8355-c276-40fa-b1bc-34b0fe8dfc2f req-842c1263-26e0-4783-a52c-35b56675488f service nova] Acquiring lock "refresh_cache-84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:19:28 user nova-compute[72849]: DEBUG nova.network.neutron [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:19:29 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] COPY block job progress, current cursor: 789577728 final cursor: 1073741824 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:19:29 user nova-compute[72849]: DEBUG nova.network.neutron [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Updating instance_info_cache with network_info: [{"id": "993c798d-2a87-4ee5-80ea-484b8848ca54", "address": "fa:16:3e:e2:8e:fc", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993c798d-2a", "ovs_interfaceid": "993c798d-2a87-4ee5-80ea-484b8848ca54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:19:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Releasing lock "refresh_cache-84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:19:29 user nova-compute[72849]: DEBUG nova.compute.manager [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Instance network_info: |[{"id": "993c798d-2a87-4ee5-80ea-484b8848ca54", "address": "fa:16:3e:e2:8e:fc", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993c798d-2a", "ovs_interfaceid": "993c798d-2a87-4ee5-80ea-484b8848ca54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:19:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7f4d8355-c276-40fa-b1bc-34b0fe8dfc2f req-842c1263-26e0-4783-a52c-35b56675488f service nova] Acquired lock "refresh_cache-84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:19:29 user nova-compute[72849]: DEBUG nova.network.neutron [req-7f4d8355-c276-40fa-b1bc-34b0fe8dfc2f req-842c1263-26e0-4783-a52c-35b56675488f service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Refreshing network info cache for port 993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:19:29 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] COPY block job progress, current cursor: 976224256 final cursor: 1073741824 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:19:29 user nova-compute[72849]: DEBUG nova.network.neutron [req-7f4d8355-c276-40fa-b1bc-34b0fe8dfc2f req-842c1263-26e0-4783-a52c-35b56675488f service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Updated VIF entry in instance network info cache for port 993c798d-2a87-4ee5-80ea-484b8848ca54. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:19:29 user nova-compute[72849]: DEBUG nova.network.neutron [req-7f4d8355-c276-40fa-b1bc-34b0fe8dfc2f req-842c1263-26e0-4783-a52c-35b56675488f service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Updating instance_info_cache with network_info: [{"id": "993c798d-2a87-4ee5-80ea-484b8848ca54", "address": "fa:16:3e:e2:8e:fc", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993c798d-2a", "ovs_interfaceid": "993c798d-2a87-4ee5-80ea-484b8848ca54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:19:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7f4d8355-c276-40fa-b1bc-34b0fe8dfc2f req-842c1263-26e0-4783-a52c-35b56675488f service nova] Releasing lock "refresh_cache-84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:19:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZkqEjfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:30 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cbce88-0fa9-4f49-b9d3-99a7b07450ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c833fe-67a0-49be-ab4e-559b2d7b0342]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:30 user nova-compute[72849]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:30 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:30 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:30 user nova-compute[72849]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:30 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:30 user nova-compute[72849]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:30 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:30 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:30 user nova-compute[72849]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:30 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3780b8040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d'): ({'sdg'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Removing single pathed devices sdg {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48331fe-cd87-45c7-9609-f2b568fea5c0]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dd60df-18ea-401f-b240-86b8ff49c160]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Flushing IO for device /dev/sdg {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dfb7c3-c448-4188-a28b-3a650ae41c9b]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfe4fcd-62ea-43fe-b9dc-a18c0d8121e2]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] SCSI volumes sdg have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[22af31af-992a-4e80-86d8-3623e5ec5ce5]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1a4955-512a-4895-8a36-370e86f620c5]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d, portal: 172.16.0.220,3260]
Aug 15 16:19:30 user nova-compute[72849]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d, portal: 172.16.0.220,3260] successful.
Aug 15 16:19:30 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[18704a21-a446-4978-ab39-a3a97c24b095]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] <== disconnect_volume: return (286ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJwpUeoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '5c64c95c-74b3-4883-94d2-ee99ff27434e', 'attached_at': '', 'detached_at': '', 'volume_id': '85d5ae6c-b97b-43e9-89b3-11c3b6a0e135', 'serial'} {{(pid=72849) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 15 16:19:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] swap_volume: removing Cinder connection for volume f5c8896d-2002-4d25-8300-3baccb73538d {{(pid=72849) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 15 16:19:31 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] swap_volume: Updating volume f5c8896d-2002-4d25-8300-3baccb73538d BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "QJwpUeoR", "auth_password": "8hXgcwDqf71Aos", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "85d5ae6c-b97b-43e9-89b3-11c3b6a0e135"}, "status": "reserved", "instance": "5c64c95c-74b3-4883-94d2-ee99ff27434e", "attached_at": "", "detached_at": "", "volume_id": "85d5ae6c-b97b-43e9-89b3-11c3b6a0e135", "serial": "85d5ae6c-b97b-43e9-89b3-11c3b6a0e135"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '85d5ae6c-b97b-43e9-89b3-11c3b6a0e135', 'no_device': None, 'attachment_id': '08814a67-87e8-4bab-aa6b-ac7c0452b6d1'} {{(pid=72849) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 15 16:19:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ab6ab70c-26f7-4afe-a8c7-bb4d346c8696 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.519s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG os_brick.utils [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b84df7-35ad-42b8-a1ed-ac1a7e965f7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b67e515-8577-449b-b6c4-5ea867d8fef6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1561d17-3dd0-405e-a586-2c6d03ac8648]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4988e6-3fb8-4b3c-a417-e88bc0e136f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116357.1022794, c47e8572-bf45-4f91-9ca7-2dbee7972113 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:19:32 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] VM Stopped (Lifecycle Event)
Aug 15 16:19:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:19:32 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc13dab-5870-4d81-8774-68213bfad632]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG os_brick.utils [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Updating existing volume attachment record: 3f409899-2268-4180-b4dd-fe1b16ddffb2 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-b1c352c4-fe48-4f84-abc5-2792067d4d2d None None] [instance: c47e8572-bf45-4f91-9ca7-2dbee7972113] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Acquiring lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG os_brick.utils [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c76367-abfc-4fe1-8999-c56381370c38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d9a295-1972-4c55-89fc-63de56ffc145]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a5ff75-4942-44d5-a8b2-19d463f9b37d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[78df3d34-7994-47df-94cf-13ed2e3c80c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:19:32 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:19:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a63de09-112b-48a9-a481-012722c8d901]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG os_brick.utils [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:32 user nova-compute[72849]: INFO nova.compute.manager [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Swapping volume 85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 for f5c8896d-2002-4d25-8300-3baccb73538d
Aug 15 16:19:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updating instance_info_cache with network_info: [{"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:19:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:19:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:19:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:19:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:38 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:19:38 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:19:38 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=6980MB free_disk=25.504047393798828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b0a869eb-9ee8-4c31-9786-5b8be7d362a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 341edacc-b44b-4d92-9fcd-982c252fcdd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 7d843493-eda8-46a9-bb1b-3cc80eed7488 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 3954da38-0292-40f7-8ace-6987d0248a44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 5c64c95c-74b3-4883-94d2-ee99ff27434e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 40d69bd5-67c0-4b3c-8615-6660145b61fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 8aa1e777-f613-457a-9458-d36b2b6010e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 3a3a822c-230a-47a6-9658-8879957455de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:19:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-9d9ac8c1-ac4a-4a08-b928-b77ee51a5ab0 req-0cddd880-5624-453f-8a9c-456a417aeeab service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-changed-3e960116-61a7-4ee5-9eb6-72c9a60f0657 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-9d9ac8c1-ac4a-4a08-b928-b77ee51a5ab0 req-0cddd880-5624-453f-8a9c-456a417aeeab service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Refreshing instance network info cache due to event network-changed-3e960116-61a7-4ee5-9eb6-72c9a60f0657. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:19:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9d9ac8c1-ac4a-4a08-b928-b77ee51a5ab0 req-0cddd880-5624-453f-8a9c-456a417aeeab service nova] Acquiring lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:19:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9d9ac8c1-ac4a-4a08-b928-b77ee51a5ab0 req-0cddd880-5624-453f-8a9c-456a417aeeab service nova] Acquired lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:19:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-9d9ac8c1-ac4a-4a08-b928-b77ee51a5ab0 req-0cddd880-5624-453f-8a9c-456a417aeeab service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Refreshing network info cache for port 3e960116-61a7-4ee5-9eb6-72c9a60f0657 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:19:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-9d9ac8c1-ac4a-4a08-b928-b77ee51a5ab0 req-0cddd880-5624-453f-8a9c-456a417aeeab service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Updated VIF entry in instance network info cache for port 3e960116-61a7-4ee5-9eb6-72c9a60f0657. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:19:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-9d9ac8c1-ac4a-4a08-b928-b77ee51a5ab0 req-0cddd880-5624-453f-8a9c-456a417aeeab service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Updating instance_info_cache with network_info: [{"id": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "address": "fa:16:3e:7b:f7:02", "network": {"id": "5b2340e6-1701-4cd9-b55a-22a560dfe14f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1630894672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e960116-61", "ovs_interfaceid": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "869edc66-112a-4313-a86a-786335d36b51", "address": "fa:16:3e:22:06:6c", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869edc66-11", "ovs_interfaceid": "869edc66-112a-4313-a86a-786335d36b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37e52690-0504-4905-9c66-32f05b9ca665", "address": "fa:16:3e:fd:30:f1", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e52690-05", "ovs_interfaceid": "37e52690-0504-4905-9c66-32f05b9ca665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74249c5d-642c-48c3-aa3e-79f9165580bc", "address": "fa:16:3e:68:02:91", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74249c5d-64", "ovs_interfaceid": "74249c5d-642c-48c3-aa3e-79f9165580bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "address": "fa:16:3e:cf:22:4a", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f4af0d-01", "ovs_interfaceid": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "address": "fa:16:3e:83:44:49", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c779d1d-1b", "ovs_interfaceid": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "address": "fa:16:3e:ae:f3:b3", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0000b5-95", "ovs_interfaceid": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:19:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9d9ac8c1-ac4a-4a08-b928-b77ee51a5ab0 req-0cddd880-5624-453f-8a9c-456a417aeeab service nova] Releasing lock "refresh_cache-40d69bd5-67c0-4b3c-8615-6660145b61fb" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:19:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:41 user nova-compute[72849]: INFO nova.compute.manager [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Terminating instance
Aug 15 16:19:41 user nova-compute[72849]: DEBUG nova.compute.manager [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:19:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.compute.manager [req-2238e989-19cf-4152-bb58-4c8174f12251 req-426943a4-de6e-4226-999d-1083e75c091a service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-unplugged-3e960116-61a7-4ee5-9eb6-72c9a60f0657 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2238e989-19cf-4152-bb58-4c8174f12251 req-426943a4-de6e-4226-999d-1083e75c091a service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2238e989-19cf-4152-bb58-4c8174f12251 req-426943a4-de6e-4226-999d-1083e75c091a service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2238e989-19cf-4152-bb58-4c8174f12251 req-426943a4-de6e-4226-999d-1083e75c091a service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.compute.manager [req-2238e989-19cf-4152-bb58-4c8174f12251 req-426943a4-de6e-4226-999d-1083e75c091a service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-unplugged-3e960116-61a7-4ee5-9eb6-72c9a60f0657 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.compute.manager [req-2238e989-19cf-4152-bb58-4c8174f12251 req-426943a4-de6e-4226-999d-1083e75c091a service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-unplugged-3e960116-61a7-4ee5-9eb6-72c9a60f0657 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:19:42 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Creating image(s)
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Did not create local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Ensure instance console log exists: /opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Start _get_guest_xml network_info=[{"id": "993c798d-2a87-4ee5-80ea-484b8848ca54", "address": "fa:16:3e:e2:8e:fc", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993c798d-2a", "ovs_interfaceid": "993c798d-2a87-4ee5-80ea-484b8848ca54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDEiHUZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84b77d6c-5e6f-4fee-81fd-d58ee58b06ab', 'attached_at': '', 'detached_at': '', 'volume_id': '54a80adf-5b9b-4aa2-91d2-22f75686aead', 'serial': '54a80adf-5b9b-4aa2-91d2-22f75686aead'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '3f409899-2268-4180-b4dd-fe1b16ddffb2', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:42 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:19:42 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDEiHUZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:42 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:42 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:42 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:19:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.compute.manager [req-c2df06a7-596a-4793-a496-a44cd6df00c6 req-40534974-ad24-4df8-a2bd-1c329c3f7750 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-unplugged-869edc66-112a-4313-a86a-786335d36b51 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c2df06a7-596a-4793-a496-a44cd6df00c6 req-40534974-ad24-4df8-a2bd-1c329c3f7750 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c2df06a7-596a-4793-a496-a44cd6df00c6 req-40534974-ad24-4df8-a2bd-1c329c3f7750 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c2df06a7-596a-4793-a496-a44cd6df00c6 req-40534974-ad24-4df8-a2bd-1c329c3f7750 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.compute.manager [req-c2df06a7-596a-4793-a496-a44cd6df00c6 req-40534974-ad24-4df8-a2bd-1c329c3f7750 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-unplugged-869edc66-112a-4313-a86a-786335d36b51 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.compute.manager [req-c2df06a7-596a-4793-a496-a44cd6df00c6 req-40534974-ad24-4df8-a2bd-1c329c3f7750 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-unplugged-869edc66-112a-4313-a86a-786335d36b51 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6833569f-f168-4109-8ba6-9c9cae52dc7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:19:42 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[58584963-8535-43f0-8643-93dedbd23cb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead] added
Aug 15 16:19:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5a7356-8be7-423a-9990-8da9ca4c4e9b]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0200e0-4e08-424a-871c-ef5fa011c5c1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IDEiHUZh {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IDEiHUZh" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8897bc08-eafb-44fb-8406-0067ab3b3f8d]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IDEiHUZh'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8f4361-726e-441f-a2e2-4b28e5012c88]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c3de7f-91d4-4e61-91ef-ed0e2618fbb3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:42 user nova-compute[72849]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:42 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:42 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:42 user nova-compute[72849]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:42 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:42 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[74991618-9d5f-4949-ad20-58a8d47b9dc6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead, portal: 172.16.0.220,3260]
Aug 15 16:19:42 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead, portal: 172.16.0.220,3260] successful.
Aug 15 16:19:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cf384e-3166-4d4e-9bcb-51788a71472e]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b36b80e-fa7e-4d05-a6b2-a18fa9225b24]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:42 user nova-compute[72849]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:19:42 user nova-compute[72849]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:42 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:42 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:42 user nova-compute[72849]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:19:42 user nova-compute[72849]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:42 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:42 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZkqEjfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5c64c95c-74b3-4883-94d2-ee99ff27434e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5c8896d-2002-4d25-8300-3baccb73538d', 'serial': 'f5c8896d-2002-4d25-8300-3baccb73538d'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJwpUeoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '85d5ae6c-b97b-43e9-89b3-11c3b6a0e135'}, 'status': 'reserved', 'instance': '5c64c95c-74b3-4883-94d2-ee99ff27434e', 'attached_at': '', 'detached_at': '', 'volume_id': '85d5ae6c-b97b-43e9-89b3-11c3b6a0e135', 'serial'} {{(pid=72849) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZkqEjfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:42 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[56157de4-cd74-454d-bbde-71ac386a1a5a]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDEiHUZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Instance destroyed successfully.
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.objects.instance [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lazy-loading 'resources' on Instance uuid 40d69bd5-67c0-4b3c-8615-6660145b61fb {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:18:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:18:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "address": "fa:16:3e:7b:f7:02", "network": {"id": "5b2340e6-1701-4cd9-b55a-22a560dfe14f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1630894672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e960116-61", "ovs_interfaceid": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "address": "fa:16:3e:7b:f7:02", "network": {"id": "5b2340e6-1701-4cd9-b55a-22a560dfe14f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1630894672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e960116-61", "ovs_interfaceid": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=3e960116-61a7-4ee5-9eb6-72c9a60f0657,network=Network(5b2340e6-1701-4cd9-b55a-22a560dfe14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e960116-61') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=3e960116-61a7-4ee5-9eb6-72c9a60f0657,network=Network(5b2340e6-1701-4cd9-b55a-22a560dfe14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e960116-61') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e960116-61, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: INFO os_vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=3e960116-61a7-4ee5-9eb6-72c9a60f0657,network=Network(5b2340e6-1701-4cd9-b55a-22a560dfe14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e960116-61')
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:18:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:18:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "869edc66-112a-4313-a86a-786335d36b51", "address": "fa:16:3e:22:06:6c", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869edc66-11", "ovs_interfaceid": "869edc66-112a-4313-a86a-786335d36b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "869edc66-112a-4313-a86a-786335d36b51", "address": "fa:16:3e:22:06:6c", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869edc66-11", "ovs_interfaceid": "869edc66-112a-4313-a86a-786335d36b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:06:6c,bridge_name='br-int',has_traffic_filtering=True,id=869edc66-112a-4313-a86a-786335d36b51,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap869edc66-11') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:06:6c,bridge_name='br-int',has_traffic_filtering=True,id=869edc66-112a-4313-a86a-786335d36b51,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap869edc66-11') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap869edc66-11, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: INFO os_vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:06:6c,bridge_name='br-int',has_traffic_filtering=True,id=869edc66-112a-4313-a86a-786335d36b51,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap869edc66-11')
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:18:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:18:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37e52690-0504-4905-9c66-32f05b9ca665", "address": "fa:16:3e:fd:30:f1", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e52690-05", "ovs_interfaceid": "37e52690-0504-4905-9c66-32f05b9ca665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "37e52690-0504-4905-9c66-32f05b9ca665", "address": "fa:16:3e:fd:30:f1", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e52690-05", "ovs_interfaceid": "37e52690-0504-4905-9c66-32f05b9ca665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:f1,bridge_name='br-int',has_traffic_filtering=True,id=37e52690-0504-4905-9c66-32f05b9ca665,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37e52690-05') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:f1,bridge_name='br-int',has_traffic_filtering=True,id=37e52690-0504-4905-9c66-32f05b9ca665,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37e52690-05') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37e52690-05, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23462333561613439', 'path': '/dev/sdf'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462333561613439', 'path': '/dev/sdf'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.023s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:43 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:43 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: INFO os_vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:f1,bridge_name='br-int',has_traffic_filtering=True,id=37e52690-0504-4905-9c66-32f05b9ca665,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37e52690-05')
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:18:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:18:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74249c5d-642c-48c3-aa3e-79f9165580bc", "address": "fa:16:3e:68:02:91", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74249c5d-64", "ovs_interfaceid": "74249c5d-642c-48c3-aa3e-79f9165580bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "74249c5d-642c-48c3-aa3e-79f9165580bc", "address": "fa:16:3e:68:02:91", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74249c5d-64", "ovs_interfaceid": "74249c5d-642c-48c3-aa3e-79f9165580bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:02:91,bridge_name='br-int',has_traffic_filtering=True,id=74249c5d-642c-48c3-aa3e-79f9165580bc,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74249c5d-64') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:02:91,bridge_name='br-int',has_traffic_filtering=True,id=74249c5d-642c-48c3-aa3e-79f9165580bc,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74249c5d-64') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb027c60-d823-483d-a74f-f90ce87e8438]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:19:43 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-403650730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-403650730',id=13,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f51f800c0ca74e149a2f8ed9718b221f',ramdisk_id='',reservation_id='r-xr5wu3j2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:19:26Z,user_data=None,user_id='cd6279423b7f43c4aac7956aec43efdd',uuid=84b77d6c-5e6f-4fee-81fd-d58ee58b06ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "993c798d-2a87-4ee5-80ea-484b8848ca54", "address": "fa:16:3e:e2:8e:fc", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993c798d-2a", "ovs_interfaceid": "993c798d-2a87-4ee5-80ea-484b8848ca54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converting VIF {"id": "993c798d-2a87-4ee5-80ea-484b8848ca54", "address": "fa:16:3e:e2:8e:fc", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993c798d-2a", "ovs_interfaceid": "993c798d-2a87-4ee5-80ea-484b8848ca54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=993c798d-2a87-4ee5-80ea-484b8848ca54,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993c798d-2a') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.objects.instance [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'pci_devices' on Instance uuid 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74249c5d-64, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:19:43 user nova-compute[72849]:   <uuid>84b77d6c-5e6f-4fee-81fd-d58ee58b06ab</uuid>
Aug 15 16:19:43 user nova-compute[72849]:   <name>instance-0000000d</name>
Aug 15 16:19:43 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:19:43 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:19:43 user nova-compute[72849]:   <metadata>
Aug 15 16:19:43 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:19:43 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:19:43 user nova-compute[72849]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-403650730</nova:name>
Aug 15 16:19:43 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:19:42</nova:creationTime>
Aug 15 16:19:43 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:19:43 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:19:43 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:19:43 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:19:43 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:19:43 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:19:43 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:19:43 user nova-compute[72849]:       <nova:owner>
Aug 15 16:19:43 user nova-compute[72849]:         <nova:user uuid="cd6279423b7f43c4aac7956aec43efdd">tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member</nova:user>
Aug 15 16:19:43 user nova-compute[72849]:         <nova:project uuid="f51f800c0ca74e149a2f8ed9718b221f">tempest-ServerBootFromVolumeStableRescueTest-1207284584</nova:project>
Aug 15 16:19:43 user nova-compute[72849]:       </nova:owner>
Aug 15 16:19:43 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:19:43 user nova-compute[72849]:       <nova:ports>
Aug 15 16:19:43 user nova-compute[72849]:         <nova:port uuid="993c798d-2a87-4ee5-80ea-484b8848ca54">
Aug 15 16:19:43 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 16:19:43 user nova-compute[72849]:         </nova:port>
Aug 15 16:19:43 user nova-compute[72849]:       </nova:ports>
Aug 15 16:19:43 user nova-compute[72849]:     </nova:instance>
Aug 15 16:19:43 user nova-compute[72849]:   </metadata>
Aug 15 16:19:43 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:19:43 user nova-compute[72849]:     <system>
Aug 15 16:19:43 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:19:43 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:19:43 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:19:43 user nova-compute[72849]:       <entry name="serial">84b77d6c-5e6f-4fee-81fd-d58ee58b06ab</entry>
Aug 15 16:19:43 user nova-compute[72849]:       <entry name="uuid">84b77d6c-5e6f-4fee-81fd-d58ee58b06ab</entry>
Aug 15 16:19:43 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:19:43 user nova-compute[72849]:     </system>
Aug 15 16:19:43 user nova-compute[72849]:   </sysinfo>
Aug 15 16:19:43 user nova-compute[72849]:   <os>
Aug 15 16:19:43 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:19:43 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:19:43 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:19:43 user nova-compute[72849]:   </os>
Aug 15 16:19:43 user nova-compute[72849]:   <features>
Aug 15 16:19:43 user nova-compute[72849]:     <acpi/>
Aug 15 16:19:43 user nova-compute[72849]:     <apic/>
Aug 15 16:19:43 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:19:43 user nova-compute[72849]:   </features>
Aug 15 16:19:43 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:19:43 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:19:43 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:19:43 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:19:43 user nova-compute[72849]:   </clock>
Aug 15 16:19:43 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:19:43 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:19:43 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:19:43 user nova-compute[72849]:   </cpu>
Aug 15 16:19:43 user nova-compute[72849]:   <devices>
Aug 15 16:19:43 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:19:43 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:19:43 user nova-compute[72849]:       <source dev="/dev/sdf"/>
Aug 15 16:19:43 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:19:43 user nova-compute[72849]:       <serial>54a80adf-5b9b-4aa2-91d2-22f75686aead</serial>
Aug 15 16:19:43 user nova-compute[72849]:     </disk>
Aug 15 16:19:43 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:19:43 user nova-compute[72849]:       <mac address="fa:16:3e:e2:8e:fc"/>
Aug 15 16:19:43 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:19:43 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:19:43 user nova-compute[72849]:       <target dev="tap993c798d-2a"/>
Aug 15 16:19:43 user nova-compute[72849]:     </interface>
Aug 15 16:19:43 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:19:43 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab/console.log" append="off"/>
Aug 15 16:19:43 user nova-compute[72849]:     </serial>
Aug 15 16:19:43 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:19:43 user nova-compute[72849]:     <video>
Aug 15 16:19:43 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:19:43 user nova-compute[72849]:     </video>
Aug 15 16:19:43 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:19:43 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:19:43 user nova-compute[72849]:     </rng>
Aug 15 16:19:43 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:19:43 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:19:43 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:19:43 user nova-compute[72849]:     </memballoon>
Aug 15 16:19:43 user nova-compute[72849]:   </devices>
Aug 15 16:19:43 user nova-compute[72849]: </domain>
Aug 15 16:19:43 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-403650730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-403650730',id=13,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f51f800c0ca74e149a2f8ed9718b221f',ramdisk_id='',reservation_id='r-xr5wu3j2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:19:26Z,user_data=None,user_id='cd6279423b7f43c4aac7956aec43efdd',uuid=84b77d6c-5e6f-4fee-81fd-d58ee58b06ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "993c798d-2a87-4ee5-80ea-484b8848ca54", "address": "fa:16:3e:e2:8e:fc", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993c798d-2a", "ovs_interfaceid": "993c798d-2a87-4ee5-80ea-484b8848ca54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converting VIF {"id": "993c798d-2a87-4ee5-80ea-484b8848ca54", "address": "fa:16:3e:e2:8e:fc", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993c798d-2a", "ovs_interfaceid": "993c798d-2a87-4ee5-80ea-484b8848ca54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=993c798d-2a87-4ee5-80ea-484b8848ca54,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993c798d-2a') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_vif [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=993c798d-2a87-4ee5-80ea-484b8848ca54,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993c798d-2a') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea35f1e-9939-4a0d-a0b7-2637c009f9ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d] added
Aug 15 16:19:43 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:19:43 user nova-compute[72849]: INFO os_vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:02:91,bridge_name='br-int',has_traffic_filtering=True,id=74249c5d-642c-48c3-aa3e-79f9165580bc,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74249c5d-64')
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:18:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:18:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "address": "fa:16:3e:cf:22:4a", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f4af0d-01", "ovs_interfaceid": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "address": "fa:16:3e:cf:22:4a", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f4af0d-01", "ovs_interfaceid": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:22:4a,bridge_name='br-int',has_traffic_filtering=True,id=68f4af0d-01e5-4950-b08a-c8454b09dd3e,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f4af0d-01') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:22:4a,bridge_name='br-int',has_traffic_filtering=True,id=68f4af0d-01e5-4950-b08a-c8454b09dd3e,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f4af0d-01') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68f4af0d-01, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f655e850-0ef5-4dfc-8c69-d1eb7630a097]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap993c798d-2a, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap993c798d-2a, col_values=(('external_ids', {'iface-id': '993c798d-2a87-4ee5-80ea-484b8848ca54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:8e:fc', 'vm-uuid': '84b77d6c-5e6f-4fee-81fd-d58ee58b06ab'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c17d4ae-1e10-48ff-a928-706089d00cd2]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:43 user nova-compute[72849]: INFO os_vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:22:4a,bridge_name='br-int',has_traffic_filtering=True,id=68f4af0d-01e5-4950-b08a-c8454b09dd3e,network=Network(0a8736fd-3f7b-4f9a-aca0-ff4df8449951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f4af0d-01')
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:18:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:18:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "address": "fa:16:3e:83:44:49", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c779d1d-1b", "ovs_interfaceid": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "address": "fa:16:3e:83:44:49", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c779d1d-1b", "ovs_interfaceid": "3c779d1d-1bdc-4614-b153-60d32915a3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:44:49,bridge_name='br-int',has_traffic_filtering=True,id=3c779d1d-1bdc-4614-b153-60d32915a3b9,network=Network(10a3e942-8148-4a73-9d5f-353e9c05b95b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c779d1d-1b') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:44:49,bridge_name='br-int',has_traffic_filtering=True,id=3c779d1d-1bdc-4614-b153-60d32915a3b9,network=Network(10a3e942-8148-4a73-9d5f-353e9c05b95b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c779d1d-1b') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GZkqEjfB {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GZkqEjfB" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[755f081b-98ae-4105-872d-a291f6b05041]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GZkqEjfB'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: INFO os_vif [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=993c798d-2a87-4ee5-80ea-484b8848ca54,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993c798d-2a')
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c779d1d-1b, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fbec38-b4ec-4ed0-873b-9efd2f1f073c]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: INFO os_vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:44:49,bridge_name='br-int',has_traffic_filtering=True,id=3c779d1d-1bdc-4614-b153-60d32915a3b9,network=Network(10a3e942-8148-4a73-9d5f-353e9c05b95b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c779d1d-1b')
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-77370635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-77370635',id=10,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuGdl2D5EzVB/0Bf+sQhAfuaH3rqVt6IBxSgdf/bBmVMtTemiGhmX2oWIf69dgBb72Qg+DRJ85xo7VUQcqo30+dDWU+27JGjGE4mwhAuJxRPAR+lktRKKSaFQCeV3bnw==',key_name='tempest-keypair-1817945712',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:18:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d504c6bf4d1e40f89105b6bb868fbb28',ramdisk_id='',reservation_id='r-3hviitn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1229052876',owner_user_name='tempest-TaggedBootDevicesTest-1229052876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:18:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7af94d2a9ff14736ad788d175f392cc9',uuid=40d69bd5-67c0-4b3c-8615-6660145b61fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "address": "fa:16:3e:ae:f3:b3", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0000b5-95", "ovs_interfaceid": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converting VIF {"id": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "address": "fa:16:3e:ae:f3:b3", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0000b5-95", "ovs_interfaceid": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:f3:b3,bridge_name='br-int',has_traffic_filtering=True,id=be0000b5-95ec-4f3f-9344-3754b9f63a3d,network=Network(10a3e942-8148-4a73-9d5f-353e9c05b95b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0000b5-95') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:f3:b3,bridge_name='br-int',has_traffic_filtering=True,id=be0000b5-95ec-4f3f-9344-3754b9f63a3d,network=Network(10a3e942-8148-4a73-9d5f-353e9c05b95b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0000b5-95') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe0000b5-95, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded6bfa2-1fcd-4ed8-8f16-1c60cea077dd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:43 user nova-compute[72849]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:19:43 user nova-compute[72849]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:43 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:43 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:43 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:43 user nova-compute[72849]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:19:43 user nova-compute[72849]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:43 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:43 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:43 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:43 user nova-compute[72849]: INFO os_vif [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:f3:b3,bridge_name='br-int',has_traffic_filtering=True,id=be0000b5-95ec-4f3f-9344-3754b9f63a3d,network=Network(10a3e942-8148-4a73-9d5f-353e9c05b95b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0000b5-95')
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDNZanHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:43 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] No VIF found with MAC fa:16:3e:e2:8e:fc, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fb844b-ff2f-43ca-a67a-5f6a92369220]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d, portal: 172.16.0.220,3260]
Aug 15 16:19:43 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d, portal: 172.16.0.220,3260] successful.
Aug 15 16:19:43 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a77d218-5a0a-49b1-ae89-875dc093f8d3]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8b7958-3929-425e-9999-687eab2aa619]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:43 user nova-compute[72849]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:19:43 user nova-compute[72849]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:43 user nova-compute[72849]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:43 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:43 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:43 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:43 user nova-compute[72849]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:19:43 user nova-compute[72849]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:43 user nova-compute[72849]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:43 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:43 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:43 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] HCTL ('38', '-', '-', 0) found on session 12 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[506daa95-2d3b-4498-bfca-7c540bccb8c6]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:19:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZkqEjfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-3e960116-61a7-4ee5-9eb6-72c9a60f0657 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-3e960116-61a7-4ee5-9eb6-72c9a60f0657 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:44 user nova-compute[72849]: WARNING nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-3e960116-61a7-4ee5-9eb6-72c9a60f0657 for instance with vm_state active and task_state deleting.
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-unplugged-37e52690-0504-4905-9c66-32f05b9ca665 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-unplugged-37e52690-0504-4905-9c66-32f05b9ca665 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-unplugged-37e52690-0504-4905-9c66-32f05b9ca665 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-37e52690-0504-4905-9c66-32f05b9ca665 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-37e52690-0504-4905-9c66-32f05b9ca665 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:44 user nova-compute[72849]: WARNING nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-37e52690-0504-4905-9c66-32f05b9ca665 for instance with vm_state active and task_state deleting.
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-unplugged-74249c5d-642c-48c3-aa3e-79f9165580bc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-unplugged-74249c5d-642c-48c3-aa3e-79f9165580bc {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-unplugged-74249c5d-642c-48c3-aa3e-79f9165580bc for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-74249c5d-642c-48c3-aa3e-79f9165580bc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-74249c5d-642c-48c3-aa3e-79f9165580bc {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:44 user nova-compute[72849]: WARNING nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-74249c5d-642c-48c3-aa3e-79f9165580bc for instance with vm_state active and task_state deleting.
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-unplugged-68f4af0d-01e5-4950-b08a-c8454b09dd3e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-unplugged-68f4af0d-01e5-4950-b08a-c8454b09dd3e {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-unplugged-68f4af0d-01e5-4950-b08a-c8454b09dd3e for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-68f4af0d-01e5-4950-b08a-c8454b09dd3e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-68f4af0d-01e5-4950-b08a-c8454b09dd3e {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:44 user nova-compute[72849]: WARNING nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-68f4af0d-01e5-4950-b08a-c8454b09dd3e for instance with vm_state active and task_state deleting.
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-unplugged-3c779d1d-1bdc-4614-b153-60d32915a3b9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-unplugged-3c779d1d-1bdc-4614-b153-60d32915a3b9 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-87877b68-6959-4edb-8794-7c1adc93e5d5 req-dcca6b2a-b73f-4155-b9f1-e3ac8d5eb175 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-unplugged-3c779d1d-1bdc-4614-b153-60d32915a3b9 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-e5c2c41a-6e08-46b8-bd67-8f6e84320895 req-e3be3f28-c30e-42a1-8c72-77f277760b31 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-869edc66-112a-4313-a86a-786335d36b51 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e5c2c41a-6e08-46b8-bd67-8f6e84320895 req-e3be3f28-c30e-42a1-8c72-77f277760b31 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e5c2c41a-6e08-46b8-bd67-8f6e84320895 req-e3be3f28-c30e-42a1-8c72-77f277760b31 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e5c2c41a-6e08-46b8-bd67-8f6e84320895 req-e3be3f28-c30e-42a1-8c72-77f277760b31 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-e5c2c41a-6e08-46b8-bd67-8f6e84320895 req-e3be3f28-c30e-42a1-8c72-77f277760b31 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-869edc66-112a-4313-a86a-786335d36b51 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:44 user nova-compute[72849]: WARNING nova.compute.manager [req-e5c2c41a-6e08-46b8-bd67-8f6e84320895 req-e3be3f28-c30e-42a1-8c72-77f277760b31 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-869edc66-112a-4313-a86a-786335d36b51 for instance with vm_state active and task_state deleting.
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-e5c2c41a-6e08-46b8-bd67-8f6e84320895 req-e3be3f28-c30e-42a1-8c72-77f277760b31 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-unplugged-be0000b5-95ec-4f3f-9344-3754b9f63a3d {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e5c2c41a-6e08-46b8-bd67-8f6e84320895 req-e3be3f28-c30e-42a1-8c72-77f277760b31 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e5c2c41a-6e08-46b8-bd67-8f6e84320895 req-e3be3f28-c30e-42a1-8c72-77f277760b31 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e5c2c41a-6e08-46b8-bd67-8f6e84320895 req-e3be3f28-c30e-42a1-8c72-77f277760b31 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-e5c2c41a-6e08-46b8-bd67-8f6e84320895 req-e3be3f28-c30e-42a1-8c72-77f277760b31 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-unplugged-be0000b5-95ec-4f3f-9344-3754b9f63a3d {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-e5c2c41a-6e08-46b8-bd67-8f6e84320895 req-e3be3f28-c30e-42a1-8c72-77f277760b31 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-unplugged-be0000b5-95ec-4f3f-9344-3754b9f63a3d for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-e5c2c41a-6e08-46b8-bd67-8f6e84320895 req-e3be3f28-c30e-42a1-8c72-77f277760b31 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-be0000b5-95ec-4f3f-9344-3754b9f63a3d {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e5c2c41a-6e08-46b8-bd67-8f6e84320895 req-e3be3f28-c30e-42a1-8c72-77f277760b31 service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e5c2c41a-6e08-46b8-bd67-8f6e84320895 req-e3be3f28-c30e-42a1-8c72-77f277760b31 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e5c2c41a-6e08-46b8-bd67-8f6e84320895 req-e3be3f28-c30e-42a1-8c72-77f277760b31 service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-e5c2c41a-6e08-46b8-bd67-8f6e84320895 req-e3be3f28-c30e-42a1-8c72-77f277760b31 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-be0000b5-95ec-4f3f-9344-3754b9f63a3d {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:44 user nova-compute[72849]: WARNING nova.compute.manager [req-e5c2c41a-6e08-46b8-bd67-8f6e84320895 req-e3be3f28-c30e-42a1-8c72-77f277760b31 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-be0000b5-95ec-4f3f-9344-3754b9f63a3d for instance with vm_state active and task_state deleting.
Aug 15 16:19:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] <== connect_volume: return (2376ms) {'type': 'block', 'scsi_wwn': '23330383838326663', 'path': '/dev/sdg'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330383838326663', 'path': '/dev/sdg'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.157s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG nova.objects.instance [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Lazy-loading 'flavor' on Instance uuid 5c64c95c-74b3-4883-94d2-ee99ff27434e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e442f39d-06fd-498b-8960-8a2c722e961b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e70476-8265-44f2-8736-08b9693d4931]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:44 user nova-compute[72849]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:19:44 user nova-compute[72849]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:44 user nova-compute[72849]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:44 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:44 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:44 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:44 user nova-compute[72849]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:19:44 user nova-compute[72849]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:44 user nova-compute[72849]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 (non-flash)
Aug 15 16:19:44 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:44 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:44 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc358280b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bb4ceb-2133-4413-b95b-d8d51b07e8c1]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0ed5a8-48c9-488e-a36c-6e004aeb173b]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3590e5ac-1667-4639-967a-ffd2926c11a8]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eba433-b70d-4b2f-b397-4760ea4b2da8]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[624cbad5-c01c-4bba-ae58-31e3603bdc18]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa32f534-23d8-40e5-9c71-85a04da2eba7]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152, portal: 172.16.0.220,3260]
Aug 15 16:19:45 user nova-compute[72849]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152, portal: 172.16.0.220,3260] successful.
Aug 15 16:19:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-add87c0d-72be-4c23-836f-073bdbfa3c4b req-b41a6421-65f4-45a6-aa7b-368c5f7892d7 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-add87c0d-72be-4c23-836f-073bdbfa3c4b req-b41a6421-65f4-45a6-aa7b-368c5f7892d7 service nova] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-add87c0d-72be-4c23-836f-073bdbfa3c4b req-b41a6421-65f4-45a6-aa7b-368c5f7892d7 service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-add87c0d-72be-4c23-836f-073bdbfa3c4b req-b41a6421-65f4-45a6-aa7b-368c5f7892d7 service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-add87c0d-72be-4c23-836f-073bdbfa3c4b req-b41a6421-65f4-45a6-aa7b-368c5f7892d7 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] No waiting events found dispatching network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:45 user nova-compute[72849]: WARNING nova.compute.manager [req-add87c0d-72be-4c23-836f-073bdbfa3c4b req-b41a6421-65f4-45a6-aa7b-368c5f7892d7 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received unexpected event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 for instance with vm_state building and task_state spawning.
Aug 15 16:19:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3bddc-122f-4557-9246-1adbf93a9152 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed574043-fe0b-424c-bda7-c1ca6a544346]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] <== disconnect_volume: return (1463ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClpdcsMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:45 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05abc88-85ca-446c-b188-e367d9319d2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee4ed73-7731-48b1-83e4-99ad66f0b41c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:45 user nova-compute[72849]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:19:45 user nova-compute[72849]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:45 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:45 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:45 user nova-compute[72849]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:19:45 user nova-compute[72849]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:45 user nova-compute[72849]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 (non-flash)
Aug 15 16:19:45 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc358280b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46'): ({'sdc'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Removing single pathed devices sdc {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[63692c68-9e8b-4115-b88d-2614062739c6]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[703e9a9e-02b8-4d37-995a-478d592bb5df]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Flushing IO for device /dev/sdc {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[60059ad4-fa92-4919-8817-038bf7ccde02]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4df97e2-cd32-4bbc-a7c6-7e8a1c459940]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[482d70ff-cddc-47c6-b59f-167df6b60875]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4637d0-69dc-43ee-b6c4-d8943be7bff1]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46, portal: 172.16.0.220,3260]
Aug 15 16:19:45 user nova-compute[72849]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46, portal: 172.16.0.220,3260] successful.
Aug 15 16:19:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f1661f8-0165-4dae-86c4-fbb833894d46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4603dbf-314c-4660-be72-3db73e39dc04]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] <== disconnect_volume: return (291ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JinTwUXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:45 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5f0cc3-1e54-4673-a84b-7f7437fde185]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d05b20-f1e7-42df-8e11-3dda2b8a6401]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:45 user nova-compute[72849]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:19:45 user nova-compute[72849]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:45 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:45 user nova-compute[72849]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:19:45 user nova-compute[72849]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:45 user nova-compute[72849]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 (non-flash)
Aug 15 16:19:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc358280b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381'): ({'sdd'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Removing single pathed devices sdd {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[65361d5e-4052-450d-b9da-86bd83c67014]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b76f9e8-bc12-476a-b5dd-de73df598cb7]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Flushing IO for device /dev/sdd {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5cf04e-f94d-4837-8f3b-3933c0ef13a2]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f234812f-8421-4a20-8359-9c16e257d386]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] SCSI volumes sdd have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3002d244-ee89-4bda-b442-d8a1191829e6]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c046e66b-7b4f-4ad3-b9b9-5b0b6723e255]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381, portal: 172.16.0.220,3260]
Aug 15 16:19:45 user nova-compute[72849]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381, portal: 172.16.0.220,3260] successful.
Aug 15 16:19:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b821dc-9517-43cd-bac2-78ee1cc1c381 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5ee367-5b58-473e-a52c-4ba2dff71295]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] <== disconnect_volume: return (337ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:19:45 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Deleting instance files /opt/stack/data/nova/instances/40d69bd5-67c0-4b3c-8615-6660145b61fb_del
Aug 15 16:19:45 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Deletion of /opt/stack/data/nova/instances/40d69bd5-67c0-4b3c-8615-6660145b61fb_del complete
Aug 15 16:19:45 user nova-compute[72849]: INFO nova.compute.manager [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Took 4.33 seconds to destroy the instance on the hypervisor.
Aug 15 16:19:45 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:19:45 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:19:46 user nova-compute[72849]: DEBUG nova.compute.manager [req-d7ed73a0-d8f9-4fb9-833f-7938151c51e3 req-55473895-6306-44ec-88a0-ab38a66ee63e service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-plugged-3c779d1d-1bdc-4614-b153-60d32915a3b9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d7ed73a0-d8f9-4fb9-833f-7938151c51e3 req-55473895-6306-44ec-88a0-ab38a66ee63e service nova] Acquiring lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d7ed73a0-d8f9-4fb9-833f-7938151c51e3 req-55473895-6306-44ec-88a0-ab38a66ee63e service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d7ed73a0-d8f9-4fb9-833f-7938151c51e3 req-55473895-6306-44ec-88a0-ab38a66ee63e service nova] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:46 user nova-compute[72849]: DEBUG nova.compute.manager [req-d7ed73a0-d8f9-4fb9-833f-7938151c51e3 req-55473895-6306-44ec-88a0-ab38a66ee63e service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] No waiting events found dispatching network-vif-plugged-3c779d1d-1bdc-4614-b153-60d32915a3b9 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:46 user nova-compute[72849]: WARNING nova.compute.manager [req-d7ed73a0-d8f9-4fb9-833f-7938151c51e3 req-55473895-6306-44ec-88a0-ab38a66ee63e service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received unexpected event network-vif-plugged-3c779d1d-1bdc-4614-b153-60d32915a3b9 for instance with vm_state active and task_state deleting.
Aug 15 16:19:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] COPY block job progress, current cursor: 174063616 final cursor: 1073741824 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:19:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] COPY block job progress, current cursor: 344981504 final cursor: 1073741824 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] COPY block job progress, current cursor: 521142272 final cursor: 1073741824 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.compute.manager [req-a9a042df-9631-4dfd-9aa7-dfe08a157186 req-b73733a0-a30b-4d8f-b831-22c5718f1757 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a9a042df-9631-4dfd-9aa7-dfe08a157186 req-b73733a0-a30b-4d8f-b831-22c5718f1757 service nova] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a9a042df-9631-4dfd-9aa7-dfe08a157186 req-b73733a0-a30b-4d8f-b831-22c5718f1757 service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a9a042df-9631-4dfd-9aa7-dfe08a157186 req-b73733a0-a30b-4d8f-b831-22c5718f1757 service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.compute.manager [req-a9a042df-9631-4dfd-9aa7-dfe08a157186 req-b73733a0-a30b-4d8f-b831-22c5718f1757 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] No waiting events found dispatching network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:47 user nova-compute[72849]: WARNING nova.compute.manager [req-a9a042df-9631-4dfd-9aa7-dfe08a157186 req-b73733a0-a30b-4d8f-b831-22c5718f1757 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received unexpected event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 for instance with vm_state building and task_state spawning.
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] COPY block job progress, current cursor: 696254464 final cursor: 1073741824 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116387.7628913, 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:19:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] VM Resumed (Lifecycle Event)
Aug 15 16:19:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:19:47 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Instance spawned successfully.
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:19:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116387.7643929, 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:19:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] VM Started (Lifecycle Event)
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:19:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:19:47 user nova-compute[72849]: INFO nova.compute.manager [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Took 5.87 seconds to spawn the instance on the hypervisor.
Aug 15 16:19:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:19:48 user nova-compute[72849]: INFO nova.compute.manager [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Took 22.29 seconds to build instance.
Aug 15 16:19:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24a2409b-57d9-4381-82fa-c7467ea1868e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.402s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] COPY block job progress, current cursor: 879755264 final cursor: 1073741824 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:19:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] COPY block job progress, current cursor: 1059061760 final cursor: 1073741824 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:19:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJwpUeoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '85d5ae6c-b97b-43e9-89b3-11c3b6a0e135'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:49 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce6da55-7d72-46dd-b16d-65d8f62e1cd0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb48d9b-3bb7-41af-8c47-024247ed5318]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:49 user nova-compute[72849]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:19:49 user nova-compute[72849]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:49 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 (non-flash)
Aug 15 16:19:49 user nova-compute[72849]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:19:49 user nova-compute[72849]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:49 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3587a5750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135'): ({'sde'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Removing single pathed devices sde {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a270d20-29b4-4532-8e5f-58227d84f028]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c65b934-ef75-4344-9f6e-51a48037a78d]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Flushing IO for device /dev/sde {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e131a8-db6f-4c02-8e76-cbce774da7c2]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[93938b89-f9a3-4177-a5ec-1dd4220286bb]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] SCSI volumes sde have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9c7d34-0054-4f37-9e8d-bc9880bd97fe]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f619e85-d8d4-4997-a241-95796a94b301]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135, portal: 172.16.0.220,3260]
Aug 15 16:19:49 user nova-compute[72849]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135, portal: 172.16.0.220,3260] successful.
Aug 15 16:19:49 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG nova.compute.manager [req-5b9d2019-2e26-4fc8-a6c5-4e6ce79df242 req-f6cba32e-231b-4e0d-8342-5a9e8968b584 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-deleted-3c779d1d-1bdc-4614-b153-60d32915a3b9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:49 user nova-compute[72849]: INFO nova.compute.manager [req-5b9d2019-2e26-4fc8-a6c5-4e6ce79df242 req-f6cba32e-231b-4e0d-8342-5a9e8968b584 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Neutron deleted interface 3c779d1d-1bdc-4614-b153-60d32915a3b9; detaching it from the instance and deleting it from the info cache
Aug 15 16:19:49 user nova-compute[72849]: DEBUG nova.network.neutron [req-5b9d2019-2e26-4fc8-a6c5-4e6ce79df242 req-f6cba32e-231b-4e0d-8342-5a9e8968b584 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Updating instance_info_cache with network_info: [{"id": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "address": "fa:16:3e:7b:f7:02", "network": {"id": "5b2340e6-1701-4cd9-b55a-22a560dfe14f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1630894672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e960116-61", "ovs_interfaceid": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "869edc66-112a-4313-a86a-786335d36b51", "address": "fa:16:3e:22:06:6c", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869edc66-11", "ovs_interfaceid": "869edc66-112a-4313-a86a-786335d36b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37e52690-0504-4905-9c66-32f05b9ca665", "address": "fa:16:3e:fd:30:f1", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e52690-05", "ovs_interfaceid": "37e52690-0504-4905-9c66-32f05b9ca665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74249c5d-642c-48c3-aa3e-79f9165580bc", "address": "fa:16:3e:68:02:91", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74249c5d-64", "ovs_interfaceid": "74249c5d-642c-48c3-aa3e-79f9165580bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "address": "fa:16:3e:cf:22:4a", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f4af0d-01", "ovs_interfaceid": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "address": "fa:16:3e:ae:f3:b3", "network": {"id": "10a3e942-8148-4a73-9d5f-353e9c05b95b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1138174892", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0000b5-95", "ovs_interfaceid": "be0000b5-95ec-4f3f-9344-3754b9f63a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[91158e1d-63f1-432c-8365-ae56ef187c9f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] <== disconnect_volume: return (263ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG nova.compute.manager [req-5b9d2019-2e26-4fc8-a6c5-4e6ce79df242 req-f6cba32e-231b-4e0d-8342-5a9e8968b584 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Detach interface failed, port_id=3c779d1d-1bdc-4614-b153-60d32915a3b9, reason: Instance 40d69bd5-67c0-4b3c-8615-6660145b61fb could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG nova.compute.manager [req-5b9d2019-2e26-4fc8-a6c5-4e6ce79df242 req-f6cba32e-231b-4e0d-8342-5a9e8968b584 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-deleted-be0000b5-95ec-4f3f-9344-3754b9f63a3d {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:49 user nova-compute[72849]: INFO nova.compute.manager [req-5b9d2019-2e26-4fc8-a6c5-4e6ce79df242 req-f6cba32e-231b-4e0d-8342-5a9e8968b584 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Neutron deleted interface be0000b5-95ec-4f3f-9344-3754b9f63a3d; detaching it from the instance and deleting it from the info cache
Aug 15 16:19:49 user nova-compute[72849]: DEBUG nova.network.neutron [req-5b9d2019-2e26-4fc8-a6c5-4e6ce79df242 req-f6cba32e-231b-4e0d-8342-5a9e8968b584 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Updating instance_info_cache with network_info: [{"id": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "address": "fa:16:3e:7b:f7:02", "network": {"id": "5b2340e6-1701-4cd9-b55a-22a560dfe14f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1630894672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e960116-61", "ovs_interfaceid": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "869edc66-112a-4313-a86a-786335d36b51", "address": "fa:16:3e:22:06:6c", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869edc66-11", "ovs_interfaceid": "869edc66-112a-4313-a86a-786335d36b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37e52690-0504-4905-9c66-32f05b9ca665", "address": "fa:16:3e:fd:30:f1", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e52690-05", "ovs_interfaceid": "37e52690-0504-4905-9c66-32f05b9ca665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74249c5d-642c-48c3-aa3e-79f9165580bc", "address": "fa:16:3e:68:02:91", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74249c5d-64", "ovs_interfaceid": "74249c5d-642c-48c3-aa3e-79f9165580bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "address": "fa:16:3e:cf:22:4a", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f4af0d-01", "ovs_interfaceid": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG nova.compute.manager [req-5b9d2019-2e26-4fc8-a6c5-4e6ce79df242 req-f6cba32e-231b-4e0d-8342-5a9e8968b584 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Detach interface failed, port_id=be0000b5-95ec-4f3f-9344-3754b9f63a3d, reason: Instance 40d69bd5-67c0-4b3c-8615-6660145b61fb could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG nova.compute.manager [req-5b9d2019-2e26-4fc8-a6c5-4e6ce79df242 req-f6cba32e-231b-4e0d-8342-5a9e8968b584 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-deleted-74249c5d-642c-48c3-aa3e-79f9165580bc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:49 user nova-compute[72849]: INFO nova.compute.manager [req-5b9d2019-2e26-4fc8-a6c5-4e6ce79df242 req-f6cba32e-231b-4e0d-8342-5a9e8968b584 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Neutron deleted interface 74249c5d-642c-48c3-aa3e-79f9165580bc; detaching it from the instance and deleting it from the info cache
Aug 15 16:19:49 user nova-compute[72849]: DEBUG nova.network.neutron [req-5b9d2019-2e26-4fc8-a6c5-4e6ce79df242 req-f6cba32e-231b-4e0d-8342-5a9e8968b584 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Updating instance_info_cache with network_info: [{"id": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "address": "fa:16:3e:7b:f7:02", "network": {"id": "5b2340e6-1701-4cd9-b55a-22a560dfe14f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1630894672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e960116-61", "ovs_interfaceid": "3e960116-61a7-4ee5-9eb6-72c9a60f0657", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "869edc66-112a-4313-a86a-786335d36b51", "address": "fa:16:3e:22:06:6c", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869edc66-11", "ovs_interfaceid": "869edc66-112a-4313-a86a-786335d36b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37e52690-0504-4905-9c66-32f05b9ca665", "address": "fa:16:3e:fd:30:f1", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e52690-05", "ovs_interfaceid": "37e52690-0504-4905-9c66-32f05b9ca665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "address": "fa:16:3e:cf:22:4a", "network": {"id": "0a8736fd-3f7b-4f9a-aca0-ff4df8449951", "bridge": "br-int", "label": "tempest-device-tagging-net1-578742909", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d504c6bf4d1e40f89105b6bb868fbb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f4af0d-01", "ovs_interfaceid": "68f4af0d-01e5-4950-b08a-c8454b09dd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZkqEjfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '5c64c95c-74b3-4883-94d2-ee99ff27434e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5c8896d-2002-4d25-8300-3baccb73538d', 'serial'} {{(pid=72849) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] swap_volume: removing Cinder connection for volume 85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 {{(pid=72849) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 15 16:19:49 user nova-compute[72849]: DEBUG nova.compute.manager [req-5b9d2019-2e26-4fc8-a6c5-4e6ce79df242 req-f6cba32e-231b-4e0d-8342-5a9e8968b584 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Detach interface failed, port_id=74249c5d-642c-48c3-aa3e-79f9165580bc, reason: Instance 40d69bd5-67c0-4b3c-8615-6660145b61fb could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:19:50 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:19:50 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Took 4.46 seconds to deallocate network for instance.
Aug 15 16:19:50 user nova-compute[72849]: DEBUG nova.compute.manager [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] swap_volume: Updating volume 85d5ae6c-b97b-43e9-89b3-11c3b6a0e135 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "GZkqEjfB", "auth_password": "AdD8VFauSKB0Hh", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "f5c8896d-2002-4d25-8300-3baccb73538d"}, "status": "reserved", "instance": "5c64c95c-74b3-4883-94d2-ee99ff27434e", "attached_at": "", "detached_at": "", "volume_id": "f5c8896d-2002-4d25-8300-3baccb73538d", "serial": "f5c8896d-2002-4d25-8300-3baccb73538d"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f5c8896d-2002-4d25-8300-3baccb73538d', 'no_device': None, 'attachment_id': 'c41f5fd1-019d-4e8a-a6e5-4e4cfac9b3a0'} {{(pid=72849) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 15 16:19:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-447fd71c-a1e1-4166-9a61-6394d4f79c97 tempest-TestVolumeSwap-2140420515 tempest-TestVolumeSwap-2140420515-project-admin] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.932s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Acquiring lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:51 user nova-compute[72849]: INFO nova.compute.manager [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Detaching volume f5c8896d-2002-4d25-8300-3baccb73538d
Aug 15 16:19:51 user nova-compute[72849]: INFO nova.virt.block_device [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Attempting to driver detach volume f5c8896d-2002-4d25-8300-3baccb73538d from mountpoint /dev/vdb
Aug 15 16:19:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Attempting to detach device vdb from instance 5c64c95c-74b3-4883-94d2-ee99ff27434e from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:19:51 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:19:51 user nova-compute[72849]:   <source dev="/dev/sdg"/>
Aug 15 16:19:51 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:19:51 user nova-compute[72849]:   <serial>f5c8896d-2002-4d25-8300-3baccb73538d</serial>
Aug 15 16:19:51 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:19:51 user nova-compute[72849]: </disk>
Aug 15 16:19:51 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:19:51 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Successfully detached device vdb from instance 5c64c95c-74b3-4883-94d2-ee99ff27434e from the persistent domain config.
Aug 15 16:19:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c64c95c-74b3-4883-94d2-ee99ff27434e from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:19:51 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:19:51 user nova-compute[72849]:   <source dev="/dev/sdg"/>
Aug 15 16:19:51 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:19:51 user nova-compute[72849]:   <serial>f5c8896d-2002-4d25-8300-3baccb73538d</serial>
Aug 15 16:19:51 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:19:51 user nova-compute[72849]: </disk>
Aug 15 16:19:51 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG nova.compute.manager [req-d4472708-a83a-4b92-bb39-b5900c41710c req-4ad97caf-5ef8-49b0-8496-bc0119748754 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-deleted-68f4af0d-01e5-4950-b08a-c8454b09dd3e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG nova.compute.manager [req-d4472708-a83a-4b92-bb39-b5900c41710c req-4ad97caf-5ef8-49b0-8496-bc0119748754 service nova] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Received event network-vif-deleted-3e960116-61a7-4ee5-9eb6-72c9a60f0657 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692116391.8417828, 5c64c95c-74b3-4883-94d2-ee99ff27434e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c64c95c-74b3-4883-94d2-ee99ff27434e {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:19:51 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Successfully detached device vdb from instance 5c64c95c-74b3-4883-94d2-ee99ff27434e from the live domain config.
Aug 15 16:19:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZkqEjfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'f5c8896d-2002-4d25-8300-3baccb73538d'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:19:51 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:19:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9712f0-2034-4284-849d-6ff53ef9268f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e464ce86-8b0b-4814-beee-da2efdee0ed5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:19:51 user nova-compute[72849]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:51 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:19:51 user nova-compute[72849]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d (non-flash)
Aug 15 16:19:51 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc358296f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d'): ({'sdg'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Removing single pathed devices sdg {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a6067f-88c0-4513-a545-152e73484928]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2bd022-2511-4313-ab0b-3c5f0699ecce]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Flushing IO for device /dev/sdg {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4cb2f0-aea2-434a-9176-c5740071edfd]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:19:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec93742-41b9-42e2-b4fe-c89cede62547]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] SCSI volumes sdg have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[223ae2ff-4760-48a7-94da-20f4eb8070af]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[79aae9a7-2855-4772-bd5e-536bc705c083]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "dea53f90-39ad-4c38-b67b-e23a8ce03d23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "dea53f90-39ad-4c38-b67b-e23a8ce03d23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d, portal: 172.16.0.220,3260]
Aug 15 16:19:52 user nova-compute[72849]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d, portal: 172.16.0.220,3260] successful.
Aug 15 16:19:52 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5c8896d-2002-4d25-8300-3baccb73538d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f66495-5277-4a01-8612-ad02234dd75c]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] <== disconnect_volume: return (271ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:19:52 user nova-compute[72849]: INFO nova.compute.claims [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Claim successful on node user
Aug 15 16:19:52 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:19:52 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:19:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:19:52 user nova-compute[72849]: INFO nova.compute.manager [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Took 2.38 seconds to detach 3 volumes for instance.
Aug 15 16:19:52 user nova-compute[72849]: DEBUG nova.policy [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8365a9dd961144a2b2cb303bb7854a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279e48c00f91440082b8bfe112af9091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:19:52 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Creating image(s)
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "/opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "/opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "/opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:52 user nova-compute[72849]: DEBUG nova.objects.instance [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lazy-loading 'flavor' on Instance uuid 5c64c95c-74b3-4883-94d2-ee99ff27434e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-227f1cc0-dc7a-4a4c-8efa-4541f4939bdd tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.743s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.174s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/disk 1073741824" returned: 0 in 0.047s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Successfully created port: 09bced67-66f5-4fc8-96c7-367c28d28143 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.506s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:53 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Deleted allocations for instance 40d69bd5-67c0-4b3c-8615-6660145b61fb
Aug 15 16:19:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.192s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a49d5db-6665-4a39-afb2-92cbff9e4ba9 tempest-TaggedBootDevicesTest-1229052876 tempest-TaggedBootDevicesTest-1229052876-project-member] Lock "40d69bd5-67c0-4b3c-8615-6660145b61fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.960s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Cannot resize image /opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lazy-loading 'migration_context' on Instance uuid dea53f90-39ad-4c38-b67b-e23a8ce03d23 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Ensure instance console log exists: /opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Successfully updated port: 09bced67-66f5-4fc8-96c7-367c28d28143 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "refresh_cache-dea53f90-39ad-4c38-b67b-e23a8ce03d23" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquired lock "refresh_cache-dea53f90-39ad-4c38-b67b-e23a8ce03d23" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-57687329-647c-45cf-b9a1-fa663bda57fd req-6ab9f66a-e814-46cf-88cd-218f4c0237a0 service nova] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Received event network-changed-09bced67-66f5-4fc8-96c7-367c28d28143 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-57687329-647c-45cf-b9a1-fa663bda57fd req-6ab9f66a-e814-46cf-88cd-218f4c0237a0 service nova] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Refreshing instance network info cache due to event network-changed-09bced67-66f5-4fc8-96c7-367c28d28143. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-57687329-647c-45cf-b9a1-fa663bda57fd req-6ab9f66a-e814-46cf-88cd-218f4c0237a0 service nova] Acquiring lock "refresh_cache-dea53f90-39ad-4c38-b67b-e23a8ce03d23" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Updating instance_info_cache with network_info: [{"id": "09bced67-66f5-4fc8-96c7-367c28d28143", "address": "fa:16:3e:bb:c3:b2", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bced67-66", "ovs_interfaceid": "09bced67-66f5-4fc8-96c7-367c28d28143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Releasing lock "refresh_cache-dea53f90-39ad-4c38-b67b-e23a8ce03d23" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Instance network_info: |[{"id": "09bced67-66f5-4fc8-96c7-367c28d28143", "address": "fa:16:3e:bb:c3:b2", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bced67-66", "ovs_interfaceid": "09bced67-66f5-4fc8-96c7-367c28d28143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-57687329-647c-45cf-b9a1-fa663bda57fd req-6ab9f66a-e814-46cf-88cd-218f4c0237a0 service nova] Acquired lock "refresh_cache-dea53f90-39ad-4c38-b67b-e23a8ce03d23" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.network.neutron [req-57687329-647c-45cf-b9a1-fa663bda57fd req-6ab9f66a-e814-46cf-88cd-218f4c0237a0 service nova] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Refreshing network info cache for port 09bced67-66f5-4fc8-96c7-367c28d28143 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Start _get_guest_xml network_info=[{"id": "09bced67-66f5-4fc8-96c7-367c28d28143", "address": "fa:16:3e:bb:c3:b2", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bced67-66", "ovs_interfaceid": "09bced67-66f5-4fc8-96c7-367c28d28143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:19:54 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:19:54 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-741975421',display_name='tempest-VolumesAdminNegativeTest-server-741975421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-741975421',id=14,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='279e48c00f91440082b8bfe112af9091',ramdisk_id='',reservation_id='r-48nzwqka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-879284905',owner_user_name='tempest-VolumesAdminNegativeTest-879284905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:19:53Z,user_data=None,user_id='8365a9dd961144a2b2cb303bb7854a45',uuid=dea53f90-39ad-4c38-b67b-e23a8ce03d23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09bced67-66f5-4fc8-96c7-367c28d28143", "address": "fa:16:3e:bb:c3:b2", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bced67-66", "ovs_interfaceid": "09bced67-66f5-4fc8-96c7-367c28d28143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Converting VIF {"id": "09bced67-66f5-4fc8-96c7-367c28d28143", "address": "fa:16:3e:bb:c3:b2", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bced67-66", "ovs_interfaceid": "09bced67-66f5-4fc8-96c7-367c28d28143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c3:b2,bridge_name='br-int',has_traffic_filtering=True,id=09bced67-66f5-4fc8-96c7-367c28d28143,network=Network(181b9566-bc94-42e7-b80e-1b78111cce19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bced67-66') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lazy-loading 'pci_devices' on Instance uuid dea53f90-39ad-4c38-b67b-e23a8ce03d23 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:19:54 user nova-compute[72849]:   <uuid>dea53f90-39ad-4c38-b67b-e23a8ce03d23</uuid>
Aug 15 16:19:54 user nova-compute[72849]:   <name>instance-0000000e</name>
Aug 15 16:19:54 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:19:54 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:19:54 user nova-compute[72849]:   <metadata>
Aug 15 16:19:54 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:19:54 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:19:54 user nova-compute[72849]:       <nova:name>tempest-VolumesAdminNegativeTest-server-741975421</nova:name>
Aug 15 16:19:54 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:19:54</nova:creationTime>
Aug 15 16:19:54 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:19:54 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:19:54 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:19:54 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:19:54 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:19:54 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:19:54 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:19:54 user nova-compute[72849]:       <nova:owner>
Aug 15 16:19:54 user nova-compute[72849]:         <nova:user uuid="8365a9dd961144a2b2cb303bb7854a45">tempest-VolumesAdminNegativeTest-879284905-project-member</nova:user>
Aug 15 16:19:54 user nova-compute[72849]:         <nova:project uuid="279e48c00f91440082b8bfe112af9091">tempest-VolumesAdminNegativeTest-879284905</nova:project>
Aug 15 16:19:54 user nova-compute[72849]:       </nova:owner>
Aug 15 16:19:54 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:19:54 user nova-compute[72849]:       <nova:ports>
Aug 15 16:19:54 user nova-compute[72849]:         <nova:port uuid="09bced67-66f5-4fc8-96c7-367c28d28143">
Aug 15 16:19:54 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 16:19:54 user nova-compute[72849]:         </nova:port>
Aug 15 16:19:54 user nova-compute[72849]:       </nova:ports>
Aug 15 16:19:54 user nova-compute[72849]:     </nova:instance>
Aug 15 16:19:54 user nova-compute[72849]:   </metadata>
Aug 15 16:19:54 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:19:54 user nova-compute[72849]:     <system>
Aug 15 16:19:54 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:19:54 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:19:54 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:19:54 user nova-compute[72849]:       <entry name="serial">dea53f90-39ad-4c38-b67b-e23a8ce03d23</entry>
Aug 15 16:19:54 user nova-compute[72849]:       <entry name="uuid">dea53f90-39ad-4c38-b67b-e23a8ce03d23</entry>
Aug 15 16:19:54 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:19:54 user nova-compute[72849]:     </system>
Aug 15 16:19:54 user nova-compute[72849]:   </sysinfo>
Aug 15 16:19:54 user nova-compute[72849]:   <os>
Aug 15 16:19:54 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:19:54 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:19:54 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:19:54 user nova-compute[72849]:   </os>
Aug 15 16:19:54 user nova-compute[72849]:   <features>
Aug 15 16:19:54 user nova-compute[72849]:     <acpi/>
Aug 15 16:19:54 user nova-compute[72849]:     <apic/>
Aug 15 16:19:54 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:19:54 user nova-compute[72849]:   </features>
Aug 15 16:19:54 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:19:54 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:19:54 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:19:54 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:19:54 user nova-compute[72849]:   </clock>
Aug 15 16:19:54 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:19:54 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:19:54 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:19:54 user nova-compute[72849]:   </cpu>
Aug 15 16:19:54 user nova-compute[72849]:   <devices>
Aug 15 16:19:54 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:19:54 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:19:54 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/disk"/>
Aug 15 16:19:54 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:19:54 user nova-compute[72849]:     </disk>
Aug 15 16:19:54 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:19:54 user nova-compute[72849]:       <mac address="fa:16:3e:bb:c3:b2"/>
Aug 15 16:19:54 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:19:54 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:19:54 user nova-compute[72849]:       <target dev="tap09bced67-66"/>
Aug 15 16:19:54 user nova-compute[72849]:     </interface>
Aug 15 16:19:54 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:19:54 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/console.log" append="off"/>
Aug 15 16:19:54 user nova-compute[72849]:     </serial>
Aug 15 16:19:54 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:19:54 user nova-compute[72849]:     <video>
Aug 15 16:19:54 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:19:54 user nova-compute[72849]:     </video>
Aug 15 16:19:54 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:19:54 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:19:54 user nova-compute[72849]:     </rng>
Aug 15 16:19:54 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:19:54 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:19:54 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:19:54 user nova-compute[72849]:     </memballoon>
Aug 15 16:19:54 user nova-compute[72849]:   </devices>
Aug 15 16:19:54 user nova-compute[72849]: </domain>
Aug 15 16:19:54 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-741975421',display_name='tempest-VolumesAdminNegativeTest-server-741975421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-741975421',id=14,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='279e48c00f91440082b8bfe112af9091',ramdisk_id='',reservation_id='r-48nzwqka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-879284905',owner_user_name='tempest-VolumesAdminNegativeTest-879284905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:19:53Z,user_data=None,user_id='8365a9dd961144a2b2cb303bb7854a45',uuid=dea53f90-39ad-4c38-b67b-e23a8ce03d23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09bced67-66f5-4fc8-96c7-367c28d28143", "address": "fa:16:3e:bb:c3:b2", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bced67-66", "ovs_interfaceid": "09bced67-66f5-4fc8-96c7-367c28d28143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Converting VIF {"id": "09bced67-66f5-4fc8-96c7-367c28d28143", "address": "fa:16:3e:bb:c3:b2", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bced67-66", "ovs_interfaceid": "09bced67-66f5-4fc8-96c7-367c28d28143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c3:b2,bridge_name='br-int',has_traffic_filtering=True,id=09bced67-66f5-4fc8-96c7-367c28d28143,network=Network(181b9566-bc94-42e7-b80e-1b78111cce19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bced67-66') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG os_vif [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c3:b2,bridge_name='br-int',has_traffic_filtering=True,id=09bced67-66f5-4fc8-96c7-367c28d28143,network=Network(181b9566-bc94-42e7-b80e-1b78111cce19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bced67-66') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09bced67-66, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09bced67-66, col_values=(('external_ids', {'iface-id': '09bced67-66f5-4fc8-96c7-367c28d28143', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:c3:b2', 'vm-uuid': 'dea53f90-39ad-4c38-b67b-e23a8ce03d23'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:54 user nova-compute[72849]: INFO os_vif [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c3:b2,bridge_name='br-int',has_traffic_filtering=True,id=09bced67-66f5-4fc8-96c7-367c28d28143,network=Network(181b9566-bc94-42e7-b80e-1b78111cce19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bced67-66')
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] No VIF found with MAC fa:16:3e:bb:c3:b2, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.network.neutron [req-57687329-647c-45cf-b9a1-fa663bda57fd req-6ab9f66a-e814-46cf-88cd-218f4c0237a0 service nova] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Updated VIF entry in instance network info cache for port 09bced67-66f5-4fc8-96c7-367c28d28143. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG nova.network.neutron [req-57687329-647c-45cf-b9a1-fa663bda57fd req-6ab9f66a-e814-46cf-88cd-218f4c0237a0 service nova] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Updating instance_info_cache with network_info: [{"id": "09bced67-66f5-4fc8-96c7-367c28d28143", "address": "fa:16:3e:bb:c3:b2", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bced67-66", "ovs_interfaceid": "09bced67-66f5-4fc8-96c7-367c28d28143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:19:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-57687329-647c-45cf-b9a1-fa663bda57fd req-6ab9f66a-e814-46cf-88cd-218f4c0237a0 service nova] Releasing lock "refresh_cache-dea53f90-39ad-4c38-b67b-e23a8ce03d23" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:19:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:56 user nova-compute[72849]: DEBUG nova.compute.manager [req-ddf7f279-aa06-4e41-b7a3-3da824ced4a9 req-5ce1c648-86d5-494c-a5a2-c30002e59237 service nova] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Received event network-vif-plugged-09bced67-66f5-4fc8-96c7-367c28d28143 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ddf7f279-aa06-4e41-b7a3-3da824ced4a9 req-5ce1c648-86d5-494c-a5a2-c30002e59237 service nova] Acquiring lock "dea53f90-39ad-4c38-b67b-e23a8ce03d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ddf7f279-aa06-4e41-b7a3-3da824ced4a9 req-5ce1c648-86d5-494c-a5a2-c30002e59237 service nova] Lock "dea53f90-39ad-4c38-b67b-e23a8ce03d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ddf7f279-aa06-4e41-b7a3-3da824ced4a9 req-5ce1c648-86d5-494c-a5a2-c30002e59237 service nova] Lock "dea53f90-39ad-4c38-b67b-e23a8ce03d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:56 user nova-compute[72849]: DEBUG nova.compute.manager [req-ddf7f279-aa06-4e41-b7a3-3da824ced4a9 req-5ce1c648-86d5-494c-a5a2-c30002e59237 service nova] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] No waiting events found dispatching network-vif-plugged-09bced67-66f5-4fc8-96c7-367c28d28143 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:56 user nova-compute[72849]: WARNING nova.compute.manager [req-ddf7f279-aa06-4e41-b7a3-3da824ced4a9 req-5ce1c648-86d5-494c-a5a2-c30002e59237 service nova] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Received unexpected event network-vif-plugged-09bced67-66f5-4fc8-96c7-367c28d28143 for instance with vm_state building and task_state spawning.
Aug 15 16:19:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:19:57 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116397.8815339, dea53f90-39ad-4c38-b67b-e23a8ce03d23 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:19:57 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] VM Resumed (Lifecycle Event)
Aug 15 16:19:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:19:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:19:57 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Instance spawned successfully.
Aug 15 16:19:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:19:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:19:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:19:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:19:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:19:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:19:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:19:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:19:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:19:57 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:19:57 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116397.88276, dea53f90-39ad-4c38-b67b-e23a8ce03d23 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:19:57 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] VM Started (Lifecycle Event)
Aug 15 16:19:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:19:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:19:57 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:19:57 user nova-compute[72849]: INFO nova.compute.manager [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Took 5.11 seconds to spawn the instance on the hypervisor.
Aug 15 16:19:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:19:58 user nova-compute[72849]: INFO nova.compute.manager [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Took 5.89 seconds to build instance.
Aug 15 16:19:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d81bbf9-f282-48ee-a8b7-728ecd7c538b tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "dea53f90-39ad-4c38-b67b-e23a8ce03d23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.978s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:58 user nova-compute[72849]: DEBUG nova.compute.manager [req-37f51c34-5ddd-406f-894b-f5c36eefcce6 req-8790d718-dee1-4b4c-902e-f3967779fda0 service nova] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Received event network-vif-plugged-09bced67-66f5-4fc8-96c7-367c28d28143 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:19:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-37f51c34-5ddd-406f-894b-f5c36eefcce6 req-8790d718-dee1-4b4c-902e-f3967779fda0 service nova] Acquiring lock "dea53f90-39ad-4c38-b67b-e23a8ce03d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:19:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-37f51c34-5ddd-406f-894b-f5c36eefcce6 req-8790d718-dee1-4b4c-902e-f3967779fda0 service nova] Lock "dea53f90-39ad-4c38-b67b-e23a8ce03d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:19:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-37f51c34-5ddd-406f-894b-f5c36eefcce6 req-8790d718-dee1-4b4c-902e-f3967779fda0 service nova] Lock "dea53f90-39ad-4c38-b67b-e23a8ce03d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:19:58 user nova-compute[72849]: DEBUG nova.compute.manager [req-37f51c34-5ddd-406f-894b-f5c36eefcce6 req-8790d718-dee1-4b4c-902e-f3967779fda0 service nova] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] No waiting events found dispatching network-vif-plugged-09bced67-66f5-4fc8-96c7-367c28d28143 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:19:58 user nova-compute[72849]: WARNING nova.compute.manager [req-37f51c34-5ddd-406f-894b-f5c36eefcce6 req-8790d718-dee1-4b4c-902e-f3967779fda0 service nova] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Received unexpected event network-vif-plugged-09bced67-66f5-4fc8-96c7-367c28d28143 for instance with vm_state active and task_state None.
Aug 15 16:19:58 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116383.361218, 40d69bd5-67c0-4b3c-8615-6660145b61fb => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:19:58 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] VM Stopped (Lifecycle Event)
Aug 15 16:19:58 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ddc8904e-e7d8-436a-b218-25241b82930e None None] [instance: 40d69bd5-67c0-4b3c-8615-6660145b61fb] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:19:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Acquiring lock "3954da38-0292-40f7-8ace-6987d0248a44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lock "3954da38-0292-40f7-8ace-6987d0248a44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Acquiring lock "3954da38-0292-40f7-8ace-6987d0248a44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lock "3954da38-0292-40f7-8ace-6987d0248a44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lock "3954da38-0292-40f7-8ace-6987d0248a44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:08 user nova-compute[72849]: INFO nova.compute.manager [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Terminating instance
Aug 15 16:20:08 user nova-compute[72849]: DEBUG nova.compute.manager [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:20:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-129950d5-02cb-4622-8314-768a229a9646 req-d008bb98-d27d-446a-980c-23531043ed0f service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Received event network-vif-unplugged-9312a7dc-cae1-498e-8151-5dea468286d0 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-129950d5-02cb-4622-8314-768a229a9646 req-d008bb98-d27d-446a-980c-23531043ed0f service nova] Acquiring lock "3954da38-0292-40f7-8ace-6987d0248a44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-129950d5-02cb-4622-8314-768a229a9646 req-d008bb98-d27d-446a-980c-23531043ed0f service nova] Lock "3954da38-0292-40f7-8ace-6987d0248a44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-129950d5-02cb-4622-8314-768a229a9646 req-d008bb98-d27d-446a-980c-23531043ed0f service nova] Lock "3954da38-0292-40f7-8ace-6987d0248a44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-129950d5-02cb-4622-8314-768a229a9646 req-d008bb98-d27d-446a-980c-23531043ed0f service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] No waiting events found dispatching network-vif-unplugged-9312a7dc-cae1-498e-8151-5dea468286d0 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-129950d5-02cb-4622-8314-768a229a9646 req-d008bb98-d27d-446a-980c-23531043ed0f service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Received event network-vif-unplugged-9312a7dc-cae1-498e-8151-5dea468286d0 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:20:09 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Instance destroyed successfully.
Aug 15 16:20:09 user nova-compute[72849]: DEBUG nova.objects.instance [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lazy-loading 'resources' on Instance uuid 3954da38-0292-40f7-8ace-6987d0248a44 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1390546721',display_name='tempest-VolumesAssistedSnapshotsTest-server-1390546721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1390546721',id=8,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEc021U9xL6F+lzSp7FwDJkLyIKhbhsVVwQFQBeE5kd/4MXhf5DaQr3E2+3eWMtz+JFny48gBByr9d0rv3mX7Arg0pRMATw/8WoY/4PC2LQUaXQqARtE6N4I68AZMCSARg==',key_name='tempest-keypair-2101886699',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:17:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='574b067543464efcbb6701547c90a91f',ramdisk_id='',reservation_id='r-k7surjy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-585822675',owner_user_name='tempest-VolumesAssistedSnapshotsTest-585822675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9695ab1e4507498eb7216e616f536c68',uuid=3954da38-0292-40f7-8ace-6987d0248a44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9312a7dc-cae1-498e-8151-5dea468286d0", "address": "fa:16:3e:be:cc:d8", "network": {"id": "343457d5-3929-410d-a486-16e7ca4ef8f2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-695787955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "574b067543464efcbb6701547c90a91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9312a7dc-ca", "ovs_interfaceid": "9312a7dc-cae1-498e-8151-5dea468286d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:20:09 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Converting VIF {"id": "9312a7dc-cae1-498e-8151-5dea468286d0", "address": "fa:16:3e:be:cc:d8", "network": {"id": "343457d5-3929-410d-a486-16e7ca4ef8f2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-695787955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "574b067543464efcbb6701547c90a91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9312a7dc-ca", "ovs_interfaceid": "9312a7dc-cae1-498e-8151-5dea468286d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:20:09 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:cc:d8,bridge_name='br-int',has_traffic_filtering=True,id=9312a7dc-cae1-498e-8151-5dea468286d0,network=Network(343457d5-3929-410d-a486-16e7ca4ef8f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9312a7dc-ca') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:20:09 user nova-compute[72849]: DEBUG os_vif [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:cc:d8,bridge_name='br-int',has_traffic_filtering=True,id=9312a7dc-cae1-498e-8151-5dea468286d0,network=Network(343457d5-3929-410d-a486-16e7ca4ef8f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9312a7dc-ca') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:20:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9312a7dc-ca, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:20:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:20:09 user nova-compute[72849]: INFO os_vif [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:cc:d8,bridge_name='br-int',has_traffic_filtering=True,id=9312a7dc-cae1-498e-8151-5dea468286d0,network=Network(343457d5-3929-410d-a486-16e7ca4ef8f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9312a7dc-ca')
Aug 15 16:20:09 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Deleting instance files /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44_del
Aug 15 16:20:09 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Deletion of /opt/stack/data/nova/instances/3954da38-0292-40f7-8ace-6987d0248a44_del complete
Aug 15 16:20:09 user nova-compute[72849]: INFO nova.compute.manager [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Took 1.07 seconds to destroy the instance on the hypervisor.
Aug 15 16:20:09 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:20:09 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:20:09 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:20:10 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:20:10 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Took 1.13 seconds to deallocate network for instance.
Aug 15 16:20:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-db001d49-f465-4d81-ace0-faadbfb41b22 req-31944ec7-75d0-48cf-a257-49e06af29119 service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Received event network-vif-deleted-9312a7dc-cae1-498e-8151-5dea468286d0 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-b50dfabb-bce0-4ead-8c4c-c55696b104de req-ba87d72c-159c-4843-b7de-e48a5e0dad7b service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Received event network-vif-plugged-9312a7dc-cae1-498e-8151-5dea468286d0 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b50dfabb-bce0-4ead-8c4c-c55696b104de req-ba87d72c-159c-4843-b7de-e48a5e0dad7b service nova] Acquiring lock "3954da38-0292-40f7-8ace-6987d0248a44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b50dfabb-bce0-4ead-8c4c-c55696b104de req-ba87d72c-159c-4843-b7de-e48a5e0dad7b service nova] Lock "3954da38-0292-40f7-8ace-6987d0248a44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b50dfabb-bce0-4ead-8c4c-c55696b104de req-ba87d72c-159c-4843-b7de-e48a5e0dad7b service nova] Lock "3954da38-0292-40f7-8ace-6987d0248a44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-b50dfabb-bce0-4ead-8c4c-c55696b104de req-ba87d72c-159c-4843-b7de-e48a5e0dad7b service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] No waiting events found dispatching network-vif-plugged-9312a7dc-cae1-498e-8151-5dea468286d0 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:11 user nova-compute[72849]: WARNING nova.compute.manager [req-b50dfabb-bce0-4ead-8c4c-c55696b104de req-ba87d72c-159c-4843-b7de-e48a5e0dad7b service nova] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Received unexpected event network-vif-plugged-9312a7dc-cae1-498e-8151-5dea468286d0 for instance with vm_state deleted and task_state None.
Aug 15 16:20:11 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:20:11 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:20:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.550s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:11 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Deleted allocations for instance 3954da38-0292-40f7-8ace-6987d0248a44
Aug 15 16:20:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e261154e-6a2a-472d-b8e8-54c05ea3b7d9 tempest-VolumesAssistedSnapshotsTest-585822675 tempest-VolumesAssistedSnapshotsTest-585822675-project-member] Lock "3954da38-0292-40f7-8ace-6987d0248a44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.965s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "7d843493-eda8-46a9-bb1b-3cc80eed7488" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:15 user nova-compute[72849]: INFO nova.compute.manager [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Terminating instance
Aug 15 16:20:15 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-77d97dba-4565-46c2-9b3c-1683eb7adc3a req-478be59e-76b7-4551-8685-4df6cf7f7547 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received event network-vif-unplugged-888d8da9-c8a5-40fd-a421-1a8ec1890f25 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-77d97dba-4565-46c2-9b3c-1683eb7adc3a req-478be59e-76b7-4551-8685-4df6cf7f7547 service nova] Acquiring lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-77d97dba-4565-46c2-9b3c-1683eb7adc3a req-478be59e-76b7-4551-8685-4df6cf7f7547 service nova] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-77d97dba-4565-46c2-9b3c-1683eb7adc3a req-478be59e-76b7-4551-8685-4df6cf7f7547 service nova] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-77d97dba-4565-46c2-9b3c-1683eb7adc3a req-478be59e-76b7-4551-8685-4df6cf7f7547 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] No waiting events found dispatching network-vif-unplugged-888d8da9-c8a5-40fd-a421-1a8ec1890f25 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-77d97dba-4565-46c2-9b3c-1683eb7adc3a req-478be59e-76b7-4551-8685-4df6cf7f7547 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received event network-vif-unplugged-888d8da9-c8a5-40fd-a421-1a8ec1890f25 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:20:15 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Instance destroyed successfully.
Aug 15 16:20:15 user nova-compute[72849]: DEBUG nova.objects.instance [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lazy-loading 'resources' on Instance uuid 7d843493-eda8-46a9-bb1b-3cc80eed7488 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-215597638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-215597638',id=7,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdbWakgm9rkhjBkOdQBASg9y5tRST/eN38nlLPxQcgrQZwoqRDKC9b5dSss1Yo4J4gifxLRY6ThnnWU08v57v9/fZXdXuUr1hxB2yLXnfesqIyRH5q7Iz1U8TLWUXIMbw==',key_name='tempest-keypair-627680743',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:17:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de78e6bddce4402d9829b94e9bd6cf05',ramdisk_id='',reservation_id='r-aag6oo7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-415257394',owner_user_name='tempest-TaggedAttachmentsTest-415257394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:17:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a442003f0164870905327b6b5f1a0b2',uuid=7d843493-eda8-46a9-bb1b-3cc80eed7488,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "address": "fa:16:3e:7d:a6:b4", "network": {"id": "2d0a7c86-1e60-4ea6-93d7-c66b552d95e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1960989403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888d8da9-c8", "ovs_interfaceid": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Converting VIF {"id": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "address": "fa:16:3e:7d:a6:b4", "network": {"id": "2d0a7c86-1e60-4ea6-93d7-c66b552d95e4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1960989403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78e6bddce4402d9829b94e9bd6cf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888d8da9-c8", "ovs_interfaceid": "888d8da9-c8a5-40fd-a421-1a8ec1890f25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:a6:b4,bridge_name='br-int',has_traffic_filtering=True,id=888d8da9-c8a5-40fd-a421-1a8ec1890f25,network=Network(2d0a7c86-1e60-4ea6-93d7-c66b552d95e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888d8da9-c8') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG os_vif [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:a6:b4,bridge_name='br-int',has_traffic_filtering=True,id=888d8da9-c8a5-40fd-a421-1a8ec1890f25,network=Network(2d0a7c86-1e60-4ea6-93d7-c66b552d95e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888d8da9-c8') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap888d8da9-c8, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:15 user nova-compute[72849]: INFO os_vif [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:a6:b4,bridge_name='br-int',has_traffic_filtering=True,id=888d8da9-c8a5-40fd-a421-1a8ec1890f25,network=Network(2d0a7c86-1e60-4ea6-93d7-c66b552d95e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888d8da9-c8')
Aug 15 16:20:15 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Deleting instance files /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488_del
Aug 15 16:20:15 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Deletion of /opt/stack/data/nova/instances/7d843493-eda8-46a9-bb1b-3cc80eed7488_del complete
Aug 15 16:20:15 user nova-compute[72849]: INFO nova.compute.manager [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 15 16:20:16 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:20:16 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:20:16 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:20:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "052cde29-421b-4b17-9bcd-acd58456ddba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "052cde29-421b-4b17-9bcd-acd58456ddba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:16 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:20:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:16 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:20:16 user nova-compute[72849]: INFO nova.compute.claims [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Claim successful on node user
Aug 15 16:20:16 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:20:16 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Took 0.87 seconds to deallocate network for instance.
Aug 15 16:20:16 user nova-compute[72849]: DEBUG nova.compute.manager [req-bd93f181-3604-407a-a080-3c0dab60b854 req-d8e6dea4-8990-4de2-b290-c1eb4b904cc1 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received event network-vif-deleted-888d8da9-c8a5-40fd-a421-1a8ec1890f25 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:16 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.111s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG nova.network.neutron [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:20:17 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:20:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG nova.policy [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60cbe30799ad4438b84251a254691b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a3a3412c95451db4dd0edc27f361cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:20:17 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Creating image(s)
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "/opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "/opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "/opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.190s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-24145d6c-7bd6-4b9b-bb53-05acb732f8c9 req-75caa175-6d89-4767-b2db-05b1eb2da663 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received event network-vif-plugged-888d8da9-c8a5-40fd-a421-1a8ec1890f25 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-24145d6c-7bd6-4b9b-bb53-05acb732f8c9 req-75caa175-6d89-4767-b2db-05b1eb2da663 service nova] Acquiring lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-24145d6c-7bd6-4b9b-bb53-05acb732f8c9 req-75caa175-6d89-4767-b2db-05b1eb2da663 service nova] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-24145d6c-7bd6-4b9b-bb53-05acb732f8c9 req-75caa175-6d89-4767-b2db-05b1eb2da663 service nova] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-24145d6c-7bd6-4b9b-bb53-05acb732f8c9 req-75caa175-6d89-4767-b2db-05b1eb2da663 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] No waiting events found dispatching network-vif-plugged-888d8da9-c8a5-40fd-a421-1a8ec1890f25 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:17 user nova-compute[72849]: WARNING nova.compute.manager [req-24145d6c-7bd6-4b9b-bb53-05acb732f8c9 req-75caa175-6d89-4767-b2db-05b1eb2da663 service nova] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Received unexpected event network-vif-plugged-888d8da9-c8a5-40fd-a421-1a8ec1890f25 for instance with vm_state deleted and task_state None.
Aug 15 16:20:17 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Deleted allocations for instance 7d843493-eda8-46a9-bb1b-3cc80eed7488
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5a986200-6bf8-49c4-aaf2-37c9cdfedcea tempest-TaggedAttachmentsTest-415257394 tempest-TaggedAttachmentsTest-415257394-project-member] Lock "7d843493-eda8-46a9-bb1b-3cc80eed7488" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.549s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.184s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk 1073741824" returned: 0 in 0.047s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG nova.network.neutron [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Successfully created port: a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.184s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:20:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Cannot resize image /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.objects.instance [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'migration_context' on Instance uuid 052cde29-421b-4b17-9bcd-acd58456ddba {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Ensure instance console log exists: /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.network.neutron [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Successfully updated port: a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "refresh_cache-052cde29-421b-4b17-9bcd-acd58456ddba" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquired lock "refresh_cache-052cde29-421b-4b17-9bcd-acd58456ddba" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.network.neutron [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.network.neutron [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.network.neutron [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Updating instance_info_cache with network_info: [{"id": "a9418a97-870c-46fc-97bc-a65348a97f18", "address": "fa:16:3e:20:6f:8a", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9418a97-87", "ovs_interfaceid": "a9418a97-870c-46fc-97bc-a65348a97f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Releasing lock "refresh_cache-052cde29-421b-4b17-9bcd-acd58456ddba" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Instance network_info: |[{"id": "a9418a97-870c-46fc-97bc-a65348a97f18", "address": "fa:16:3e:20:6f:8a", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9418a97-87", "ovs_interfaceid": "a9418a97-870c-46fc-97bc-a65348a97f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Start _get_guest_xml network_info=[{"id": "a9418a97-870c-46fc-97bc-a65348a97f18", "address": "fa:16:3e:20:6f:8a", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9418a97-87", "ovs_interfaceid": "a9418a97-870c-46fc-97bc-a65348a97f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:20:18 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:20:18 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:20:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1165172925',display_name='tempest-tempest.common.compute-instance-1165172925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1165172925',id=15,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWBknFznF3Br/e4erZ96RmBYDGn9QHpqMDloNSpP2DJ4x6ZpnS6SI2xoXmzVDqEscehLRvnBUFKCcKRhuMKezXg92SXubTl6wUnndM1gWudDEMYfZ38YquQQ+VVBgQblw==',key_name='tempest-keypair-1330851775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33a3a3412c95451db4dd0edc27f361cc',ramdisk_id='',reservation_id='r-8l740hjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-514064593',owner_user_name='tempest-ServerActionsTestOtherA-514064593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:20:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60cbe30799ad4438b84251a254691b70',uuid=052cde29-421b-4b17-9bcd-acd58456ddba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9418a97-870c-46fc-97bc-a65348a97f18", "address": "fa:16:3e:20:6f:8a", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9418a97-87", "ovs_interfaceid": "a9418a97-870c-46fc-97bc-a65348a97f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converting VIF {"id": "a9418a97-870c-46fc-97bc-a65348a97f18", "address": "fa:16:3e:20:6f:8a", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9418a97-87", "ovs_interfaceid": "a9418a97-870c-46fc-97bc-a65348a97f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:6f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a9418a97-870c-46fc-97bc-a65348a97f18,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9418a97-87') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.objects.instance [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'pci_devices' on Instance uuid 052cde29-421b-4b17-9bcd-acd58456ddba {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-06fd07b8-6da9-4dde-b087-81a58a7d631f req-d8e5de4e-57b5-46fe-9a49-9357c74979e3 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received event network-changed-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-06fd07b8-6da9-4dde-b087-81a58a7d631f req-d8e5de4e-57b5-46fe-9a49-9357c74979e3 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Refreshing instance network info cache due to event network-changed-a9418a97-870c-46fc-97bc-a65348a97f18. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-06fd07b8-6da9-4dde-b087-81a58a7d631f req-d8e5de4e-57b5-46fe-9a49-9357c74979e3 service nova] Acquiring lock "refresh_cache-052cde29-421b-4b17-9bcd-acd58456ddba" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-06fd07b8-6da9-4dde-b087-81a58a7d631f req-d8e5de4e-57b5-46fe-9a49-9357c74979e3 service nova] Acquired lock "refresh_cache-052cde29-421b-4b17-9bcd-acd58456ddba" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.network.neutron [req-06fd07b8-6da9-4dde-b087-81a58a7d631f req-d8e5de4e-57b5-46fe-9a49-9357c74979e3 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Refreshing network info cache for port a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:20:18 user nova-compute[72849]:   <uuid>052cde29-421b-4b17-9bcd-acd58456ddba</uuid>
Aug 15 16:20:18 user nova-compute[72849]:   <name>instance-0000000f</name>
Aug 15 16:20:18 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:20:18 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:20:18 user nova-compute[72849]:   <metadata>
Aug 15 16:20:18 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:20:18 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:20:18 user nova-compute[72849]:       <nova:name>tempest-tempest.common.compute-instance-1165172925</nova:name>
Aug 15 16:20:18 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:20:18</nova:creationTime>
Aug 15 16:20:18 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:20:18 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:20:18 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:20:18 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:20:18 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:20:18 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:20:18 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:20:18 user nova-compute[72849]:       <nova:owner>
Aug 15 16:20:18 user nova-compute[72849]:         <nova:user uuid="60cbe30799ad4438b84251a254691b70">tempest-ServerActionsTestOtherA-514064593-project-member</nova:user>
Aug 15 16:20:18 user nova-compute[72849]:         <nova:project uuid="33a3a3412c95451db4dd0edc27f361cc">tempest-ServerActionsTestOtherA-514064593</nova:project>
Aug 15 16:20:18 user nova-compute[72849]:       </nova:owner>
Aug 15 16:20:18 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:20:18 user nova-compute[72849]:       <nova:ports>
Aug 15 16:20:18 user nova-compute[72849]:         <nova:port uuid="a9418a97-870c-46fc-97bc-a65348a97f18">
Aug 15 16:20:18 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:20:18 user nova-compute[72849]:         </nova:port>
Aug 15 16:20:18 user nova-compute[72849]:       </nova:ports>
Aug 15 16:20:18 user nova-compute[72849]:     </nova:instance>
Aug 15 16:20:18 user nova-compute[72849]:   </metadata>
Aug 15 16:20:18 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:20:18 user nova-compute[72849]:     <system>
Aug 15 16:20:18 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:20:18 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:20:18 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:20:18 user nova-compute[72849]:       <entry name="serial">052cde29-421b-4b17-9bcd-acd58456ddba</entry>
Aug 15 16:20:18 user nova-compute[72849]:       <entry name="uuid">052cde29-421b-4b17-9bcd-acd58456ddba</entry>
Aug 15 16:20:18 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:20:18 user nova-compute[72849]:     </system>
Aug 15 16:20:18 user nova-compute[72849]:   </sysinfo>
Aug 15 16:20:18 user nova-compute[72849]:   <os>
Aug 15 16:20:18 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:20:18 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:20:18 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:20:18 user nova-compute[72849]:   </os>
Aug 15 16:20:18 user nova-compute[72849]:   <features>
Aug 15 16:20:18 user nova-compute[72849]:     <acpi/>
Aug 15 16:20:18 user nova-compute[72849]:     <apic/>
Aug 15 16:20:18 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:20:18 user nova-compute[72849]:   </features>
Aug 15 16:20:18 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:20:18 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:20:18 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:20:18 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:20:18 user nova-compute[72849]:   </clock>
Aug 15 16:20:18 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:20:18 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:20:18 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:20:18 user nova-compute[72849]:   </cpu>
Aug 15 16:20:18 user nova-compute[72849]:   <devices>
Aug 15 16:20:18 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:20:18 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:20:18 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk"/>
Aug 15 16:20:18 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:20:18 user nova-compute[72849]:     </disk>
Aug 15 16:20:18 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:20:18 user nova-compute[72849]:       <mac address="fa:16:3e:20:6f:8a"/>
Aug 15 16:20:18 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:20:18 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:20:18 user nova-compute[72849]:       <target dev="tapa9418a97-87"/>
Aug 15 16:20:18 user nova-compute[72849]:     </interface>
Aug 15 16:20:18 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:20:18 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/console.log" append="off"/>
Aug 15 16:20:18 user nova-compute[72849]:     </serial>
Aug 15 16:20:18 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:20:18 user nova-compute[72849]:     <video>
Aug 15 16:20:18 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:20:18 user nova-compute[72849]:     </video>
Aug 15 16:20:18 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:20:18 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:20:18 user nova-compute[72849]:     </rng>
Aug 15 16:20:18 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:20:18 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:20:18 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:20:18 user nova-compute[72849]:     </memballoon>
Aug 15 16:20:18 user nova-compute[72849]:   </devices>
Aug 15 16:20:18 user nova-compute[72849]: </domain>
Aug 15 16:20:18 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:20:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1165172925',display_name='tempest-tempest.common.compute-instance-1165172925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1165172925',id=15,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWBknFznF3Br/e4erZ96RmBYDGn9QHpqMDloNSpP2DJ4x6ZpnS6SI2xoXmzVDqEscehLRvnBUFKCcKRhuMKezXg92SXubTl6wUnndM1gWudDEMYfZ38YquQQ+VVBgQblw==',key_name='tempest-keypair-1330851775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33a3a3412c95451db4dd0edc27f361cc',ramdisk_id='',reservation_id='r-8l740hjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-514064593',owner_user_name='tempest-ServerActionsTestOtherA-514064593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:20:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60cbe30799ad4438b84251a254691b70',uuid=052cde29-421b-4b17-9bcd-acd58456ddba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9418a97-870c-46fc-97bc-a65348a97f18", "address": "fa:16:3e:20:6f:8a", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9418a97-87", "ovs_interfaceid": "a9418a97-870c-46fc-97bc-a65348a97f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converting VIF {"id": "a9418a97-870c-46fc-97bc-a65348a97f18", "address": "fa:16:3e:20:6f:8a", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9418a97-87", "ovs_interfaceid": "a9418a97-870c-46fc-97bc-a65348a97f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:6f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a9418a97-870c-46fc-97bc-a65348a97f18,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9418a97-87') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG os_vif [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:6f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a9418a97-870c-46fc-97bc-a65348a97f18,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9418a97-87') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9418a97-87, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9418a97-87, col_values=(('external_ids', {'iface-id': 'a9418a97-870c-46fc-97bc-a65348a97f18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:6f:8a', 'vm-uuid': '052cde29-421b-4b17-9bcd-acd58456ddba'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:20:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:18 user nova-compute[72849]: INFO os_vif [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:6f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a9418a97-870c-46fc-97bc-a65348a97f18,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9418a97-87')
Aug 15 16:20:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:20:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] No VIF found with MAC fa:16:3e:20:6f:8a, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:20:19 user nova-compute[72849]: DEBUG nova.network.neutron [req-06fd07b8-6da9-4dde-b087-81a58a7d631f req-d8e5de4e-57b5-46fe-9a49-9357c74979e3 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Updated VIF entry in instance network info cache for port a9418a97-870c-46fc-97bc-a65348a97f18. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:20:19 user nova-compute[72849]: DEBUG nova.network.neutron [req-06fd07b8-6da9-4dde-b087-81a58a7d631f req-d8e5de4e-57b5-46fe-9a49-9357c74979e3 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Updating instance_info_cache with network_info: [{"id": "a9418a97-870c-46fc-97bc-a65348a97f18", "address": "fa:16:3e:20:6f:8a", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9418a97-87", "ovs_interfaceid": "a9418a97-870c-46fc-97bc-a65348a97f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:20:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-06fd07b8-6da9-4dde-b087-81a58a7d631f req-d8e5de4e-57b5-46fe-9a49-9357c74979e3 service nova] Releasing lock "refresh_cache-052cde29-421b-4b17-9bcd-acd58456ddba" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:20:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-219fe573-ce0d-419b-9243-278279b5b4e4 req-c8327357-5847-4ea0-ba7d-7b47db874db0 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received event network-vif-plugged-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-219fe573-ce0d-419b-9243-278279b5b4e4 req-c8327357-5847-4ea0-ba7d-7b47db874db0 service nova] Acquiring lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-219fe573-ce0d-419b-9243-278279b5b4e4 req-c8327357-5847-4ea0-ba7d-7b47db874db0 service nova] Lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-219fe573-ce0d-419b-9243-278279b5b4e4 req-c8327357-5847-4ea0-ba7d-7b47db874db0 service nova] Lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-219fe573-ce0d-419b-9243-278279b5b4e4 req-c8327357-5847-4ea0-ba7d-7b47db874db0 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] No waiting events found dispatching network-vif-plugged-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:20 user nova-compute[72849]: WARNING nova.compute.manager [req-219fe573-ce0d-419b-9243-278279b5b4e4 req-c8327357-5847-4ea0-ba7d-7b47db874db0 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received unexpected event network-vif-plugged-a9418a97-870c-46fc-97bc-a65348a97f18 for instance with vm_state building and task_state spawning.
Aug 15 16:20:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.objects.instance [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lazy-loading 'flavor' on Instance uuid b0a869eb-9ee8-4c31-9786-5b8be7d362a9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:22 user nova-compute[72849]: INFO nova.compute.manager [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Attaching volume 4f25b0b3-328d-4f59-9947-1023da21eef5 to /dev/vdb
Aug 15 16:20:22 user nova-compute[72849]: DEBUG os_brick.utils [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eff797a-1fda-4dd0-bcb4-ca85dc644dc0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[baacebfb-8b4c-4258-94fe-00f2d441f419]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed2d576-f238-4b20-bff9-30ab12644270]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9a8391-f5c0-49fc-b7a4-9076a10492fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:20:22 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4f70a0-1f6c-4463-a134-e20d8c902d69]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG os_brick.utils [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updating existing volume attachment record: 74520281-c9a3-4cf5-86da-ef2db2d7f167 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116422.5520978, 052cde29-421b-4b17-9bcd-acd58456ddba => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:20:22 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] VM Resumed (Lifecycle Event)
Aug 15 16:20:22 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Instance spawned successfully.
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:20:22 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116422.5578282, 052cde29-421b-4b17-9bcd-acd58456ddba => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:20:22 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] VM Started (Lifecycle Event)
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:22 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-f478f7d1-ad79-42e7-bc25-d13dbab7dcaf req-b448be8a-640e-4511-af85-062fa65ca2f6 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received event network-vif-plugged-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f478f7d1-ad79-42e7-bc25-d13dbab7dcaf req-b448be8a-640e-4511-af85-062fa65ca2f6 service nova] Acquiring lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f478f7d1-ad79-42e7-bc25-d13dbab7dcaf req-b448be8a-640e-4511-af85-062fa65ca2f6 service nova] Lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f478f7d1-ad79-42e7-bc25-d13dbab7dcaf req-b448be8a-640e-4511-af85-062fa65ca2f6 service nova] Lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-f478f7d1-ad79-42e7-bc25-d13dbab7dcaf req-b448be8a-640e-4511-af85-062fa65ca2f6 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] No waiting events found dispatching network-vif-plugged-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:22 user nova-compute[72849]: WARNING nova.compute.manager [req-f478f7d1-ad79-42e7-bc25-d13dbab7dcaf req-b448be8a-640e-4511-af85-062fa65ca2f6 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received unexpected event network-vif-plugged-a9418a97-870c-46fc-97bc-a65348a97f18 for instance with vm_state building and task_state spawning.
Aug 15 16:20:22 user nova-compute[72849]: INFO nova.compute.manager [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Took 5.49 seconds to spawn the instance on the hypervisor.
Aug 15 16:20:22 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:20:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:22 user nova-compute[72849]: INFO nova.compute.manager [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Took 6.26 seconds to build instance.
Aug 15 16:20:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d80462b-a675-48f0-ba01-b2cfef97236f tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "052cde29-421b-4b17-9bcd-acd58456ddba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.355s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG nova.objects.instance [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lazy-loading 'flavor' on Instance uuid 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:23 user nova-compute[72849]: INFO nova.compute.manager [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Attaching volume c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 to /dev/vdb
Aug 15 16:20:23 user nova-compute[72849]: DEBUG os_brick.utils [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3db4cd-8115-4176-bbac-34622c5c9725]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1b4e89-c1bb-4ae6-bc1c-17a97bf73f1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[79588477-bfa9-4c59-bdc5-bf17cc7fc0ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c11d1a-c229-43f5-82d2-581c1d6bd50a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:20:23 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:20:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb7441c-6e3d-4e22-a76f-a7c85bf90d04]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG os_brick.utils [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Updating existing volume attachment record: 0160bced-be06-4e25-a013-d2fce23ebfcc {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:20:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:24 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116409.4936008, 3954da38-0292-40f7-8ace-6987d0248a44 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:20:24 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] VM Stopped (Lifecycle Event)
Aug 15 16:20:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c9840fa4-5504-475d-b849-1cf20fc767c1 None None] [instance: 3954da38-0292-40f7-8ace-6987d0248a44] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:20:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:27 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:20:27 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:20:27 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:20:27 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:20:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:20:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:20:27 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Updating instance_info_cache with network_info: [{"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:30 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116415.9024086, 7d843493-eda8-46a9-bb1b-3cc80eed7488 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:20:30 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] VM Stopped (Lifecycle Event)
Aug 15 16:20:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-75b61e5c-37ee-4c1c-afd1-3ce7dced6ea5 None None] [instance: 7d843493-eda8-46a9-bb1b-3cc80eed7488] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:20:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVdiagcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:20:33 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:20:33 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:20:33 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fcf47c-50c4-48c3-9326-271b58d0b7ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:20:33 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[02073804-7596-4133-b794-4f6b802c6ae7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5] added
Aug 15 16:20:33 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a59c2b-b993-4954-bed5-5f9cf5edc056]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc37c255-a0a6-4b7b-8abc-2c15671a3923]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVdiagcD {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:33 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:20:33 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:20:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=7453MB free_disk=25.566295623779297GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVdiagcD" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ade8c99-ad10-454c-9c6e-9a73b8904ba7]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zVdiagcD'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bbbf25-4952-4f08-88de-1df75a435be3]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ed599d-0f10-4e62-b0e1-0e93237c48f0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:33 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:33 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c794abd-67aa-4b6d-af76-509ae8217ce6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260]
Aug 15 16:20:33 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260] successful.
Aug 15 16:20:33 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "cc521d87-09aa-44ba-a87c-1cd5517b3707" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b0a869eb-9ee8-4c31-9786-5b8be7d362a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 341edacc-b44b-4d92-9fcd-982c252fcdd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 5c64c95c-74b3-4883-94d2-ee99ff27434e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 8aa1e777-f613-457a-9458-d36b2b6010e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 3a3a822c-230a-47a6-9658-8879957455de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance dea53f90-39ad-4c38-b67b-e23a8ce03d23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 052cde29-421b-4b17-9bcd-acd58456ddba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7b2482-02e1-4edc-8e31-78f5c1a638c6]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc521d87-09aa-44ba-a87c-1cd5517b3707 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4397f813-eb55-44d8-984e-4c602a8d603a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:33 user nova-compute[72849]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:20:33 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:33 user nova-compute[72849]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:20:33 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.929s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc999eca-019e-4fd7-ace1-beeda1fd6694]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVdiagcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:20:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG nova.compute.manager [req-de8f2173-6730-4f40-8533-a70d085ed701 req-f085d389-d995-4e83-8964-01ab79f3b598 service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Received event network-changed-281634e4-b965-40cf-b60f-9c122ec59050 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG nova.compute.manager [req-de8f2173-6730-4f40-8533-a70d085ed701 req-f085d389-d995-4e83-8964-01ab79f3b598 service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Refreshing instance network info cache due to event network-changed-281634e4-b965-40cf-b60f-9c122ec59050. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-de8f2173-6730-4f40-8533-a70d085ed701 req-f085d389-d995-4e83-8964-01ab79f3b598 service nova] Acquiring lock "refresh_cache-8aa1e777-f613-457a-9458-d36b2b6010e9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-de8f2173-6730-4f40-8533-a70d085ed701 req-f085d389-d995-4e83-8964-01ab79f3b598 service nova] Acquired lock "refresh_cache-8aa1e777-f613-457a-9458-d36b2b6010e9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG nova.network.neutron [req-de8f2173-6730-4f40-8533-a70d085ed701 req-f085d389-d995-4e83-8964-01ab79f3b598 service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Refreshing network info cache for port 281634e4-b965-40cf-b60f-9c122ec59050 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.677s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.384s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:20:34 user nova-compute[72849]: INFO nova.compute.claims [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Claim successful on node user
Aug 15 16:20:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "8aa1e777-f613-457a-9458-d36b2b6010e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG nova.objects.instance [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lazy-loading 'flavor' on Instance uuid 8aa1e777-f613-457a-9458-d36b2b6010e9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:34 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Ignoring supplied device name: /dev/vdb
Aug 15 16:20:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhqNZgHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:20:34 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:20:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "46f0aa43-e313-4aff-bacc-aa5290193b00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "8aa1e777-f613-457a-9458-d36b2b6010e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:34 user nova-compute[72849]: INFO nova.compute.manager [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Attaching volume 8ae8920d-dba5-45d2-9974-b1c147634f10 to /dev/vdb
Aug 15 16:20:34 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG nova.network.neutron [req-de8f2173-6730-4f40-8533-a70d085ed701 req-f085d389-d995-4e83-8964-01ab79f3b598 service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Updated VIF entry in instance network info cache for port 281634e4-b965-40cf-b60f-9c122ec59050. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG nova.network.neutron [req-de8f2173-6730-4f40-8533-a70d085ed701 req-f085d389-d995-4e83-8964-01ab79f3b598 service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Updating instance_info_cache with network_info: [{"id": "281634e4-b965-40cf-b60f-9c122ec59050", "address": "fa:16:3e:18:f9:c0", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281634e4-b9", "ovs_interfaceid": "281634e4-b965-40cf-b60f-9c122ec59050", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-de8f2173-6730-4f40-8533-a70d085ed701 req-f085d389-d995-4e83-8964-01ab79f3b598 service nova] Releasing lock "refresh_cache-8aa1e777-f613-457a-9458-d36b2b6010e9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG nova.compute.manager [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.157s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:20:34 user nova-compute[72849]: INFO nova.compute.claims [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Claim successful on node user
Aug 15 16:20:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.983s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] <== connect_volume: return (1985ms) {'type': 'block', 'scsi_wwn': '26337383938643864', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337383938643864', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.448s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:20:34 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:20:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:20:34 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:20:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:34 user nova-compute[72849]: DEBUG nova.objects.instance [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lazy-loading 'flavor' on Instance uuid b0a869eb-9ee8-4c31-9786-5b8be7d362a9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed96457-7cae-4c14-8807-327ef03da4b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG nova.network.neutron [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:20:35 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:20:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:20:35 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:20:35 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:20:35 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:20:35 user nova-compute[72849]:   <serial>4f25b0b3-328d-4f59-9947-1023da21eef5</serial>
Aug 15 16:20:35 user nova-compute[72849]: </disk>
Aug 15 16:20:35 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9214c0cb-582c-4f11-aae7-a4a461aa3343]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4] added
Aug 15 16:20:35 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf2bf3e-d5c6-4d45-8cd4-406d37fb1847]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7732a25f-702f-4376-8057-da657a4ebc56]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG nova.policy [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6bc0fd1358a42debf05e9bc43b8e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fff6abd55f4552b56b7f80f3b19990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RhqNZgHD {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RhqNZgHD" returned: 0 in 0.032s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d961d5a4-f885-4b42-8a92-a27fdb0dfc7d]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RhqNZgHD'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.utils [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfdd5e9-144c-4784-905c-0f26db50b0aa]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bf2218-170b-4369-8ccb-5fea03f1f5a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[529950da-8355-4715-a05c-4bce4d96dcbd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:35 user nova-compute[72849]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:20:35 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:35 user nova-compute[72849]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:20:35 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bae292-442c-4d92-bf65-e81c1bb4f10a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:20:35 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Creating image(s)
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "/opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "/opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7c4f10-949a-4b32-ace7-54c82233a1c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[40178a33-36de-477d-978a-fb519d1c78a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[98adc185-196a-4dc0-b8dd-c573f5633f81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4, portal: 172.16.0.220,3260]
Aug 15 16:20:35 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4, portal: 172.16.0.220,3260] successful.
Aug 15 16:20:35 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:20:35 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7dcff1-e5e7-4b5f-8aeb-c809a210ae29]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.utils [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] <== get_connector_properties: return (233ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Updating existing volume attachment record: fcd88498-75f9-4785-bdbf-017b0dfa5eda {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6996789-639a-4f6e-abb5-83c8c60fa905]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3f51d1-5888-4d0f-af54-06e2a664ebb3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:35 user nova-compute[72849]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:20:35 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:20:35 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:35 user nova-compute[72849]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:20:35 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:20:35 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.489s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.233s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7920eac-048a-404f-9059-811bf30d2693]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhqNZgHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] No VIF found with MAC fa:16:3e:32:86:b5, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.233s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk 1073741824" returned: 0 in 0.057s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0d797480-3880-4014-b895-8478681c8d35 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.509s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:20:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.200s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Cannot resize image /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG nova.objects.instance [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'migration_context' on Instance uuid cc521d87-09aa-44ba-a87c-1cd5517b3707 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Ensure instance console log exists: /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.257s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG nova.network.neutron [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Successfully created port: 010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:20:36 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:20:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:20:36 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Creating image(s)
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "/opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "/opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "/opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG nova.policy [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6bc0fd1358a42debf05e9bc43b8e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fff6abd55f4552b56b7f80f3b19990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.613s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] <== connect_volume: return (2063ms) {'type': 'block', 'scsi_wwn': '26264303361333237', 'path': '/dev/sdc'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264303361333237', 'path': '/dev/sdc'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG nova.objects.instance [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lazy-loading 'flavor' on Instance uuid 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:20:36 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:20:36 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:20:36 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:20:36 user nova-compute[72849]:   <serial>c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4</serial>
Aug 15 16:20:36 user nova-compute[72849]: </disk>
Aug 15 16:20:36 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.195s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.187s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk 1073741824" returned: 0 in 0.062s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] No VIF found with MAC fa:16:3e:04:ca:d5, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.187s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a40198c0-f031-4db4-b5a3-bed87a727b69 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.762s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Cannot resize image /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'migration_context' on Instance uuid 46f0aa43-e313-4aff-bacc-aa5290193b00 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Ensure instance console log exists: /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Successfully created port: 2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG nova.network.neutron [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Successfully updated port: 010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquired lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG nova.network.neutron [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG nova.compute.manager [req-3d7f84dd-5d51-4132-8dc2-7aee7728a4f7 req-accb6f3c-9999-4882-ba49-7f301150ecf6 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received event network-changed-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG nova.compute.manager [req-3d7f84dd-5d51-4132-8dc2-7aee7728a4f7 req-accb6f3c-9999-4882-ba49-7f301150ecf6 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Refreshing instance network info cache due to event network-changed-010fd638-d6f5-40be-b322-8d3f7b1d29de. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3d7f84dd-5d51-4132-8dc2-7aee7728a4f7 req-accb6f3c-9999-4882-ba49-7f301150ecf6 service nova] Acquiring lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:20:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.network.neutron [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:20:38 user nova-compute[72849]: INFO nova.compute.manager [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Rescuing
Aug 15 16:20:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquired lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.network.neutron [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Stashing vm_state: active {{(pid=72849) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.network.neutron [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Updating instance_info_cache with network_info: [{"id": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "address": "fa:16:3e:ca:d6:ea", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010fd638-d6", "ovs_interfaceid": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Releasing lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Instance network_info: |[{"id": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "address": "fa:16:3e:ca:d6:ea", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010fd638-d6", "ovs_interfaceid": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3d7f84dd-5d51-4132-8dc2-7aee7728a4f7 req-accb6f3c-9999-4882-ba49-7f301150ecf6 service nova] Acquired lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.network.neutron [req-3d7f84dd-5d51-4132-8dc2-7aee7728a4f7 req-accb6f3c-9999-4882-ba49-7f301150ecf6 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Refreshing network info cache for port 010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Start _get_guest_xml network_info=[{"id": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "address": "fa:16:3e:ca:d6:ea", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010fd638-d6", "ovs_interfaceid": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:20:38 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:20:38 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:20:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1632196122',display_name='tempest-ServerRescueNegativeTestJSON-server-1632196122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1632196122',id=16,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63fff6abd55f4552b56b7f80f3b19990',ramdisk_id='',reservation_id='r-3orjfdvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-817230683',owner_user_name='tempest-ServerRescueNegativeTestJSON-817230683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:20:35Z,user_data=None,user_id='a6bc0fd1358a42debf05e9bc43b8e329',uuid=cc521d87-09aa-44ba-a87c-1cd5517b3707,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "address": "fa:16:3e:ca:d6:ea", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010fd638-d6", "ovs_interfaceid": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converting VIF {"id": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "address": "fa:16:3e:ca:d6:ea", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010fd638-d6", "ovs_interfaceid": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:d6:ea,bridge_name='br-int',has_traffic_filtering=True,id=010fd638-d6f5-40be-b322-8d3f7b1d29de,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010fd638-d6') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.objects.instance [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'pci_devices' on Instance uuid cc521d87-09aa-44ba-a87c-1cd5517b3707 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:20:38 user nova-compute[72849]:   <uuid>cc521d87-09aa-44ba-a87c-1cd5517b3707</uuid>
Aug 15 16:20:38 user nova-compute[72849]:   <name>instance-00000010</name>
Aug 15 16:20:38 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:20:38 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:20:38 user nova-compute[72849]:   <metadata>
Aug 15 16:20:38 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:20:38 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:20:38 user nova-compute[72849]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1632196122</nova:name>
Aug 15 16:20:38 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:20:38</nova:creationTime>
Aug 15 16:20:38 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:20:38 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:20:38 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:20:38 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:20:38 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:20:38 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:20:38 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:20:38 user nova-compute[72849]:       <nova:owner>
Aug 15 16:20:38 user nova-compute[72849]:         <nova:user uuid="a6bc0fd1358a42debf05e9bc43b8e329">tempest-ServerRescueNegativeTestJSON-817230683-project-member</nova:user>
Aug 15 16:20:38 user nova-compute[72849]:         <nova:project uuid="63fff6abd55f4552b56b7f80f3b19990">tempest-ServerRescueNegativeTestJSON-817230683</nova:project>
Aug 15 16:20:38 user nova-compute[72849]:       </nova:owner>
Aug 15 16:20:38 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:20:38 user nova-compute[72849]:       <nova:ports>
Aug 15 16:20:38 user nova-compute[72849]:         <nova:port uuid="010fd638-d6f5-40be-b322-8d3f7b1d29de">
Aug 15 16:20:38 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 16:20:38 user nova-compute[72849]:         </nova:port>
Aug 15 16:20:38 user nova-compute[72849]:       </nova:ports>
Aug 15 16:20:38 user nova-compute[72849]:     </nova:instance>
Aug 15 16:20:38 user nova-compute[72849]:   </metadata>
Aug 15 16:20:38 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:20:38 user nova-compute[72849]:     <system>
Aug 15 16:20:38 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:20:38 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:20:38 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:20:38 user nova-compute[72849]:       <entry name="serial">cc521d87-09aa-44ba-a87c-1cd5517b3707</entry>
Aug 15 16:20:38 user nova-compute[72849]:       <entry name="uuid">cc521d87-09aa-44ba-a87c-1cd5517b3707</entry>
Aug 15 16:20:38 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:20:38 user nova-compute[72849]:     </system>
Aug 15 16:20:38 user nova-compute[72849]:   </sysinfo>
Aug 15 16:20:38 user nova-compute[72849]:   <os>
Aug 15 16:20:38 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:20:38 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:20:38 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:20:38 user nova-compute[72849]:   </os>
Aug 15 16:20:38 user nova-compute[72849]:   <features>
Aug 15 16:20:38 user nova-compute[72849]:     <acpi/>
Aug 15 16:20:38 user nova-compute[72849]:     <apic/>
Aug 15 16:20:38 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:20:38 user nova-compute[72849]:   </features>
Aug 15 16:20:38 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:20:38 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:20:38 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:20:38 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:20:38 user nova-compute[72849]:   </clock>
Aug 15 16:20:38 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:20:38 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:20:38 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:20:38 user nova-compute[72849]:   </cpu>
Aug 15 16:20:38 user nova-compute[72849]:   <devices>
Aug 15 16:20:38 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:20:38 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:20:38 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk"/>
Aug 15 16:20:38 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:20:38 user nova-compute[72849]:     </disk>
Aug 15 16:20:38 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:20:38 user nova-compute[72849]:       <mac address="fa:16:3e:ca:d6:ea"/>
Aug 15 16:20:38 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:20:38 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:20:38 user nova-compute[72849]:       <target dev="tap010fd638-d6"/>
Aug 15 16:20:38 user nova-compute[72849]:     </interface>
Aug 15 16:20:38 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:20:38 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/console.log" append="off"/>
Aug 15 16:20:38 user nova-compute[72849]:     </serial>
Aug 15 16:20:38 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:20:38 user nova-compute[72849]:     <video>
Aug 15 16:20:38 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:20:38 user nova-compute[72849]:     </video>
Aug 15 16:20:38 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:20:38 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:20:38 user nova-compute[72849]:     </rng>
Aug 15 16:20:38 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:20:38 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:20:38 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:20:38 user nova-compute[72849]:     </memballoon>
Aug 15 16:20:38 user nova-compute[72849]:   </devices>
Aug 15 16:20:38 user nova-compute[72849]: </domain>
Aug 15 16:20:38 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:20:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1632196122',display_name='tempest-ServerRescueNegativeTestJSON-server-1632196122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1632196122',id=16,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63fff6abd55f4552b56b7f80f3b19990',ramdisk_id='',reservation_id='r-3orjfdvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-817230683',owner_user_name='tempest-ServerRescueNegativeTestJSON-817230683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:20:35Z,user_data=None,user_id='a6bc0fd1358a42debf05e9bc43b8e329',uuid=cc521d87-09aa-44ba-a87c-1cd5517b3707,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "address": "fa:16:3e:ca:d6:ea", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010fd638-d6", "ovs_interfaceid": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converting VIF {"id": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "address": "fa:16:3e:ca:d6:ea", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010fd638-d6", "ovs_interfaceid": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:d6:ea,bridge_name='br-int',has_traffic_filtering=True,id=010fd638-d6f5-40be-b322-8d3f7b1d29de,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010fd638-d6') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG os_vif [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:d6:ea,bridge_name='br-int',has_traffic_filtering=True,id=010fd638-d6f5-40be-b322-8d3f7b1d29de,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010fd638-d6') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.objects.instance [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lazy-loading 'pci_requests' on Instance uuid b0a869eb-9ee8-4c31-9786-5b8be7d362a9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap010fd638-d6, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap010fd638-d6, col_values=(('external_ids', {'iface-id': '010fd638-d6f5-40be-b322-8d3f7b1d29de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:d6:ea', 'vm-uuid': 'cc521d87-09aa-44ba-a87c-1cd5517b3707'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:20:38 user nova-compute[72849]: INFO nova.compute.claims [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Claim successful on node user
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.objects.instance [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lazy-loading 'resources' on Instance uuid b0a869eb-9ee8-4c31-9786-5b8be7d362a9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:38 user nova-compute[72849]: INFO os_vif [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:d6:ea,bridge_name='br-int',has_traffic_filtering=True,id=010fd638-d6f5-40be-b322-8d3f7b1d29de,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010fd638-d6')
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.objects.instance [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lazy-loading 'pci_devices' on Instance uuid b0a869eb-9ee8-4c31-9786-5b8be7d362a9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] No VIF found with MAC fa:16:3e:ca:d6:ea, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:20:38 user nova-compute[72849]: DEBUG nova.network.neutron [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Updating instance_info_cache with network_info: [{"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:20:38 user nova-compute[72849]: INFO nova.compute.resource_tracker [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updating resource usage from migration 5def4dc0-2f71-4b78-ac69-f4756ff41fd3
Aug 15 16:20:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Releasing lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-2debbf8f-7fb5-4058-8672-410142572b3e req-5360ab36-0e67-4cb1-9877-941291cceec5 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received event network-vif-unplugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2debbf8f-7fb5-4058-8672-410142572b3e req-5360ab36-0e67-4cb1-9877-941291cceec5 service nova] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2debbf8f-7fb5-4058-8672-410142572b3e req-5360ab36-0e67-4cb1-9877-941291cceec5 service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2debbf8f-7fb5-4058-8672-410142572b3e req-5360ab36-0e67-4cb1-9877-941291cceec5 service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-2debbf8f-7fb5-4058-8672-410142572b3e req-5360ab36-0e67-4cb1-9877-941291cceec5 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] No waiting events found dispatching network-vif-unplugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:39 user nova-compute[72849]: WARNING nova.compute.manager [req-2debbf8f-7fb5-4058-8672-410142572b3e req-5360ab36-0e67-4cb1-9877-941291cceec5 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received unexpected event network-vif-unplugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 for instance with vm_state active and task_state rescuing.
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.688s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:39 user nova-compute[72849]: INFO nova.compute.manager [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Migrating
Aug 15 16:20:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:20:39 user nova-compute[72849]: INFO nova.compute.rpcapi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 15 16:20:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquired lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.network.neutron [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Successfully updated port: 2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "refresh_cache-46f0aa43-e313-4aff-bacc-aa5290193b00" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquired lock "refresh_cache-46f0aa43-e313-4aff-bacc-aa5290193b00" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-3d7f84dd-5d51-4132-8dc2-7aee7728a4f7 req-accb6f3c-9999-4882-ba49-7f301150ecf6 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Updated VIF entry in instance network info cache for port 010fd638-d6f5-40be-b322-8d3f7b1d29de. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-3d7f84dd-5d51-4132-8dc2-7aee7728a4f7 req-accb6f3c-9999-4882-ba49-7f301150ecf6 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Updating instance_info_cache with network_info: [{"id": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "address": "fa:16:3e:ca:d6:ea", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010fd638-d6", "ovs_interfaceid": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3d7f84dd-5d51-4132-8dc2-7aee7728a4f7 req-accb6f3c-9999-4882-ba49-7f301150ecf6 service nova] Releasing lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-71fefb19-d32b-4d58-9f9a-4edc975e0e4c req-8d85e585-7136-4cc5-ad27-0f8931644502 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Received event network-changed-2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-71fefb19-d32b-4d58-9f9a-4edc975e0e4c req-8d85e585-7136-4cc5-ad27-0f8931644502 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Refreshing instance network info cache due to event network-changed-2e6eba8c-01a5-4e16-95da-51ce996ed2eb. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-71fefb19-d32b-4d58-9f9a-4edc975e0e4c req-8d85e585-7136-4cc5-ad27-0f8931644502 service nova] Acquiring lock "refresh_cache-46f0aa43-e313-4aff-bacc-aa5290193b00" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Updating instance_info_cache with network_info: [{"id": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "address": "fa:16:3e:dc:17:58", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6eba8c-01", "ovs_interfaceid": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Releasing lock "refresh_cache-46f0aa43-e313-4aff-bacc-aa5290193b00" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Instance network_info: |[{"id": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "address": "fa:16:3e:dc:17:58", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6eba8c-01", "ovs_interfaceid": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-71fefb19-d32b-4d58-9f9a-4edc975e0e4c req-8d85e585-7136-4cc5-ad27-0f8931644502 service nova] Acquired lock "refresh_cache-46f0aa43-e313-4aff-bacc-aa5290193b00" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-71fefb19-d32b-4d58-9f9a-4edc975e0e4c req-8d85e585-7136-4cc5-ad27-0f8931644502 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Refreshing network info cache for port 2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Start _get_guest_xml network_info=[{"id": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "address": "fa:16:3e:dc:17:58", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6eba8c-01", "ovs_interfaceid": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:20:39 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:20:39 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:20:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1098266755',display_name='tempest-ServerRescueNegativeTestJSON-server-1098266755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1098266755',id=17,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63fff6abd55f4552b56b7f80f3b19990',ramdisk_id='',reservation_id='r-0yzyeyqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-817230683',owner_user_name='tempest-ServerRescueNegativeTestJSON-817230683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:20:36Z,user_data=None,user_id='a6bc0fd1358a42debf05e9bc43b8e329',uuid=46f0aa43-e313-4aff-bacc-aa5290193b00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "address": "fa:16:3e:dc:17:58", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6eba8c-01", "ovs_interfaceid": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converting VIF {"id": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "address": "fa:16:3e:dc:17:58", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6eba8c-01", "ovs_interfaceid": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:17:58,bridge_name='br-int',has_traffic_filtering=True,id=2e6eba8c-01a5-4e16-95da-51ce996ed2eb,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6eba8c-01') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'pci_devices' on Instance uuid 46f0aa43-e313-4aff-bacc-aa5290193b00 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:20:39 user nova-compute[72849]:   <uuid>46f0aa43-e313-4aff-bacc-aa5290193b00</uuid>
Aug 15 16:20:39 user nova-compute[72849]:   <name>instance-00000011</name>
Aug 15 16:20:39 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:20:39 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:20:39 user nova-compute[72849]:   <metadata>
Aug 15 16:20:39 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:20:39 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:20:39 user nova-compute[72849]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1098266755</nova:name>
Aug 15 16:20:39 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:20:39</nova:creationTime>
Aug 15 16:20:39 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:20:39 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:20:39 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:20:39 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:20:39 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:20:39 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:20:39 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:20:39 user nova-compute[72849]:       <nova:owner>
Aug 15 16:20:39 user nova-compute[72849]:         <nova:user uuid="a6bc0fd1358a42debf05e9bc43b8e329">tempest-ServerRescueNegativeTestJSON-817230683-project-member</nova:user>
Aug 15 16:20:39 user nova-compute[72849]:         <nova:project uuid="63fff6abd55f4552b56b7f80f3b19990">tempest-ServerRescueNegativeTestJSON-817230683</nova:project>
Aug 15 16:20:39 user nova-compute[72849]:       </nova:owner>
Aug 15 16:20:39 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:20:39 user nova-compute[72849]:       <nova:ports>
Aug 15 16:20:39 user nova-compute[72849]:         <nova:port uuid="2e6eba8c-01a5-4e16-95da-51ce996ed2eb">
Aug 15 16:20:39 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 16:20:39 user nova-compute[72849]:         </nova:port>
Aug 15 16:20:39 user nova-compute[72849]:       </nova:ports>
Aug 15 16:20:39 user nova-compute[72849]:     </nova:instance>
Aug 15 16:20:39 user nova-compute[72849]:   </metadata>
Aug 15 16:20:39 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:20:39 user nova-compute[72849]:     <system>
Aug 15 16:20:39 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:20:39 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:20:39 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:20:39 user nova-compute[72849]:       <entry name="serial">46f0aa43-e313-4aff-bacc-aa5290193b00</entry>
Aug 15 16:20:39 user nova-compute[72849]:       <entry name="uuid">46f0aa43-e313-4aff-bacc-aa5290193b00</entry>
Aug 15 16:20:39 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:20:39 user nova-compute[72849]:     </system>
Aug 15 16:20:39 user nova-compute[72849]:   </sysinfo>
Aug 15 16:20:39 user nova-compute[72849]:   <os>
Aug 15 16:20:39 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:20:39 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:20:39 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:20:39 user nova-compute[72849]:   </os>
Aug 15 16:20:39 user nova-compute[72849]:   <features>
Aug 15 16:20:39 user nova-compute[72849]:     <acpi/>
Aug 15 16:20:39 user nova-compute[72849]:     <apic/>
Aug 15 16:20:39 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:20:39 user nova-compute[72849]:   </features>
Aug 15 16:20:39 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:20:39 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:20:39 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:20:39 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:20:39 user nova-compute[72849]:   </clock>
Aug 15 16:20:39 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:20:39 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:20:39 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:20:39 user nova-compute[72849]:   </cpu>
Aug 15 16:20:39 user nova-compute[72849]:   <devices>
Aug 15 16:20:39 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:20:39 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:20:39 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk"/>
Aug 15 16:20:39 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:20:39 user nova-compute[72849]:     </disk>
Aug 15 16:20:39 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:20:39 user nova-compute[72849]:       <mac address="fa:16:3e:dc:17:58"/>
Aug 15 16:20:39 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:20:39 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:20:39 user nova-compute[72849]:       <target dev="tap2e6eba8c-01"/>
Aug 15 16:20:39 user nova-compute[72849]:     </interface>
Aug 15 16:20:39 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:20:39 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/console.log" append="off"/>
Aug 15 16:20:39 user nova-compute[72849]:     </serial>
Aug 15 16:20:39 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:20:39 user nova-compute[72849]:     <video>
Aug 15 16:20:39 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:20:39 user nova-compute[72849]:     </video>
Aug 15 16:20:39 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:20:39 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:20:39 user nova-compute[72849]:     </rng>
Aug 15 16:20:39 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:20:39 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:20:39 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:20:39 user nova-compute[72849]:     </memballoon>
Aug 15 16:20:39 user nova-compute[72849]:   </devices>
Aug 15 16:20:39 user nova-compute[72849]: </domain>
Aug 15 16:20:39 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:20:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1098266755',display_name='tempest-ServerRescueNegativeTestJSON-server-1098266755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1098266755',id=17,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63fff6abd55f4552b56b7f80f3b19990',ramdisk_id='',reservation_id='r-0yzyeyqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-817230683',owner_user_name='tempest-ServerRescueNegativeTestJSON-817230683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:20:36Z,user_data=None,user_id='a6bc0fd1358a42debf05e9bc43b8e329',uuid=46f0aa43-e313-4aff-bacc-aa5290193b00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "address": "fa:16:3e:dc:17:58", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6eba8c-01", "ovs_interfaceid": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converting VIF {"id": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "address": "fa:16:3e:dc:17:58", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6eba8c-01", "ovs_interfaceid": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:17:58,bridge_name='br-int',has_traffic_filtering=True,id=2e6eba8c-01a5-4e16-95da-51ce996ed2eb,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6eba8c-01') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG os_vif [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:17:58,bridge_name='br-int',has_traffic_filtering=True,id=2e6eba8c-01a5-4e16-95da-51ce996ed2eb,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6eba8c-01') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e6eba8c-01, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e6eba8c-01, col_values=(('external_ids', {'iface-id': '2e6eba8c-01a5-4e16-95da-51ce996ed2eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:17:58', 'vm-uuid': '46f0aa43-e313-4aff-bacc-aa5290193b00'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG nova.network.neutron [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updating instance_info_cache with network_info: [{"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Releasing lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:40 user nova-compute[72849]: INFO os_vif [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:17:58,bridge_name='br-int',has_traffic_filtering=True,id=2e6eba8c-01a5-4e16-95da-51ce996ed2eb,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6eba8c-01')
Aug 15 16:20:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] No VIF found with MAC fa:16:3e:dc:17:58, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Starting migrate_disk_and_power_off {{(pid=72849) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG nova.network.neutron [req-71fefb19-d32b-4d58-9f9a-4edc975e0e4c req-8d85e585-7136-4cc5-ad27-0f8931644502 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Updated VIF entry in instance network info cache for port 2e6eba8c-01a5-4e16-95da-51ce996ed2eb. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG nova.network.neutron [req-71fefb19-d32b-4d58-9f9a-4edc975e0e4c req-8d85e585-7136-4cc5-ad27-0f8931644502 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Updating instance_info_cache with network_info: [{"id": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "address": "fa:16:3e:dc:17:58", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6eba8c-01", "ovs_interfaceid": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-71fefb19-d32b-4d58-9f9a-4edc975e0e4c req-8d85e585-7136-4cc5-ad27-0f8931644502 service nova] Releasing lock "refresh_cache-46f0aa43-e313-4aff-bacc-aa5290193b00" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:20:40 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Instance destroyed successfully.
Aug 15 16:20:40 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Attempting a stable device rescue
Aug 15 16:20:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72849) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Instance directory exists: not creating {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 16:20:40 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Creating image(s)
Aug 15 16:20:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "/opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "/opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG nova.objects.instance [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "a6d35f0f6b941ddf8c27e3e1154eb3e13855c955" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "a6d35f0f6b941ddf8c27e3e1154eb3e13855c955" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d35f0f6b941ddf8c27e3e1154eb3e13855c955.part --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-025376d8-0274-4d7c-8b04-0d68b45365aa req-bf00a1fa-b119-451c-b030-805782157f75 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received event network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-025376d8-0274-4d7c-8b04-0d68b45365aa req-bf00a1fa-b119-451c-b030-805782157f75 service nova] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-025376d8-0274-4d7c-8b04-0d68b45365aa req-bf00a1fa-b119-451c-b030-805782157f75 service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-025376d8-0274-4d7c-8b04-0d68b45365aa req-bf00a1fa-b119-451c-b030-805782157f75 service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-025376d8-0274-4d7c-8b04-0d68b45365aa req-bf00a1fa-b119-451c-b030-805782157f75 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] No waiting events found dispatching network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:41 user nova-compute[72849]: WARNING nova.compute.manager [req-025376d8-0274-4d7c-8b04-0d68b45365aa req-bf00a1fa-b119-451c-b030-805782157f75 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received unexpected event network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 for instance with vm_state active and task_state rescuing.
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Acquiring lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Acquiring lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:41 user nova-compute[72849]: INFO nova.compute.manager [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Terminating instance
Aug 15 16:20:41 user nova-compute[72849]: DEBUG nova.compute.manager [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d35f0f6b941ddf8c27e3e1154eb3e13855c955.part --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG nova.virt.images [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] 2a6c261b-ddcf-4118-84b6-4ba0872a2fec was qcow2, converting to raw {{(pid=72849) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG nova.privsep.utils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72849) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a6d35f0f6b941ddf8c27e3e1154eb3e13855c955.part /opt/stack/data/nova/instances/_base/a6d35f0f6b941ddf8c27e3e1154eb3e13855c955.converted {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a6d35f0f6b941ddf8c27e3e1154eb3e13855c955.part /opt/stack/data/nova/instances/_base/a6d35f0f6b941ddf8c27e3e1154eb3e13855c955.converted" returned: 0 in 0.212s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d35f0f6b941ddf8c27e3e1154eb3e13855c955.converted --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-0c794ca0-f711-45c9-b57b-5da81f7513f2 req-05aa51cc-1bf1-4b90-a07a-b687bdfe3748 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received event network-vif-unplugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0c794ca0-f711-45c9-b57b-5da81f7513f2 req-05aa51cc-1bf1-4b90-a07a-b687bdfe3748 service nova] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0c794ca0-f711-45c9-b57b-5da81f7513f2 req-05aa51cc-1bf1-4b90-a07a-b687bdfe3748 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0c794ca0-f711-45c9-b57b-5da81f7513f2 req-05aa51cc-1bf1-4b90-a07a-b687bdfe3748 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-0c794ca0-f711-45c9-b57b-5da81f7513f2 req-05aa51cc-1bf1-4b90-a07a-b687bdfe3748 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] No waiting events found dispatching network-vif-unplugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:41 user nova-compute[72849]: WARNING nova.compute.manager [req-0c794ca0-f711-45c9-b57b-5da81f7513f2 req-05aa51cc-1bf1-4b90-a07a-b687bdfe3748 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received unexpected event network-vif-unplugged-25a67315-9859-4077-8f36-23635b760770 for instance with vm_state active and task_state resize_migrating.
Aug 15 16:20:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-0c794ca0-f711-45c9-b57b-5da81f7513f2 req-05aa51cc-1bf1-4b90-a07a-b687bdfe3748 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received event network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0c794ca0-f711-45c9-b57b-5da81f7513f2 req-05aa51cc-1bf1-4b90-a07a-b687bdfe3748 service nova] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0c794ca0-f711-45c9-b57b-5da81f7513f2 req-05aa51cc-1bf1-4b90-a07a-b687bdfe3748 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0c794ca0-f711-45c9-b57b-5da81f7513f2 req-05aa51cc-1bf1-4b90-a07a-b687bdfe3748 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-0c794ca0-f711-45c9-b57b-5da81f7513f2 req-05aa51cc-1bf1-4b90-a07a-b687bdfe3748 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] No waiting events found dispatching network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:41 user nova-compute[72849]: WARNING nova.compute.manager [req-0c794ca0-f711-45c9-b57b-5da81f7513f2 req-05aa51cc-1bf1-4b90-a07a-b687bdfe3748 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received unexpected event network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 for instance with vm_state active and task_state resize_migrating.
Aug 15 16:20:42 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Instance destroyed successfully.
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1690114442',display_name='tempest-ServerActionsTestOtherB-server-1690114442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1690114442',id=3,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+hh3mOCKtCImu1/lg7z7Mltoc1di1aJCPq0550JQzfICBVP48YFxiWhHNSQqhuSWVzxUKF+hNAtXneGjvrY/qA0OutpYd9sLJegliqP2OTf5sqdDZP815XUZAuWEPAcQ==',key_name='tempest-keypair-493994408',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:16:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b16b734f348e4d9ca7faba1f84f188a8',ramdisk_id='',reservation_id='r-43bap4gi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1970367935',owner_user_name='tempest-ServerActionsTestOtherB-1970367935-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:20:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90af38c3a2a64683a12871bb2a5e0a0f',uuid=b0a869eb-9ee8-4c31-9786-5b8be7d362a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1585365231-network", "vif_mac": "fa:16:3e:32:86:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Converting VIF {"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1585365231-network", "vif_mac": "fa:16:3e:32:86:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_vif [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25a67315-98, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d35f0f6b941ddf8c27e3e1154eb3e13855c955.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "a6d35f0f6b941ddf8c27e3e1154eb3e13855c955" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.464s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "a6d35f0f6b941ddf8c27e3e1154eb3e13855c955" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "a6d35f0f6b941ddf8c27e3e1154eb3e13855c955" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d35f0f6b941ddf8c27e3e1154eb3e13855c955 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:42 user nova-compute[72849]: INFO os_vif [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98')
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVdiagcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:20:42 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[42506f4c-1a9e-4ddf-830e-06fdff105a7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[96000ee0-68a9-427d-8a5d-e627a82ff964]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:42 user nova-compute[72849]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:20:42 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:20:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:42 user nova-compute[72849]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:20:42 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:20:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc35827e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71e49ac-707b-4dc0-86ea-fc1dcf311267]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[265d0bd6-d4d9-4d6e-9bf7-fcaa350e71da]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d35f0f6b941ddf8c27e3e1154eb3e13855c955 --force-share --output=json" returned: 0 in 0.212s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a6d35f0f6b941ddf8c27e3e1154eb3e13855c955,backing_fmt=raw /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk.rescue {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a583e5c-ec9f-4d5a-aeae-ae723a45d18d]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a6d35f0f6b941ddf8c27e3e1154eb3e13855c955,backing_fmt=raw /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk.rescue" returned: 0 in 0.062s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "a6d35f0f6b941ddf8c27e3e1154eb3e13855c955" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.objects.instance [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lazy-loading 'migration_context' on Instance uuid 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Start _get_guest_xml network_info=[{"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "vif_mac": "fa:16:3e:04:ca:d5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2a6c261b-ddcf-4118-84b6-4ba0872a2fec', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhqNZgHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '0c3852fa-b6ac-440f-ae2d-3f482c83b3f5', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4', 'serial': 'c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '0160bced-be06-4e25-a013-d2fce23ebfcc', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.objects.instance [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lazy-loading 'resources' on Instance uuid 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[438e49e7-a29a-4c7d-a9d6-358d9d013347]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.objects.instance [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lazy-loading 'numa_topology' on Instance uuid 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c4d6aa-9a94-4853-9c21-c4442daab879]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:20:42 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.objects.instance [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhqNZgHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:20:42 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cba162d-a643-4849-9fa6-1a93b572d6ff]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260]
Aug 15 16:20:42 user nova-compute[72849]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260] successful.
Aug 15 16:20:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be17fc5-f59d-4d5d-a509-21f52bdab82d]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] <== disconnect_volume: return (445ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.045s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:20:42 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:20:42 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:20:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[061c0ada-f1a6-45cd-a8eb-c070616bd86f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = RhqNZgHD\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 16:20:42 user nova-compute[72849]: node.name = iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4
Aug 15 16:20:42 user nova-compute[72849]: node.tpgt = -1
Aug 15 16:20:42 user nova-compute[72849]: node.startup = automatic
Aug 15 16:20:42 user nova-compute[72849]: node.leading_login = No
Aug 15 16:20:42 user nova-compute[72849]: iface.iscsi_ifacename = default
Aug 15 16:20:42 user nova-compute[72849]: iface.net_ifacename = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.ipaddress = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.prefix_len = 0
Aug 15 16:20:42 user nova-compute[72849]: iface.hwaddress = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.transport_name = tcp
Aug 15 16:20:42 user nova-compute[72849]: iface.initiatorname = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.state = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.vlan_id = 0
Aug 15 16:20:42 user nova-compute[72849]: iface.vlan_priority = 0
Aug 15 16:20:42 user nova-compute[72849]: iface.vlan_state = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.iface_num = 0
Aug 15 16:20:42 user nova-compute[72849]: iface.mtu = 0
Aug 15 16:20:42 user nova-compute[72849]: iface.port = 0
Aug 15 16:20:42 user nova-compute[72849]: iface.bootproto = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.subnet_mask = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.gateway = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.dhcp_alt_client_id = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.dhcp_dns = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.dhcp_learn_iqn = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.dhcp_vendor_id_state = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.dhcp_vendor_id = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.dhcp_slp_da = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.fragmentation = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.gratuitous_arp = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.incoming_forwarding = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.tos_state = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.tos = 0
Aug 15 16:20:42 user nova-compute[72849]: iface.ttl = 0
Aug 15 16:20:42 user nova-compute[72849]: iface.delayed_ack = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.tcp_nagle = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.tcp_wsf_state = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.tcp_wsf = 0
Aug 15 16:20:42 user nova-compute[72849]: iface.tcp_timer_scale = 0
Aug 15 16:20:42 user nova-compute[72849]: iface.tcp_timestamp = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.redirect = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.def_task_mgmt_timeout = 0
Aug 15 16:20:42 user nova-compute[72849]: iface.header_digest = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.data_digest = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.immediate_data = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.initial_r2t = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.data_seq_inorder = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.data_pdu_inorder = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.erl = 0
Aug 15 16:20:42 user nova-compute[72849]: iface.max_receive_data_len = 0
Aug 15 16:20:42 user nova-compute[72849]: iface.first_burst_len = 0
Aug 15 16:20:42 user nova-compute[72849]: iface.max_outstanding_r2t = 0
Aug 15 16:20:42 user nova-compute[72849]: iface.max_burst_len = 0
Aug 15 16:20:42 user nova-compute[72849]: iface.chap_auth = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.bidi_chap = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.strict_login_compliance = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.discovery_auth = <empty>
Aug 15 16:20:42 user nova-compute[72849]: iface.discovery_logout = <empty>
Aug 15 16:20:42 user nova-compute[72849]: node.discovery_address = <empty>
Aug 15 16:20:42 user nova-compute[72849]: node.discovery_port = 0
Aug 15 16:20:42 user nova-compute[72849]: node.discovery_type = static
Aug 15 16:20:42 user nova-compute[72849]: node.session.initial_cmdsn = 0
Aug 15 16:20:42 user nova-compute[72849]: node.session.initial_login_retry_max = 8
Aug 15 16:20:42 user nova-compute[72849]: node.session.xmit_thread_priority = -20
Aug 15 16:20:42 user nova-compute[72849]: node.session.cmds_max = 128
Aug 15 16:20:42 user nova-compute[72849]: node.session.queue_depth = 32
Aug 15 16:20:42 user nova-compute[72849]: node.session.nr_sessions = 1
Aug 15 16:20:42 user nova-compute[72849]: node.session.auth.authmethod = CHAP
Aug 15 16:20:42 user nova-compute[72849]: node.session.auth.username = RhqNZgHD
Aug 15 16:20:42 user nova-compute[72849]: node.session.auth.password = ***
Aug 15 16:20:42 user nova-compute[72849]: node.session.auth.username_in = <empty>
Aug 15 16:20:42 user nova-compute[72849]: node.session.auth.password_in = <empty>
Aug 15 16:20:42 user nova-compute[72849]: node.session.auth.chap_algs = MD5
Aug 15 16:20:42 user nova-compute[72849]: node.session.timeo.replacement_timeout = 120
Aug 15 16:20:42 user nova-compute[72849]: node.session.err_timeo.abort_timeout = 15
Aug 15 16:20:42 user nova-compute[72849]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 16:20:42 user nova-compute[72849]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 16:20:42 user nova-compute[72849]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 16:20:42 user nova-compute[72849]: node.session.iscsi.FastAbort = Yes
Aug 15 16:20:42 user nova-compute[72849]: node.session.iscsi.InitialR2T = No
Aug 15 16:20:42 user nova-compute[72849]: node.session.iscsi.ImmediateData = Yes
Aug 15 16:20:42 user nova-compute[72849]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 16:20:42 user nova-compute[72849]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 16:20:42 user nova-compute[72849]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 16:20:42 user nova-compute[72849]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 16:20:42 user nova-compute[72849]: node.session.iscsi.MaxConnections = 1
Aug 15 16:20:42 user nova-compute[72849]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 16:20:42 user nova-compute[72849]: node.session.iscsi.ERL = 0
Aug 15 16:20:42 user nova-compute[72849]: node.session.scan = manual
Aug 15 16:20:42 user nova-compute[72849]: node.session.reopen_max = 0
Aug 15 16:20:42 user nova-compute[72849]: node.conn[0].address = 172.16.0.220
Aug 15 16:20:42 user nova-compute[72849]: node.conn[0].port = 3260
Aug 15 16:20:42 user nova-compute[72849]: node.conn[0].startup = manual
Aug 15 16:20:42 user nova-compute[72849]: node.conn[0].tcp.window_size = 524288
Aug 15 16:20:42 user nova-compute[72849]: node.conn[0].tcp.type_of_service = 0
Aug 15 16:20:42 user nova-compute[72849]: node.conn[0].timeo.logout_timeout = 15
Aug 15 16:20:42 user nova-compute[72849]: node.conn[0].timeo.login_timeout = 15
Aug 15 16:20:42 user nova-compute[72849]: node.conn[0].timeo.auth_timeout = 45
Aug 15 16:20:42 user nova-compute[72849]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 16:20:42 user nova-compute[72849]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 16:20:42 user nova-compute[72849]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 16:20:42 user nova-compute[72849]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 16:20:42 user nova-compute[72849]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 16:20:42 user nova-compute[72849]: node.conn[0].iscsi.DataDigest = None
Aug 15 16:20:42 user nova-compute[72849]: node.conn[0].iscsi.IFMarker = No
Aug 15 16:20:42 user nova-compute[72849]: node.conn[0].iscsi.OFMarker = No
Aug 15 16:20:42 user nova-compute[72849]: # END RECORD
Aug 15 16:20:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[37944815-9be9-41d2-a667-dc4f3fbfc1e4]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[698e362f-3340-4a4a-bf39-e24c246a6821]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RhqNZgHD {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RhqNZgHD" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[70001baf-79c3-4946-a382-fa46eaecc354]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RhqNZgHD'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0a2dad-76b8-484a-b165-dd53c02b2f31]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7322034b-705c-481d-a2b2-4db38fc8c66b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:42 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:20:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:42 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:20:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.200s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] HCTL ('34', '0', '0', 0) found on session 14 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[570d2eed-3bf5-45e4-8355-d7601dfc1453]: (4, ('0 0 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Searching for a device in session 14 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhqNZgHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.233s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] <== connect_volume: return (277ms) {'type': 'block', 'scsi_wwn': '26264303361333237', 'path': '/dev/sdc'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264303361333237', 'path': '/dev/sdc'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-918445447',display_name='tempest-ServerStableDeviceRescueTest-server-918445447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-918445447',id=4,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlOvfVfqg+jJ0bzYqLK8rxyT7IxbPiXMZf2towszTNT8nSCk0Uoj/ulcw2jeQ97uYI95SkThbUeiHUFFMo9IWaJZbAIkib3lSXB42nBCTEgR439byBh1S5hepErtyn5ug==',key_name='tempest-keypair-676744820',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45f8316b45f4418583171fa8691dfe66',ramdisk_id='',reservation_id='r-0l0s337g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-839484866',owner_user_name='tempest-ServerStableDeviceRescueTest-839484866-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:18:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0ab3fef694144f39a31c1a17c854bb2',uuid=0c3852fa-b6ac-440f-ae2d-3f482c83b3f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "vif_mac": "fa:16:3e:04:ca:d5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Converting VIF {"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "vif_mac": "fa:16:3e:04:ca:d5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:ca:d5,bridge_name='br-int',has_traffic_filtering=True,id=fc17db49-50e4-4186-af46-e3cbd2dd7677,network=Network(550e2e81-51b2-436e-819b-42379e48b495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc17db49-50') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:20:42 user nova-compute[72849]: DEBUG nova.objects.instance [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:20:43 user nova-compute[72849]:   <uuid>0c3852fa-b6ac-440f-ae2d-3f482c83b3f5</uuid>
Aug 15 16:20:43 user nova-compute[72849]:   <name>instance-00000004</name>
Aug 15 16:20:43 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:20:43 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:20:43 user nova-compute[72849]:   <metadata>
Aug 15 16:20:43 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:20:43 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:20:43 user nova-compute[72849]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-918445447</nova:name>
Aug 15 16:20:43 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:20:42</nova:creationTime>
Aug 15 16:20:43 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:20:43 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:20:43 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:20:43 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:20:43 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:20:43 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:20:43 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:20:43 user nova-compute[72849]:       <nova:owner>
Aug 15 16:20:43 user nova-compute[72849]:         <nova:user uuid="e0ab3fef694144f39a31c1a17c854bb2">tempest-ServerStableDeviceRescueTest-839484866-project-member</nova:user>
Aug 15 16:20:43 user nova-compute[72849]:         <nova:project uuid="45f8316b45f4418583171fa8691dfe66">tempest-ServerStableDeviceRescueTest-839484866</nova:project>
Aug 15 16:20:43 user nova-compute[72849]:       </nova:owner>
Aug 15 16:20:43 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:20:43 user nova-compute[72849]:       <nova:ports>
Aug 15 16:20:43 user nova-compute[72849]:         <nova:port uuid="fc17db49-50e4-4186-af46-e3cbd2dd7677">
Aug 15 16:20:43 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 16:20:43 user nova-compute[72849]:         </nova:port>
Aug 15 16:20:43 user nova-compute[72849]:       </nova:ports>
Aug 15 16:20:43 user nova-compute[72849]:     </nova:instance>
Aug 15 16:20:43 user nova-compute[72849]:   </metadata>
Aug 15 16:20:43 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:20:43 user nova-compute[72849]:     <system>
Aug 15 16:20:43 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:20:43 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:20:43 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:20:43 user nova-compute[72849]:       <entry name="serial">0c3852fa-b6ac-440f-ae2d-3f482c83b3f5</entry>
Aug 15 16:20:43 user nova-compute[72849]:       <entry name="uuid">0c3852fa-b6ac-440f-ae2d-3f482c83b3f5</entry>
Aug 15 16:20:43 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:20:43 user nova-compute[72849]:     </system>
Aug 15 16:20:43 user nova-compute[72849]:   </sysinfo>
Aug 15 16:20:43 user nova-compute[72849]:   <os>
Aug 15 16:20:43 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:20:43 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:20:43 user nova-compute[72849]:   </os>
Aug 15 16:20:43 user nova-compute[72849]:   <features>
Aug 15 16:20:43 user nova-compute[72849]:     <acpi/>
Aug 15 16:20:43 user nova-compute[72849]:     <apic/>
Aug 15 16:20:43 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:20:43 user nova-compute[72849]:   </features>
Aug 15 16:20:43 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:20:43 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:20:43 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:20:43 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:20:43 user nova-compute[72849]:   </clock>
Aug 15 16:20:43 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:20:43 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:20:43 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:20:43 user nova-compute[72849]:   </cpu>
Aug 15 16:20:43 user nova-compute[72849]:   <devices>
Aug 15 16:20:43 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:20:43 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:20:43 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk"/>
Aug 15 16:20:43 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:20:43 user nova-compute[72849]:     </disk>
Aug 15 16:20:43 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:20:43 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:20:43 user nova-compute[72849]:       <source dev="/dev/sdc"/>
Aug 15 16:20:43 user nova-compute[72849]:       <target dev="vdb" bus="virtio"/>
Aug 15 16:20:43 user nova-compute[72849]:       <serial>c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4</serial>
Aug 15 16:20:43 user nova-compute[72849]:     </disk>
Aug 15 16:20:43 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:20:43 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:20:43 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk.rescue"/>
Aug 15 16:20:43 user nova-compute[72849]:       <target dev="vdc" bus="virtio"/>
Aug 15 16:20:43 user nova-compute[72849]:       <boot order="1"/>
Aug 15 16:20:43 user nova-compute[72849]:     </disk>
Aug 15 16:20:43 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:20:43 user nova-compute[72849]:       <mac address="fa:16:3e:04:ca:d5"/>
Aug 15 16:20:43 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:20:43 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:20:43 user nova-compute[72849]:       <target dev="tapfc17db49-50"/>
Aug 15 16:20:43 user nova-compute[72849]:     </interface>
Aug 15 16:20:43 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:20:43 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/console.log" append="off"/>
Aug 15 16:20:43 user nova-compute[72849]:     </serial>
Aug 15 16:20:43 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:20:43 user nova-compute[72849]:     <video>
Aug 15 16:20:43 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:20:43 user nova-compute[72849]:     </video>
Aug 15 16:20:43 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:20:43 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:20:43 user nova-compute[72849]:     </rng>
Aug 15 16:20:43 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:20:43 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:20:43 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:20:43 user nova-compute[72849]:     </memballoon>
Aug 15 16:20:43 user nova-compute[72849]:   </devices>
Aug 15 16:20:43 user nova-compute[72849]: </domain>
Aug 15 16:20:43 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:20:43 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Instance destroyed successfully.
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9_resize/disk /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] No VIF found with MAC fa:16:3e:04:ca:d5, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CMD "cp -r /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9_resize/disk /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk" returned: 0 in 0.408s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9_resize/disk.info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk.info {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CMD "cp -r /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9_resize/disk.info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk.info" returned: 0 in 0.041s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received event network-vif-unplugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] Acquiring lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] No waiting events found dispatching network-vif-unplugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received event network-vif-unplugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received event network-vif-plugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] Acquiring lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] No waiting events found dispatching network-vif-plugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:43 user nova-compute[72849]: WARNING nova.compute.manager [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received unexpected event network-vif-plugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 for instance with vm_state active and task_state deleting.
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received event network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] Acquiring lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] No waiting events found dispatching network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:43 user nova-compute[72849]: WARNING nova.compute.manager [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received unexpected event network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de for instance with vm_state building and task_state spawning.
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received event network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] Acquiring lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] No waiting events found dispatching network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:43 user nova-compute[72849]: WARNING nova.compute.manager [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received unexpected event network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de for instance with vm_state building and task_state spawning.
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received event network-vif-plugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] Acquiring lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] No waiting events found dispatching network-vif-plugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:43 user nova-compute[72849]: WARNING nova.compute.manager [req-6aebfe2e-fed1-4036-8adf-ff5c07d7684f req-0a93b202-c5fa-4c2a-87da-013aeba6a25d service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received unexpected event network-vif-plugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 for instance with vm_state active and task_state deleting.
Aug 15 16:20:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:43 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Instance destroyed successfully.
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.objects.instance [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lazy-loading 'resources' on Instance uuid 5c64c95c-74b3-4883-94d2-ee99ff27434e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1404482482',display_name='tempest-TestVolumeSwap-server-1404482482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1404482482',id=9,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLaBHKDX+X3fd1RTY+ja/SKlxlHanevj0RHqdFc1OVmkWXiPM+/hoqM/lyYZhJ4KEks7QfJHAf83BSbwkksZMlHSgx9w9SchF+XrBveDvyGVK/80gerpyDJZL7Q3QQTtw==',key_name='tempest-keypair-1595369339',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:17:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8f1c82bdf46429a93a6dd2973b7f919',ramdisk_id='',reservation_id='r-obt89w0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1560445128',owner_user_name='tempest-TestVolumeSwap-1560445128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:17:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5b056f1b3934edabf209f63a331b71c',uuid=5c64c95c-74b3-4883-94d2-ee99ff27434e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "address": "fa:16:3e:64:08:de", "network": {"id": "367bc2da-ca51-4fa8-a4f9-70a3344f28b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-621548180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8f1c82bdf46429a93a6dd2973b7f919", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c27980b-1f", "ovs_interfaceid": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Converting VIF {"id": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "address": "fa:16:3e:64:08:de", "network": {"id": "367bc2da-ca51-4fa8-a4f9-70a3344f28b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-621548180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8f1c82bdf46429a93a6dd2973b7f919", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c27980b-1f", "ovs_interfaceid": "9c27980b-1f4d-4a61-9648-9ed67abcb551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:08:de,bridge_name='br-int',has_traffic_filtering=True,id=9c27980b-1f4d-4a61-9648-9ed67abcb551,network=Network(367bc2da-ca51-4fa8-a4f9-70a3344f28b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c27980b-1f') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG os_vif [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:08:de,bridge_name='br-int',has_traffic_filtering=True,id=9c27980b-1f4d-4a61-9648-9ed67abcb551,network=Network(367bc2da-ca51-4fa8-a4f9-70a3344f28b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c27980b-1f') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c27980b-1f, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:43 user nova-compute[72849]: INFO os_vif [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:08:de,bridge_name='br-int',has_traffic_filtering=True,id=9c27980b-1f4d-4a61-9648-9ed67abcb551,network=Network(367bc2da-ca51-4fa8-a4f9-70a3344f28b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c27980b-1f')
Aug 15 16:20:43 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Deleting instance files /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e_del
Aug 15 16:20:43 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Deletion of /opt/stack/data/nova/instances/5c64c95c-74b3-4883-94d2-ee99ff27434e_del complete
Aug 15 16:20:43 user nova-compute[72849]: INFO nova.compute.manager [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Took 2.23 seconds to destroy the instance on the hypervisor.
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-a40e1a88-4db8-4444-956a-bf31c406245c req-7d759582-e373-4664-af9e-5fa602dd72fe service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Received event network-vif-plugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a40e1a88-4db8-4444-956a-bf31c406245c req-7d759582-e373-4664-af9e-5fa602dd72fe service nova] Acquiring lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a40e1a88-4db8-4444-956a-bf31c406245c req-7d759582-e373-4664-af9e-5fa602dd72fe service nova] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a40e1a88-4db8-4444-956a-bf31c406245c req-7d759582-e373-4664-af9e-5fa602dd72fe service nova] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-a40e1a88-4db8-4444-956a-bf31c406245c req-7d759582-e373-4664-af9e-5fa602dd72fe service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] No waiting events found dispatching network-vif-plugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:43 user nova-compute[72849]: WARNING nova.compute.manager [req-a40e1a88-4db8-4444-956a-bf31c406245c req-7d759582-e373-4664-af9e-5fa602dd72fe service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Received unexpected event network-vif-plugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb for instance with vm_state building and task_state spawning.
Aug 15 16:20:44 user nova-compute[72849]: DEBUG nova.network.neutron [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Port 25a67315-9859-4077-8f36-23635b760770 binding to destination host user is already ACTIVE {{(pid=72849) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 16:20:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:44 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:20:44 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Took 1.04 seconds to deallocate network for instance.
Aug 15 16:20:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquired lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG nova.network.neutron [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received event network-vif-plugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] Acquiring lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] No waiting events found dispatching network-vif-plugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:45 user nova-compute[72849]: WARNING nova.compute.manager [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received unexpected event network-vif-plugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 for instance with vm_state deleted and task_state None.
Aug 15 16:20:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received event network-vif-unplugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] Acquiring lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] No waiting events found dispatching network-vif-unplugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:45 user nova-compute[72849]: WARNING nova.compute.manager [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received unexpected event network-vif-unplugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 for instance with vm_state deleted and task_state None.
Aug 15 16:20:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received event network-vif-plugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] Acquiring lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] No waiting events found dispatching network-vif-plugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:45 user nova-compute[72849]: WARNING nova.compute.manager [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received unexpected event network-vif-plugged-9c27980b-1f4d-4a61-9648-9ed67abcb551 for instance with vm_state deleted and task_state None.
Aug 15 16:20:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received event network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] No waiting events found dispatching network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:45 user nova-compute[72849]: WARNING nova.compute.manager [req-8e4aa288-aa75-47c0-a824-668b64107abf req-cc9661ed-8ff2-4bbb-91eb-6a7ffe9f5cf9 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received unexpected event network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 for instance with vm_state active and task_state rescuing.
Aug 15 16:20:45 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.733s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:45 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Deleted allocations for instance 5c64c95c-74b3-4883-94d2-ee99ff27434e
Aug 15 16:20:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b314c14f-dd8c-4766-b0e3-e8bad9a4cf49 tempest-TestVolumeSwap-1560445128 tempest-TestVolumeSwap-1560445128-project-member] Lock "5c64c95c-74b3-4883-94d2-ee99ff27434e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.276s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG nova.compute.manager [req-0b466615-b4c8-4327-a5ea-22f56e8adb5b req-918c0e75-6d01-470e-865b-95f1f197b527 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Received event network-vif-plugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0b466615-b4c8-4327-a5ea-22f56e8adb5b req-918c0e75-6d01-470e-865b-95f1f197b527 service nova] Acquiring lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0b466615-b4c8-4327-a5ea-22f56e8adb5b req-918c0e75-6d01-470e-865b-95f1f197b527 service nova] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0b466615-b4c8-4327-a5ea-22f56e8adb5b req-918c0e75-6d01-470e-865b-95f1f197b527 service nova] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG nova.compute.manager [req-0b466615-b4c8-4327-a5ea-22f56e8adb5b req-918c0e75-6d01-470e-865b-95f1f197b527 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] No waiting events found dispatching network-vif-plugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:46 user nova-compute[72849]: WARNING nova.compute.manager [req-0b466615-b4c8-4327-a5ea-22f56e8adb5b req-918c0e75-6d01-470e-865b-95f1f197b527 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Received unexpected event network-vif-plugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb for instance with vm_state building and task_state spawning.
Aug 15 16:20:46 user nova-compute[72849]: DEBUG nova.compute.manager [req-0b466615-b4c8-4327-a5ea-22f56e8adb5b req-918c0e75-6d01-470e-865b-95f1f197b527 service nova] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Received event network-vif-deleted-9c27980b-1f4d-4a61-9648-9ed67abcb551 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG nova.network.neutron [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updating instance_info_cache with network_info: [{"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Releasing lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG os_brick.utils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[befb59d0-bdc7-40cf-82a1-b3d20c0af6e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfee61ae-41b1-4a0f-b9f2-0922836742a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[249e8436-3593-48f9-aa5f-95c23f3b473a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37b9d9f-72be-41ab-ac1a-52d507cd9302]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:20:46 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:20:46 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e7e0c4-b2ec-48f5-8a4a-bd3d8808946b]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:20:46 user nova-compute[72849]: DEBUG os_brick.utils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116447.0160303, cc521d87-09aa-44ba-a87c-1cd5517b3707 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:20:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] VM Resumed (Lifecycle Event)
Aug 15 16:20:47 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Instance spawned successfully.
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:20:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116447.016406, cc521d87-09aa-44ba-a87c-1cd5517b3707 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:20:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] VM Started (Lifecycle Event)
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:20:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:20:47 user nova-compute[72849]: INFO nova.compute.manager [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Took 11.92 seconds to spawn the instance on the hypervisor.
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116447.1834173, 46f0aa43-e313-4aff-bacc-aa5290193b00 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:20:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] VM Resumed (Lifecycle Event)
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:20:47 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Instance spawned successfully.
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:20:47 user nova-compute[72849]: INFO nova.compute.manager [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Took 13.30 seconds to build instance.
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:20:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116447.1859152, 46f0aa43-e313-4aff-bacc-aa5290193b00 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:20:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] VM Started (Lifecycle Event)
Aug 15 16:20:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-84cf306a-272b-4335-9ad4-c9b44a46d143 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.414s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:20:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:20:47 user nova-compute[72849]: INFO nova.compute.manager [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Took 10.82 seconds to spawn the instance on the hypervisor.
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:20:47 user nova-compute[72849]: INFO nova.compute.manager [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Took 12.64 seconds to build instance.
Aug 15 16:20:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d3e1d19-6cae-4369-a531-d0d337f49780 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.756s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [req-2310d374-7ef5-4350-8a57-b426d4bc1312 req-ab2a5eaa-4b1c-4051-8582-9106ed4ac71a service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received event network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2310d374-7ef5-4350-8a57-b426d4bc1312 req-ab2a5eaa-4b1c-4051-8582-9106ed4ac71a service nova] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2310d374-7ef5-4350-8a57-b426d4bc1312 req-ab2a5eaa-4b1c-4051-8582-9106ed4ac71a service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2310d374-7ef5-4350-8a57-b426d4bc1312 req-ab2a5eaa-4b1c-4051-8582-9106ed4ac71a service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [req-2310d374-7ef5-4350-8a57-b426d4bc1312 req-ab2a5eaa-4b1c-4051-8582-9106ed4ac71a service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] No waiting events found dispatching network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:47 user nova-compute[72849]: WARNING nova.compute.manager [req-2310d374-7ef5-4350-8a57-b426d4bc1312 req-ab2a5eaa-4b1c-4051-8582-9106ed4ac71a service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received unexpected event network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 for instance with vm_state active and task_state rescuing.
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Removed pending event for 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 due to event {{(pid=72849) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116447.665983, 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:20:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] VM Resumed (Lifecycle Event)
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-b0772415-c4f4-41b2-8f56-fcc2ffbb9f3b tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:20:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116447.6671445, 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:20:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] VM Started (Lifecycle Event)
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:20:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsuXNRmC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:20:52 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:20:52 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:20:52 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Acquiring lock "3a3a822c-230a-47a6-9658-8879957455de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lock "3a3a822c-230a-47a6-9658-8879957455de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Acquiring lock "3a3a822c-230a-47a6-9658-8879957455de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lock "3a3a822c-230a-47a6-9658-8879957455de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lock "3a3a822c-230a-47a6-9658-8879957455de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:52 user nova-compute[72849]: INFO nova.compute.manager [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Terminating instance
Aug 15 16:20:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac83f79a-0af2-493b-a7d7-5d71baf85532]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:20:52 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d174ce87-5f12-4c5a-adb7-738fb0a5f1db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10] added
Aug 15 16:20:52 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c389cb-08a2-425d-86f9-34359e52d892]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3c5547-bbd6-4863-8c33-1635777a9729]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vsuXNRmC {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vsuXNRmC" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[74195907-b86d-454c-ac52-adb1646ad7b2]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vsuXNRmC'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86c47dd-bae2-4df6-9841-fdc16e977a7f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba5e7b1-f3b6-484e-a390-f2fca0e2c7b1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:52 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:20:52 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:52 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:20:52 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d87e723-e557-4f3d-a91b-f0f382018770]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10, portal: 172.16.0.220,3260]
Aug 15 16:20:52 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10, portal: 172.16.0.220,3260] successful.
Aug 15 16:20:52 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a556a53-a533-49b4-bbbb-58de48782557]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c71563-7c68-46cb-a7dd-d91e0881a721]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:52 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:20:52 user nova-compute[72849]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 (non-flash)
Aug 15 16:20:52 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:52 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:20:52 user nova-compute[72849]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 (non-flash)
Aug 15 16:20:52 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f527f1f9-61df-4273-98fb-805fef375e19]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:20:52 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsuXNRmC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-e4c31243-17ae-4c3b-83e1-a744fbed3b51 req-b3186c14-013e-4078-a848-65f0a326adc8 service nova] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Received event network-vif-unplugged-cd7e0007-7124-4f85-a443-a8235d548f2c {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e4c31243-17ae-4c3b-83e1-a744fbed3b51 req-b3186c14-013e-4078-a848-65f0a326adc8 service nova] Acquiring lock "3a3a822c-230a-47a6-9658-8879957455de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e4c31243-17ae-4c3b-83e1-a744fbed3b51 req-b3186c14-013e-4078-a848-65f0a326adc8 service nova] Lock "3a3a822c-230a-47a6-9658-8879957455de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e4c31243-17ae-4c3b-83e1-a744fbed3b51 req-b3186c14-013e-4078-a848-65f0a326adc8 service nova] Lock "3a3a822c-230a-47a6-9658-8879957455de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-e4c31243-17ae-4c3b-83e1-a744fbed3b51 req-b3186c14-013e-4078-a848-65f0a326adc8 service nova] [instance: 3a3a822c-230a-47a6-9658-8879957455de] No waiting events found dispatching network-vif-unplugged-cd7e0007-7124-4f85-a443-a8235d548f2c {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-e4c31243-17ae-4c3b-83e1-a744fbed3b51 req-b3186c14-013e-4078-a848-65f0a326adc8 service nova] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Received event network-vif-unplugged-cd7e0007-7124-4f85-a443-a8235d548f2c for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:20:53 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Instance destroyed successfully.
Aug 15 16:20:53 user nova-compute[72849]: DEBUG nova.objects.instance [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lazy-loading 'resources' on Instance uuid 3a3a822c-230a-47a6-9658-8879957455de {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:18:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-90235108',display_name='tempest-VolumesActionsTest-instance-90235108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-90235108',id=12,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:18:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93e1a6b448bb4977a32e860f74031e08',ramdisk_id='',reservation_id='r-230htpye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-130541901',owner_user_name='tempest-VolumesActionsTest-130541901-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:18:56Z,user_data=None,user_id='1bd2b852f1ae4a1b9e379632a2aa0ce4',uuid=3a3a822c-230a-47a6-9658-8879957455de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd7e0007-7124-4f85-a443-a8235d548f2c", "address": "fa:16:3e:35:3a:88", "network": {"id": "cceef6cd-453d-4e81-b737-d1b78ad420e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-628785557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e1a6b448bb4977a32e860f74031e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7e0007-71", "ovs_interfaceid": "cd7e0007-7124-4f85-a443-a8235d548f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Converting VIF {"id": "cd7e0007-7124-4f85-a443-a8235d548f2c", "address": "fa:16:3e:35:3a:88", "network": {"id": "cceef6cd-453d-4e81-b737-d1b78ad420e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-628785557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e1a6b448bb4977a32e860f74031e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7e0007-71", "ovs_interfaceid": "cd7e0007-7124-4f85-a443-a8235d548f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:3a:88,bridge_name='br-int',has_traffic_filtering=True,id=cd7e0007-7124-4f85-a443-a8235d548f2c,network=Network(cceef6cd-453d-4e81-b737-d1b78ad420e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7e0007-71') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG os_vif [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3a:88,bridge_name='br-int',has_traffic_filtering=True,id=cd7e0007-7124-4f85-a443-a8235d548f2c,network=Network(cceef6cd-453d-4e81-b737-d1b78ad420e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7e0007-71') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd7e0007-71, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:20:53 user nova-compute[72849]: INFO os_vif [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3a:88,bridge_name='br-int',has_traffic_filtering=True,id=cd7e0007-7124-4f85-a443-a8235d548f2c,network=Network(cceef6cd-453d-4e81-b737-d1b78ad420e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7e0007-71')
Aug 15 16:20:53 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Deleting instance files /opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de_del
Aug 15 16:20:53 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Deletion of /opt/stack/data/nova/instances/3a3a822c-230a-47a6-9658-8879957455de_del complete
Aug 15 16:20:53 user nova-compute[72849]: INFO nova.compute.manager [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 15 16:20:53 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 3a3a822c-230a-47a6-9658-8879957455de] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '23530343532336535', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530343532336535', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG nova.objects.instance [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lazy-loading 'flavor' on Instance uuid 8aa1e777-f613-457a-9458-d36b2b6010e9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:20:53 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:20:53 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:20:53 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:20:53 user nova-compute[72849]:   <serial>8ae8920d-dba5-45d2-9974-b1c147634f10</serial>
Aug 15 16:20:53 user nova-compute[72849]: </disk>
Aug 15 16:20:53 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:20:54 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:20:54 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Took 0.70 seconds to deallocate network for instance.
Aug 15 16:20:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:20:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:20:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] No VIF found with MAC fa:16:3e:18:f9:c0, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:20:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cd34ef17-f1d9-4c17-8131-eb944b6548d8 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.138s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:54 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:20:54 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:20:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.627s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:54 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Deleted allocations for instance 3a3a822c-230a-47a6-9658-8879957455de
Aug 15 16:20:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2b61f96d-df74-4760-8de7-67dc3470f0e1 tempest-VolumesActionsTest-130541901 tempest-VolumesActionsTest-130541901-project-member] Lock "3a3a822c-230a-47a6-9658-8879957455de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.603s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-33cfbd31-c84b-468f-9989-a1dd9e4ec1c3 req-ae14f696-539e-4549-8de5-3e153452f8f5 service nova] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Received event network-vif-plugged-cd7e0007-7124-4f85-a443-a8235d548f2c {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-33cfbd31-c84b-468f-9989-a1dd9e4ec1c3 req-ae14f696-539e-4549-8de5-3e153452f8f5 service nova] Acquiring lock "3a3a822c-230a-47a6-9658-8879957455de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-33cfbd31-c84b-468f-9989-a1dd9e4ec1c3 req-ae14f696-539e-4549-8de5-3e153452f8f5 service nova] Lock "3a3a822c-230a-47a6-9658-8879957455de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-33cfbd31-c84b-468f-9989-a1dd9e4ec1c3 req-ae14f696-539e-4549-8de5-3e153452f8f5 service nova] Lock "3a3a822c-230a-47a6-9658-8879957455de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-33cfbd31-c84b-468f-9989-a1dd9e4ec1c3 req-ae14f696-539e-4549-8de5-3e153452f8f5 service nova] [instance: 3a3a822c-230a-47a6-9658-8879957455de] No waiting events found dispatching network-vif-plugged-cd7e0007-7124-4f85-a443-a8235d548f2c {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:20:55 user nova-compute[72849]: WARNING nova.compute.manager [req-33cfbd31-c84b-468f-9989-a1dd9e4ec1c3 req-ae14f696-539e-4549-8de5-3e153452f8f5 service nova] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Received unexpected event network-vif-plugged-cd7e0007-7124-4f85-a443-a8235d548f2c for instance with vm_state deleted and task_state None.
Aug 15 16:20:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-33cfbd31-c84b-468f-9989-a1dd9e4ec1c3 req-ae14f696-539e-4549-8de5-3e153452f8f5 service nova] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Received event network-vif-deleted-cd7e0007-7124-4f85-a443-a8235d548f2c {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:20:56 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116441.892027, b0a869eb-9ee8-4c31-9786-5b8be7d362a9 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:20:56 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] VM Stopped (Lifecycle Event)
Aug 15 16:20:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c812611d-3f2d-4a55-b966-18fb7ed82990 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:20:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c812611d-3f2d-4a55-b966-18fb7ed82990 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:20:57 user nova-compute[72849]: INFO nova.compute.manager [None req-c812611d-3f2d-4a55-b966-18fb7ed82990 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 16:20:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Starting finish_migration {{(pid=72849) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 15 16:20:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Instance directory exists: not creating {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 16:20:57 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Creating image(s)
Aug 15 16:20:57 user nova-compute[72849]: DEBUG nova.objects.instance [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lazy-loading 'trusted_certs' on Instance uuid b0a869eb-9ee8-4c31-9786-5b8be7d362a9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.215s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk. size=21474836480 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk 21474836480 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk 21474836480" returned: 0 in 0.094s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Did not create local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Ensure instance console log exists: /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Start _get_guest_xml network_info=[{"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1585365231-network", "vif_mac": "fa:16:3e:32:86:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVdiagcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b0a869eb-9ee8-4c31-9786-5b8be7d362a9', 'attached_at': '2023-08-15T16:20:58.000000', 'detached_at': '', 'volume_id': '4f25b0b3-328d-4f59-9947-1023da21eef5', 'serial': '4f25b0b3-328d-4f59-9947-1023da21eef5'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '0d5ef06a-4eae-4b7f-be6a-58f95fe8ef41', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:20:58 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:20:58 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:20:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.objects.instance [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lazy-loading 'vcpu_model' on Instance uuid b0a869eb-9ee8-4c31-9786-5b8be7d362a9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVdiagcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:20:58 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:20:58 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:20:58 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e108675b-afcd-41c4-9daf-2185791953be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:20:58 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bb8487-596a-42d2-bf0c-46721297d910]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5] added
Aug 15 16:20:58 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7966d657-a725-40cc-bfb1-86e0d78f9f1d]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f490ba7f-4b10-489b-8cad-cbe4b3bb8956]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVdiagcD {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVdiagcD" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d94c841-a4a4-4199-a150-77b83c76620b]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zVdiagcD'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1994af-5939-4141-a528-c0623baab04b]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[443745e9-5867-471d-91cc-7fb302514326]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:58 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:20:58 user nova-compute[72849]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 (non-flash)
Aug 15 16:20:58 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:58 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:20:58 user nova-compute[72849]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 (non-flash)
Aug 15 16:20:58 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116443.756278, 5c64c95c-74b3-4883-94d2-ee99ff27434e => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:20:58 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] VM Stopped (Lifecycle Event)
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[931ba30e-087d-4622-a55e-a69e24171eca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260]
Aug 15 16:20:58 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260] successful.
Aug 15 16:20:58 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4fa0b785-1134-4ab2-9c75-a9ef0571df0d None None] [instance: 5c64c95c-74b3-4883-94d2-ee99ff27434e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e22f605-e9d9-4be1-8dda-89a461ea8074]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6084bab7-e00f-48d4-b89d-31620c8684cf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:58 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:20:58 user nova-compute[72849]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 (non-flash)
Aug 15 16:20:58 user nova-compute[72849]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:20:58 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:20:58 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:20:58 user nova-compute[72849]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 (non-flash)
Aug 15 16:20:58 user nova-compute[72849]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:20:58 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8893dd9c-e6cf-492b-af05-62fa27a66fc7]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:20:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVdiagcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26337383938643864', 'path': '/dev/sdd'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337383938643864', 'path': '/dev/sdd'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1690114442',display_name='tempest-ServerActionsTestOtherB-server-1690114442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1690114442',id=3,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+hh3mOCKtCImu1/lg7z7Mltoc1di1aJCPq0550JQzfICBVP48YFxiWhHNSQqhuSWVzxUKF+hNAtXneGjvrY/qA0OutpYd9sLJegliqP2OTf5sqdDZP815XUZAuWEPAcQ==',key_name='tempest-keypair-493994408',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:16:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b16b734f348e4d9ca7faba1f84f188a8',ramdisk_id='',reservation_id='r-43bap4gi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1970367935',owner_user_name='tempest-ServerActionsTestOtherB-1970367935-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:20:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90af38c3a2a64683a12871bb2a5e0a0f',uuid=b0a869eb-9ee8-4c31-9786-5b8be7d362a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1585365231-network", "vif_mac": "fa:16:3e:32:86:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Converting VIF {"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1585365231-network", "vif_mac": "fa:16:3e:32:86:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:20:59 user nova-compute[72849]:   <uuid>b0a869eb-9ee8-4c31-9786-5b8be7d362a9</uuid>
Aug 15 16:20:59 user nova-compute[72849]:   <name>instance-00000003</name>
Aug 15 16:20:59 user nova-compute[72849]:   <memory>2097152</memory>
Aug 15 16:20:59 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:20:59 user nova-compute[72849]:   <metadata>
Aug 15 16:20:59 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:20:59 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:20:59 user nova-compute[72849]:       <nova:name>tempest-ServerActionsTestOtherB-server-1690114442</nova:name>
Aug 15 16:20:59 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:20:58</nova:creationTime>
Aug 15 16:20:59 user nova-compute[72849]:       <nova:flavor name="m1.small">
Aug 15 16:20:59 user nova-compute[72849]:         <nova:memory>2048</nova:memory>
Aug 15 16:20:59 user nova-compute[72849]:         <nova:disk>20</nova:disk>
Aug 15 16:20:59 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:20:59 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:20:59 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:20:59 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:20:59 user nova-compute[72849]:       <nova:owner>
Aug 15 16:20:59 user nova-compute[72849]:         <nova:user uuid="90af38c3a2a64683a12871bb2a5e0a0f">tempest-ServerActionsTestOtherB-1970367935-project-member</nova:user>
Aug 15 16:20:59 user nova-compute[72849]:         <nova:project uuid="b16b734f348e4d9ca7faba1f84f188a8">tempest-ServerActionsTestOtherB-1970367935</nova:project>
Aug 15 16:20:59 user nova-compute[72849]:       </nova:owner>
Aug 15 16:20:59 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:20:59 user nova-compute[72849]:       <nova:ports>
Aug 15 16:20:59 user nova-compute[72849]:         <nova:port uuid="25a67315-9859-4077-8f36-23635b760770">
Aug 15 16:20:59 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 16:20:59 user nova-compute[72849]:         </nova:port>
Aug 15 16:20:59 user nova-compute[72849]:       </nova:ports>
Aug 15 16:20:59 user nova-compute[72849]:     </nova:instance>
Aug 15 16:20:59 user nova-compute[72849]:   </metadata>
Aug 15 16:20:59 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:20:59 user nova-compute[72849]:     <system>
Aug 15 16:20:59 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:20:59 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:20:59 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:20:59 user nova-compute[72849]:       <entry name="serial">b0a869eb-9ee8-4c31-9786-5b8be7d362a9</entry>
Aug 15 16:20:59 user nova-compute[72849]:       <entry name="uuid">b0a869eb-9ee8-4c31-9786-5b8be7d362a9</entry>
Aug 15 16:20:59 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:20:59 user nova-compute[72849]:     </system>
Aug 15 16:20:59 user nova-compute[72849]:   </sysinfo>
Aug 15 16:20:59 user nova-compute[72849]:   <os>
Aug 15 16:20:59 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:20:59 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:20:59 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:20:59 user nova-compute[72849]:   </os>
Aug 15 16:20:59 user nova-compute[72849]:   <features>
Aug 15 16:20:59 user nova-compute[72849]:     <acpi/>
Aug 15 16:20:59 user nova-compute[72849]:     <apic/>
Aug 15 16:20:59 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:20:59 user nova-compute[72849]:   </features>
Aug 15 16:20:59 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:20:59 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:20:59 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:20:59 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:20:59 user nova-compute[72849]:   </clock>
Aug 15 16:20:59 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:20:59 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:20:59 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:20:59 user nova-compute[72849]:   </cpu>
Aug 15 16:20:59 user nova-compute[72849]:   <devices>
Aug 15 16:20:59 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:20:59 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:20:59 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk"/>
Aug 15 16:20:59 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:20:59 user nova-compute[72849]:     </disk>
Aug 15 16:20:59 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:20:59 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:20:59 user nova-compute[72849]:       <source dev="/dev/sdd"/>
Aug 15 16:20:59 user nova-compute[72849]:       <target dev="vdb" bus="virtio"/>
Aug 15 16:20:59 user nova-compute[72849]:       <serial>4f25b0b3-328d-4f59-9947-1023da21eef5</serial>
Aug 15 16:20:59 user nova-compute[72849]:     </disk>
Aug 15 16:20:59 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:20:59 user nova-compute[72849]:       <mac address="fa:16:3e:32:86:b5"/>
Aug 15 16:20:59 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:20:59 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:20:59 user nova-compute[72849]:       <target dev="tap25a67315-98"/>
Aug 15 16:20:59 user nova-compute[72849]:     </interface>
Aug 15 16:20:59 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:20:59 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/console.log" append="off"/>
Aug 15 16:20:59 user nova-compute[72849]:     </serial>
Aug 15 16:20:59 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:20:59 user nova-compute[72849]:     <video>
Aug 15 16:20:59 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:20:59 user nova-compute[72849]:     </video>
Aug 15 16:20:59 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:20:59 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:20:59 user nova-compute[72849]:     </rng>
Aug 15 16:20:59 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:20:59 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:20:59 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:20:59 user nova-compute[72849]:     </memballoon>
Aug 15 16:20:59 user nova-compute[72849]:   </devices>
Aug 15 16:20:59 user nova-compute[72849]: </domain>
Aug 15 16:20:59 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1690114442',display_name='tempest-ServerActionsTestOtherB-server-1690114442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1690114442',id=3,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+hh3mOCKtCImu1/lg7z7Mltoc1di1aJCPq0550JQzfICBVP48YFxiWhHNSQqhuSWVzxUKF+hNAtXneGjvrY/qA0OutpYd9sLJegliqP2OTf5sqdDZP815XUZAuWEPAcQ==',key_name='tempest-keypair-493994408',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:16:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b16b734f348e4d9ca7faba1f84f188a8',ramdisk_id='',reservation_id='r-43bap4gi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1970367935',owner_user_name='tempest-ServerActionsTestOtherB-1970367935-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:20:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90af38c3a2a64683a12871bb2a5e0a0f',uuid=b0a869eb-9ee8-4c31-9786-5b8be7d362a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1585365231-network", "vif_mac": "fa:16:3e:32:86:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Converting VIF {"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1585365231-network", "vif_mac": "fa:16:3e:32:86:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG os_vif [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25a67315-98, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25a67315-98, col_values=(('external_ids', {'iface-id': '25a67315-9859-4077-8f36-23635b760770', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:86:b5', 'vm-uuid': 'b0a869eb-9ee8-4c31-9786-5b8be7d362a9'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:20:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:20:59 user nova-compute[72849]: INFO os_vif [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98')
Aug 15 16:21:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:21:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:21:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] No VIF found with MAC fa:16:3e:32:86:b5, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:21:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:02 user nova-compute[72849]: DEBUG nova.compute.manager [req-197cbc87-acdc-47d4-8fc3-ec2f5dc50aa6 req-8902097a-4f6e-4f08-aa4f-e74185a5fad5 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received event network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:21:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-197cbc87-acdc-47d4-8fc3-ec2f5dc50aa6 req-8902097a-4f6e-4f08-aa4f-e74185a5fad5 service nova] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-197cbc87-acdc-47d4-8fc3-ec2f5dc50aa6 req-8902097a-4f6e-4f08-aa4f-e74185a5fad5 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-197cbc87-acdc-47d4-8fc3-ec2f5dc50aa6 req-8902097a-4f6e-4f08-aa4f-e74185a5fad5 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:02 user nova-compute[72849]: DEBUG nova.compute.manager [req-197cbc87-acdc-47d4-8fc3-ec2f5dc50aa6 req-8902097a-4f6e-4f08-aa4f-e74185a5fad5 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] No waiting events found dispatching network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:21:02 user nova-compute[72849]: WARNING nova.compute.manager [req-197cbc87-acdc-47d4-8fc3-ec2f5dc50aa6 req-8902097a-4f6e-4f08-aa4f-e74185a5fad5 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received unexpected event network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 for instance with vm_state active and task_state resize_finish.
Aug 15 16:21:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:04 user nova-compute[72849]: DEBUG nova.compute.manager [req-2cf8f077-1f4c-47a5-97f7-f7f3488c71de req-b9bef47b-8da3-465e-bc9d-80acdda0ae43 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received event network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:21:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2cf8f077-1f4c-47a5-97f7-f7f3488c71de req-b9bef47b-8da3-465e-bc9d-80acdda0ae43 service nova] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2cf8f077-1f4c-47a5-97f7-f7f3488c71de req-b9bef47b-8da3-465e-bc9d-80acdda0ae43 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2cf8f077-1f4c-47a5-97f7-f7f3488c71de req-b9bef47b-8da3-465e-bc9d-80acdda0ae43 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:04 user nova-compute[72849]: DEBUG nova.compute.manager [req-2cf8f077-1f4c-47a5-97f7-f7f3488c71de req-b9bef47b-8da3-465e-bc9d-80acdda0ae43 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] No waiting events found dispatching network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:21:04 user nova-compute[72849]: WARNING nova.compute.manager [req-2cf8f077-1f4c-47a5-97f7-f7f3488c71de req-b9bef47b-8da3-465e-bc9d-80acdda0ae43 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received unexpected event network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 for instance with vm_state active and task_state resize_finish.
Aug 15 16:21:04 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116464.535344, b0a869eb-9ee8-4c31-9786-5b8be7d362a9 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:21:04 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] VM Resumed (Lifecycle Event)
Aug 15 16:21:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:21:04 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Instance running successfully.
Aug 15 16:21:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:21:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Failed to set time: agent not configured {{(pid=72849) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 15 16:21:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cca50abc-3d70-4175-afac-b20e8c98f9d6 tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] finish_migration finished successfully. {{(pid=72849) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 15 16:21:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:21:04 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 16:21:04 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116464.5362918, b0a869eb-9ee8-4c31-9786-5b8be7d362a9 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:21:04 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] VM Started (Lifecycle Event)
Aug 15 16:21:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:21:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:21:04 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 16:21:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:08 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116453.381199, 3a3a822c-230a-47a6-9658-8879957455de => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:21:08 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 3a3a822c-230a-47a6-9658-8879957455de] VM Stopped (Lifecycle Event)
Aug 15 16:21:08 user nova-compute[72849]: DEBUG nova.compute.manager [None req-e8adb420-94f5-444b-a398-bd4d21dc303f None None] [instance: 3a3a822c-230a-47a6-9658-8879957455de] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:21:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:16 user nova-compute[72849]: INFO nova.compute.manager [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Rescuing
Aug 15 16:21:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "refresh_cache-84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:21:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquired lock "refresh_cache-84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:21:16 user nova-compute[72849]: DEBUG nova.network.neutron [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:21:17 user nova-compute[72849]: DEBUG nova.network.neutron [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Updating instance_info_cache with network_info: [{"id": "993c798d-2a87-4ee5-80ea-484b8848ca54", "address": "fa:16:3e:e2:8e:fc", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993c798d-2a", "ovs_interfaceid": "993c798d-2a87-4ee5-80ea-484b8848ca54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:21:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Releasing lock "refresh_cache-84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:21:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-d4cf766c-36cd-4031-b1d2-4ef5bf8d2f88 req-04276048-a711-45f1-b594-2e2b2ffc484d service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-vif-unplugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:21:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d4cf766c-36cd-4031-b1d2-4ef5bf8d2f88 req-04276048-a711-45f1-b594-2e2b2ffc484d service nova] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d4cf766c-36cd-4031-b1d2-4ef5bf8d2f88 req-04276048-a711-45f1-b594-2e2b2ffc484d service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d4cf766c-36cd-4031-b1d2-4ef5bf8d2f88 req-04276048-a711-45f1-b594-2e2b2ffc484d service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-d4cf766c-36cd-4031-b1d2-4ef5bf8d2f88 req-04276048-a711-45f1-b594-2e2b2ffc484d service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] No waiting events found dispatching network-vif-unplugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:21:17 user nova-compute[72849]: WARNING nova.compute.manager [req-d4cf766c-36cd-4031-b1d2-4ef5bf8d2f88 req-04276048-a711-45f1-b594-2e2b2ffc484d service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received unexpected event network-vif-unplugged-993c798d-2a87-4ee5-80ea-484b8848ca54 for instance with vm_state active and task_state rescuing.
Aug 15 16:21:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:18 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Instance destroyed successfully.
Aug 15 16:21:18 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Attempting a stable device rescue
Aug 15 16:21:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72849) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 16:21:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Instance directory exists: not creating {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 16:21:18 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Creating image(s)
Aug 15 16:21:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "/opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "/opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "/opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:18 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'trusted_certs' on Instance uuid 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:21:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "3a8dc7acd339b1c29a17068871cefe19059c16ed" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "3a8dc7acd339b1c29a17068871cefe19059c16ed" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a8dc7acd339b1c29a17068871cefe19059c16ed.part --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] No waiting events found dispatching network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:21:20 user nova-compute[72849]: WARNING nova.compute.manager [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received unexpected event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 for instance with vm_state active and task_state rescuing.
Aug 15 16:21:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] No waiting events found dispatching network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:21:20 user nova-compute[72849]: WARNING nova.compute.manager [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received unexpected event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 for instance with vm_state active and task_state rescuing.
Aug 15 16:21:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] No waiting events found dispatching network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:21:20 user nova-compute[72849]: WARNING nova.compute.manager [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received unexpected event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 for instance with vm_state active and task_state rescuing.
Aug 15 16:21:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-vif-unplugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] No waiting events found dispatching network-vif-unplugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:21:20 user nova-compute[72849]: WARNING nova.compute.manager [req-f22cdb0b-c554-409c-9d3b-922a61c1d76c req-289b8a06-516c-4a8b-9a54-a6b2e5fae7f4 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received unexpected event network-vif-unplugged-993c798d-2a87-4ee5-80ea-484b8848ca54 for instance with vm_state active and task_state rescuing.
Aug 15 16:21:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a8dc7acd339b1c29a17068871cefe19059c16ed.part --force-share --output=json" returned: 0 in 0.201s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG nova.virt.images [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] d359f01c-666f-4a3a-89a3-0229addcd2cc was qcow2, converting to raw {{(pid=72849) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG nova.privsep.utils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72849) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3a8dc7acd339b1c29a17068871cefe19059c16ed.part /opt/stack/data/nova/instances/_base/3a8dc7acd339b1c29a17068871cefe19059c16ed.converted {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3a8dc7acd339b1c29a17068871cefe19059c16ed.part /opt/stack/data/nova/instances/_base/3a8dc7acd339b1c29a17068871cefe19059c16ed.converted" returned: 0 in 0.878s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a8dc7acd339b1c29a17068871cefe19059c16ed.converted --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a8dc7acd339b1c29a17068871cefe19059c16ed.converted --force-share --output=json" returned: 0 in 0.218s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "3a8dc7acd339b1c29a17068871cefe19059c16ed" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.836s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "3a8dc7acd339b1c29a17068871cefe19059c16ed" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "3a8dc7acd339b1c29a17068871cefe19059c16ed" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a8dc7acd339b1c29a17068871cefe19059c16ed --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a8dc7acd339b1c29a17068871cefe19059c16ed --force-share --output=json" returned: 0 in 0.223s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3a8dc7acd339b1c29a17068871cefe19059c16ed,backing_fmt=raw /opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab/disk.rescue {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3a8dc7acd339b1c29a17068871cefe19059c16ed,backing_fmt=raw /opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab/disk.rescue" returned: 0 in 0.049s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "3a8dc7acd339b1c29a17068871cefe19059c16ed" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'migration_context' on Instance uuid 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Start _get_guest_xml network_info=[{"id": "993c798d-2a87-4ee5-80ea-484b8848ca54", "address": "fa:16:3e:e2:8e:fc", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "vif_mac": "fa:16:3e:e2:8e:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993c798d-2a", "ovs_interfaceid": "993c798d-2a87-4ee5-80ea-484b8848ca54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd359f01c-666f-4a3a-89a3-0229addcd2cc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDEiHUZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '84b77d6c-5e6f-4fee-81fd-d58ee58b06ab', 'attached_at': '', 'detached_at': '', 'volume_id': '54a80adf-5b9b-4aa2-91d2-22f75686aead', 'serial': '54a80adf-5b9b-4aa2-91d2-22f75686aead'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '3f409899-2268-4180-b4dd-fe1b16ddffb2', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'resources' on Instance uuid 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'numa_topology' on Instance uuid 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:21:21 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:21:21 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'vcpu_model' on Instance uuid 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDEiHUZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:21:21 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:21:21 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:21:21 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[329dccbb-2163-405a-86c0-bc6d4ef2dc0b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = IDEiHUZh\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 16:21:21 user nova-compute[72849]: node.name = iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead
Aug 15 16:21:21 user nova-compute[72849]: node.tpgt = -1
Aug 15 16:21:21 user nova-compute[72849]: node.startup = automatic
Aug 15 16:21:21 user nova-compute[72849]: node.leading_login = No
Aug 15 16:21:21 user nova-compute[72849]: iface.iscsi_ifacename = default
Aug 15 16:21:21 user nova-compute[72849]: iface.net_ifacename = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.ipaddress = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.prefix_len = 0
Aug 15 16:21:21 user nova-compute[72849]: iface.hwaddress = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.transport_name = tcp
Aug 15 16:21:21 user nova-compute[72849]: iface.initiatorname = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.state = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.vlan_id = 0
Aug 15 16:21:21 user nova-compute[72849]: iface.vlan_priority = 0
Aug 15 16:21:21 user nova-compute[72849]: iface.vlan_state = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.iface_num = 0
Aug 15 16:21:21 user nova-compute[72849]: iface.mtu = 0
Aug 15 16:21:21 user nova-compute[72849]: iface.port = 0
Aug 15 16:21:21 user nova-compute[72849]: iface.bootproto = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.subnet_mask = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.gateway = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.dhcp_alt_client_id = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.dhcp_dns = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.dhcp_learn_iqn = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.dhcp_vendor_id_state = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.dhcp_vendor_id = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.dhcp_slp_da = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.fragmentation = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.gratuitous_arp = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.incoming_forwarding = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.tos_state = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.tos = 0
Aug 15 16:21:21 user nova-compute[72849]: iface.ttl = 0
Aug 15 16:21:21 user nova-compute[72849]: iface.delayed_ack = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.tcp_nagle = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.tcp_wsf_state = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.tcp_wsf = 0
Aug 15 16:21:21 user nova-compute[72849]: iface.tcp_timer_scale = 0
Aug 15 16:21:21 user nova-compute[72849]: iface.tcp_timestamp = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.redirect = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.def_task_mgmt_timeout = 0
Aug 15 16:21:21 user nova-compute[72849]: iface.header_digest = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.data_digest = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.immediate_data = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.initial_r2t = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.data_seq_inorder = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.data_pdu_inorder = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.erl = 0
Aug 15 16:21:21 user nova-compute[72849]: iface.max_receive_data_len = 0
Aug 15 16:21:21 user nova-compute[72849]: iface.first_burst_len = 0
Aug 15 16:21:21 user nova-compute[72849]: iface.max_outstanding_r2t = 0
Aug 15 16:21:21 user nova-compute[72849]: iface.max_burst_len = 0
Aug 15 16:21:21 user nova-compute[72849]: iface.chap_auth = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.bidi_chap = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.strict_login_compliance = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.discovery_auth = <empty>
Aug 15 16:21:21 user nova-compute[72849]: iface.discovery_logout = <empty>
Aug 15 16:21:21 user nova-compute[72849]: node.discovery_address = <empty>
Aug 15 16:21:21 user nova-compute[72849]: node.discovery_port = 0
Aug 15 16:21:21 user nova-compute[72849]: node.discovery_type = static
Aug 15 16:21:21 user nova-compute[72849]: node.session.initial_cmdsn = 0
Aug 15 16:21:21 user nova-compute[72849]: node.session.initial_login_retry_max = 8
Aug 15 16:21:21 user nova-compute[72849]: node.session.xmit_thread_priority = -20
Aug 15 16:21:21 user nova-compute[72849]: node.session.cmds_max = 128
Aug 15 16:21:21 user nova-compute[72849]: node.session.queue_depth = 32
Aug 15 16:21:21 user nova-compute[72849]: node.session.nr_sessions = 1
Aug 15 16:21:21 user nova-compute[72849]: node.session.auth.authmethod = CHAP
Aug 15 16:21:21 user nova-compute[72849]: node.session.auth.username = IDEiHUZh
Aug 15 16:21:21 user nova-compute[72849]: node.session.auth.password = ***
Aug 15 16:21:21 user nova-compute[72849]: node.session.auth.username_in = <empty>
Aug 15 16:21:21 user nova-compute[72849]: node.session.auth.password_in = <empty>
Aug 15 16:21:21 user nova-compute[72849]: node.session.auth.chap_algs = MD5
Aug 15 16:21:21 user nova-compute[72849]: node.session.timeo.replacement_timeout = 120
Aug 15 16:21:21 user nova-compute[72849]: node.session.err_timeo.abort_timeout = 15
Aug 15 16:21:21 user nova-compute[72849]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 16:21:21 user nova-compute[72849]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 16:21:21 user nova-compute[72849]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 16:21:21 user nova-compute[72849]: node.session.iscsi.FastAbort = Yes
Aug 15 16:21:21 user nova-compute[72849]: node.session.iscsi.InitialR2T = No
Aug 15 16:21:21 user nova-compute[72849]: node.session.iscsi.ImmediateData = Yes
Aug 15 16:21:21 user nova-compute[72849]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 16:21:21 user nova-compute[72849]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 16:21:21 user nova-compute[72849]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 16:21:21 user nova-compute[72849]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 16:21:21 user nova-compute[72849]: node.session.iscsi.MaxConnections = 1
Aug 15 16:21:21 user nova-compute[72849]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 16:21:21 user nova-compute[72849]: node.session.iscsi.ERL = 0
Aug 15 16:21:21 user nova-compute[72849]: node.session.scan = manual
Aug 15 16:21:21 user nova-compute[72849]: node.session.reopen_max = 0
Aug 15 16:21:21 user nova-compute[72849]: node.conn[0].address = 172.16.0.220
Aug 15 16:21:21 user nova-compute[72849]: node.conn[0].port = 3260
Aug 15 16:21:21 user nova-compute[72849]: node.conn[0].startup = manual
Aug 15 16:21:21 user nova-compute[72849]: node.conn[0].tcp.window_size = 524288
Aug 15 16:21:21 user nova-compute[72849]: node.conn[0].tcp.type_of_service = 0
Aug 15 16:21:21 user nova-compute[72849]: node.conn[0].timeo.logout_timeout = 15
Aug 15 16:21:21 user nova-compute[72849]: node.conn[0].timeo.login_timeout = 15
Aug 15 16:21:21 user nova-compute[72849]: node.conn[0].timeo.auth_timeout = 45
Aug 15 16:21:21 user nova-compute[72849]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 16:21:21 user nova-compute[72849]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 16:21:21 user nova-compute[72849]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 16:21:21 user nova-compute[72849]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 16:21:21 user nova-compute[72849]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 16:21:21 user nova-compute[72849]: node.conn[0].iscsi.DataDigest = None
Aug 15 16:21:21 user nova-compute[72849]: node.conn[0].iscsi.IFMarker = No
Aug 15 16:21:21 user nova-compute[72849]: node.conn[0].iscsi.OFMarker = No
Aug 15 16:21:21 user nova-compute[72849]: # END RECORD
Aug 15 16:21:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3434ae6-c67f-4ecf-b868-a920d6120da2]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b0016d-925b-4e2d-b28e-7eea4f8afbd0]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IDEiHUZh {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IDEiHUZh" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3eea24b-a793-449d-9c84-87c09646b17d]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IDEiHUZh'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9053a6-8924-430a-b460-e28568b3afa5]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10fa31a-53fa-4e91-baa1-a6a256d3a0b9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:21:21 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:21:21 user nova-compute[72849]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 (non-flash)
Aug 15 16:21:21 user nova-compute[72849]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:21:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:21:21 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:21:21 user nova-compute[72849]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 (non-flash)
Aug 15 16:21:21 user nova-compute[72849]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:21:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.166s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] HCTL ('37', '0', '0', 0) found on session 11 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[29eee66a-adb5-4f4e-a1fb-b66a2e4c7252]: (4, ('0 0 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Searching for a device in session 11 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDEiHUZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.195s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '23462333561613439', 'path': '/dev/sdf'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462333561613439', 'path': '/dev/sdf'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-403650730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-403650730',id=13,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f51f800c0ca74e149a2f8ed9718b221f',ramdisk_id='',reservation_id='r-xr5wu3j2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:19:48Z,user_data=None,user_id='cd6279423b7f43c4aac7956aec43efdd',uuid=84b77d6c-5e6f-4fee-81fd-d58ee58b06ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "993c798d-2a87-4ee5-80ea-484b8848ca54", "address": "fa:16:3e:e2:8e:fc", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "vif_mac": "fa:16:3e:e2:8e:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993c798d-2a", "ovs_interfaceid": "993c798d-2a87-4ee5-80ea-484b8848ca54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converting VIF {"id": "993c798d-2a87-4ee5-80ea-484b8848ca54", "address": "fa:16:3e:e2:8e:fc", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "vif_mac": "fa:16:3e:e2:8e:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993c798d-2a", "ovs_interfaceid": "993c798d-2a87-4ee5-80ea-484b8848ca54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=993c798d-2a87-4ee5-80ea-484b8848ca54,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993c798d-2a') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'pci_devices' on Instance uuid 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:21:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:21:21 user nova-compute[72849]:   <uuid>84b77d6c-5e6f-4fee-81fd-d58ee58b06ab</uuid>
Aug 15 16:21:21 user nova-compute[72849]:   <name>instance-0000000d</name>
Aug 15 16:21:21 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:21:21 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:21:21 user nova-compute[72849]:   <metadata>
Aug 15 16:21:21 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:21:21 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:21:21 user nova-compute[72849]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-403650730</nova:name>
Aug 15 16:21:21 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:21:21</nova:creationTime>
Aug 15 16:21:21 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:21:21 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:21:21 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:21:21 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:21:21 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:21:21 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:21:21 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:21:21 user nova-compute[72849]:       <nova:owner>
Aug 15 16:21:21 user nova-compute[72849]:         <nova:user uuid="cd6279423b7f43c4aac7956aec43efdd">tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member</nova:user>
Aug 15 16:21:21 user nova-compute[72849]:         <nova:project uuid="f51f800c0ca74e149a2f8ed9718b221f">tempest-ServerBootFromVolumeStableRescueTest-1207284584</nova:project>
Aug 15 16:21:21 user nova-compute[72849]:       </nova:owner>
Aug 15 16:21:21 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:21:21 user nova-compute[72849]:       <nova:ports>
Aug 15 16:21:21 user nova-compute[72849]:         <nova:port uuid="993c798d-2a87-4ee5-80ea-484b8848ca54">
Aug 15 16:21:21 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 16:21:21 user nova-compute[72849]:         </nova:port>
Aug 15 16:21:21 user nova-compute[72849]:       </nova:ports>
Aug 15 16:21:21 user nova-compute[72849]:     </nova:instance>
Aug 15 16:21:21 user nova-compute[72849]:   </metadata>
Aug 15 16:21:21 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:21:21 user nova-compute[72849]:     <system>
Aug 15 16:21:21 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:21:21 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:21:21 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:21:21 user nova-compute[72849]:       <entry name="serial">84b77d6c-5e6f-4fee-81fd-d58ee58b06ab</entry>
Aug 15 16:21:21 user nova-compute[72849]:       <entry name="uuid">84b77d6c-5e6f-4fee-81fd-d58ee58b06ab</entry>
Aug 15 16:21:21 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:21:21 user nova-compute[72849]:     </system>
Aug 15 16:21:21 user nova-compute[72849]:   </sysinfo>
Aug 15 16:21:21 user nova-compute[72849]:   <os>
Aug 15 16:21:21 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:21:21 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:21:21 user nova-compute[72849]:   </os>
Aug 15 16:21:21 user nova-compute[72849]:   <features>
Aug 15 16:21:21 user nova-compute[72849]:     <acpi/>
Aug 15 16:21:21 user nova-compute[72849]:     <apic/>
Aug 15 16:21:21 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:21:21 user nova-compute[72849]:   </features>
Aug 15 16:21:21 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:21:21 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:21:21 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:21:21 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:21:21 user nova-compute[72849]:   </clock>
Aug 15 16:21:21 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:21:21 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:21:21 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:21:21 user nova-compute[72849]:   </cpu>
Aug 15 16:21:21 user nova-compute[72849]:   <devices>
Aug 15 16:21:21 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:21:21 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:21:21 user nova-compute[72849]:       <source dev="/dev/sdf"/>
Aug 15 16:21:21 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:21:21 user nova-compute[72849]:       <serial>54a80adf-5b9b-4aa2-91d2-22f75686aead</serial>
Aug 15 16:21:21 user nova-compute[72849]:     </disk>
Aug 15 16:21:21 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:21:21 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:21:21 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab/disk.rescue"/>
Aug 15 16:21:21 user nova-compute[72849]:       <target dev="vdb" bus="virtio"/>
Aug 15 16:21:21 user nova-compute[72849]:       <boot order="1"/>
Aug 15 16:21:21 user nova-compute[72849]:     </disk>
Aug 15 16:21:21 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:21:21 user nova-compute[72849]:       <mac address="fa:16:3e:e2:8e:fc"/>
Aug 15 16:21:21 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:21:21 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:21:21 user nova-compute[72849]:       <target dev="tap993c798d-2a"/>
Aug 15 16:21:21 user nova-compute[72849]:     </interface>
Aug 15 16:21:21 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:21:21 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab/console.log" append="off"/>
Aug 15 16:21:21 user nova-compute[72849]:     </serial>
Aug 15 16:21:21 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:21:21 user nova-compute[72849]:     <video>
Aug 15 16:21:21 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:21:21 user nova-compute[72849]:     </video>
Aug 15 16:21:21 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:21:21 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:21:21 user nova-compute[72849]:     </rng>
Aug 15 16:21:21 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:21:21 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:21:21 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:21:21 user nova-compute[72849]:     </memballoon>
Aug 15 16:21:21 user nova-compute[72849]:   </devices>
Aug 15 16:21:21 user nova-compute[72849]: </domain>
Aug 15 16:21:21 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:21:21 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Instance destroyed successfully.
Aug 15 16:21:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:21:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:21:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] No VIF found with MAC fa:16:3e:e2:8e:fc, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:21:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-337d06d6-9bd8-4e50-ac40-d098cd7083c5 req-ecba9ac7-b456-4bbc-a03e-bba5392aba2c service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:21:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-337d06d6-9bd8-4e50-ac40-d098cd7083c5 req-ecba9ac7-b456-4bbc-a03e-bba5392aba2c service nova] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-337d06d6-9bd8-4e50-ac40-d098cd7083c5 req-ecba9ac7-b456-4bbc-a03e-bba5392aba2c service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-337d06d6-9bd8-4e50-ac40-d098cd7083c5 req-ecba9ac7-b456-4bbc-a03e-bba5392aba2c service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-337d06d6-9bd8-4e50-ac40-d098cd7083c5 req-ecba9ac7-b456-4bbc-a03e-bba5392aba2c service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] No waiting events found dispatching network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:21:22 user nova-compute[72849]: WARNING nova.compute.manager [req-337d06d6-9bd8-4e50-ac40-d098cd7083c5 req-ecba9ac7-b456-4bbc-a03e-bba5392aba2c service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received unexpected event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 for instance with vm_state active and task_state rescuing.
Aug 15 16:21:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-e49b24ab-f4dc-4fad-82d5-7868a7c35965 req-b97f42b9-4005-4db8-b02f-c00d10decd2e service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:21:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e49b24ab-f4dc-4fad-82d5-7868a7c35965 req-b97f42b9-4005-4db8-b02f-c00d10decd2e service nova] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e49b24ab-f4dc-4fad-82d5-7868a7c35965 req-b97f42b9-4005-4db8-b02f-c00d10decd2e service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e49b24ab-f4dc-4fad-82d5-7868a7c35965 req-b97f42b9-4005-4db8-b02f-c00d10decd2e service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-e49b24ab-f4dc-4fad-82d5-7868a7c35965 req-b97f42b9-4005-4db8-b02f-c00d10decd2e service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] No waiting events found dispatching network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:21:24 user nova-compute[72849]: WARNING nova.compute.manager [req-e49b24ab-f4dc-4fad-82d5-7868a7c35965 req-b97f42b9-4005-4db8-b02f-c00d10decd2e service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received unexpected event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 for instance with vm_state active and task_state rescuing.
Aug 15 16:21:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Removed pending event for 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab due to event {{(pid=72849) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 16:21:25 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116485.805654, 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:21:25 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] VM Resumed (Lifecycle Event)
Aug 15 16:21:25 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ec6fceb2-644a-4c67-bbbf-104edfcc38d7 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:21:25 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:21:25 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:21:25 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 16:21:25 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116485.806064, 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:21:25 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] VM Started (Lifecycle Event)
Aug 15 16:21:25 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:21:25 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:21:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-ea861856-d553-462f-aaf5-f72bd7af1f9e req-4bfa9229-adc9-4462-91c0-9dadded83540 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:21:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ea861856-d553-462f-aaf5-f72bd7af1f9e req-4bfa9229-adc9-4462-91c0-9dadded83540 service nova] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ea861856-d553-462f-aaf5-f72bd7af1f9e req-4bfa9229-adc9-4462-91c0-9dadded83540 service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ea861856-d553-462f-aaf5-f72bd7af1f9e req-4bfa9229-adc9-4462-91c0-9dadded83540 service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-ea861856-d553-462f-aaf5-f72bd7af1f9e req-4bfa9229-adc9-4462-91c0-9dadded83540 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] No waiting events found dispatching network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:21:26 user nova-compute[72849]: WARNING nova.compute.manager [req-ea861856-d553-462f-aaf5-f72bd7af1f9e req-4bfa9229-adc9-4462-91c0-9dadded83540 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received unexpected event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 for instance with vm_state rescued and task_state None.
Aug 15 16:21:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:34 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:21:34 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:21:34 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:21:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-341edacc-b44b-4d92-9fcd-982c252fcdd6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:21:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-341edacc-b44b-4d92-9fcd-982c252fcdd6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:21:35 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:21:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Updating instance_info_cache with network_info: [{"id": "c605963e-3827-4ad6-ab40-665c92c252b1", "address": "fa:16:3e:0a:d9:a5", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605963e-38", "ovs_interfaceid": "c605963e-3827-4ad6-ab40-665c92c252b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-341edacc-b44b-4d92-9fcd-982c252fcdd6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:21:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:21:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:21:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:21:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab/disk.rescue --force-share --output=json" returned: 0 in 0.290s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:42 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:21:42 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:21:42 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=6777MB free_disk=25.293212890625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:21:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:42 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Applying migration context for instance b0a869eb-9ee8-4c31-9786-5b8be7d362a9 as it has an incoming, in-progress migration 5def4dc0-2f71-4b78-ac69-f4756ff41fd3. Migration status is finished {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 16:21:42 user nova-compute[72849]: INFO nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updating resource usage from migration 5def4dc0-2f71-4b78-ac69-f4756ff41fd3
Aug 15 16:21:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:21:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:21:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:21:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 341edacc-b44b-4d92-9fcd-982c252fcdd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:21:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 8aa1e777-f613-457a-9458-d36b2b6010e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:21:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:21:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance dea53f90-39ad-4c38-b67b-e23a8ce03d23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:21:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 052cde29-421b-4b17-9bcd-acd58456ddba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:21:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc521d87-09aa-44ba-a87c-1cd5517b3707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:21:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 46f0aa43-e313-4aff-bacc-aa5290193b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:21:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Migration 5def4dc0-2f71-4b78-ac69-f4756ff41fd3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 16:21:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b0a869eb-9ee8-4c31-9786-5b8be7d362a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:21:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:21:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:21:43 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:21:43 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:21:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:21:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.838s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:21:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:46 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:21:46 user nova-compute[72849]: INFO nova.compute.claims [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Claim successful on node user
Aug 15 16:21:46 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:21:46 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:21:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:21:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "8aa1e777-f613-457a-9458-d36b2b6010e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:46 user nova-compute[72849]: INFO nova.compute.manager [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Detaching volume 8ae8920d-dba5-45d2-9974-b1c147634f10
Aug 15 16:21:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG nova.network.neutron [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:21:47 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:21:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:21:47 user nova-compute[72849]: INFO nova.virt.block_device [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Attempting to driver detach volume 8ae8920d-dba5-45d2-9974-b1c147634f10 from mountpoint /dev/vdb
Aug 15 16:21:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Attempting to detach device vdb from instance 8aa1e777-f613-457a-9458-d36b2b6010e9 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:21:47 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:21:47 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:21:47 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:21:47 user nova-compute[72849]:   <serial>8ae8920d-dba5-45d2-9974-b1c147634f10</serial>
Aug 15 16:21:47 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:21:47 user nova-compute[72849]: </disk>
Aug 15 16:21:47 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:21:47 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Successfully detached device vdb from instance 8aa1e777-f613-457a-9458-d36b2b6010e9 from the persistent domain config.
Aug 15 16:21:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8aa1e777-f613-457a-9458-d36b2b6010e9 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:21:47 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:21:47 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:21:47 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:21:47 user nova-compute[72849]:   <serial>8ae8920d-dba5-45d2-9974-b1c147634f10</serial>
Aug 15 16:21:47 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:21:47 user nova-compute[72849]: </disk>
Aug 15 16:21:47 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG nova.policy [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9420a64b5ea462681f3a9c6cf55986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512a50775b24f798c5cf345f08e0dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "8aa1e777-f613-457a-9458-d36b2b6010e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:21:47 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Creating image(s)
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "/opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "/opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "1ad6c6e8c673325b9852ca2af02396dc1f376fdd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "1ad6c6e8c673325b9852ca2af02396dc1f376fdd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd.part --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692116507.7868829, 8aa1e777-f613-457a-9458-d36b2b6010e9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8aa1e777-f613-457a-9458-d36b2b6010e9 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:21:47 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Successfully detached device vdb from instance 8aa1e777-f613-457a-9458-d36b2b6010e9 from the live domain config.
Aug 15 16:21:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsuXNRmC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:21:47 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:21:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[de54d6be-9eac-483f-8ed8-b4abf42180d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff2ef3c-6b57-4e9b-a0c2-c801636a460c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:21:47 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:21:47 user nova-compute[72849]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 (non-flash)
Aug 15 16:21:47 user nova-compute[72849]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:21:47 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:21:47 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:21:47 user nova-compute[72849]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 (non-flash)
Aug 15 16:21:47 user nova-compute[72849]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:21:47 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3582ace50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[84072c09-9187-4cdf-88d5-8e5be6024842]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0f5a97-31e4-4c29-b5c6-2d6ed67f0708]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd.part --force-share --output=json" returned: 0 in 0.352s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG nova.virt.images [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] e96995a9-02fd-46b4-a493-49c55a019fb8 was qcow2, converting to raw {{(pid=72849) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG nova.privsep.utils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72849) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 16:21:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd.part /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd.converted {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bc39cc-6440-4df0-a5e1-f0d43d96b24e]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2ab307-fd42-43d7-8fe1-6c4ecc855a56]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[258518c2-058a-4de2-afa1-964cd1e024f3]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd.part /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd.converted" returned: 0 in 0.194s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd.converted --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[75598457-1af9-4197-8a64-a4d53b835121]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10, portal: 172.16.0.220,3260]
Aug 15 16:21:48 user nova-compute[72849]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10, portal: 172.16.0.220,3260] successful.
Aug 15 16:21:48 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG nova.network.neutron [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Successfully created port: a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b97303-0c5e-46ee-b434-79f48177a7bd]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] <== disconnect_volume: return (424ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "1ad6c6e8c673325b9852ca2af02396dc1f376fdd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.175s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd --force-share --output=json" returned: 0 in 0.241s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "1ad6c6e8c673325b9852ca2af02396dc1f376fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "1ad6c6e8c673325b9852ca2af02396dc1f376fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd --force-share --output=json" returned: 0 in 0.197s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd,backing_fmt=raw /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd,backing_fmt=raw /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk 1073741824" returned: 0 in 0.056s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "1ad6c6e8c673325b9852ca2af02396dc1f376fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG nova.network.neutron [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Successfully updated port: a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquired lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG nova.network.neutron [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG nova.compute.manager [req-fcfc6f07-dcc8-40cc-85b2-f1763189d358 req-1c089f7c-18cb-4286-8a89-89c323acaeed service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received event network-changed-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG nova.compute.manager [req-fcfc6f07-dcc8-40cc-85b2-f1763189d358 req-1c089f7c-18cb-4286-8a89-89c323acaeed service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Refreshing instance network info cache due to event network-changed-a5ec1882-941b-4bf8-94c2-dd58f74762c6. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fcfc6f07-dcc8-40cc-85b2-f1763189d358 req-1c089f7c-18cb-4286-8a89-89c323acaeed service nova] Acquiring lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG nova.objects.instance [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lazy-loading 'flavor' on Instance uuid 8aa1e777-f613-457a-9458-d36b2b6010e9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG nova.network.neutron [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b746d5e6-0d4a-42e5-b047-abeca3edbd1a tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.292s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.080s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "8aa1e777-f613-457a-9458-d36b2b6010e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:49 user nova-compute[72849]: INFO nova.compute.manager [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Terminating instance
Aug 15 16:21:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Cannot resize image /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG nova.objects.instance [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lazy-loading 'migration_context' on Instance uuid 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Ensure instance console log exists: /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG nova.network.neutron [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Updating instance_info_cache with network_info: [{"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG nova.compute.manager [req-6a287fe1-ef94-4d32-bbdb-10c4fe2bb22b req-89092423-49ec-4aeb-ac39-a205d0ee0966 service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Received event network-vif-unplugged-281634e4-b965-40cf-b60f-9c122ec59050 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6a287fe1-ef94-4d32-bbdb-10c4fe2bb22b req-89092423-49ec-4aeb-ac39-a205d0ee0966 service nova] Acquiring lock "8aa1e777-f613-457a-9458-d36b2b6010e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6a287fe1-ef94-4d32-bbdb-10c4fe2bb22b req-89092423-49ec-4aeb-ac39-a205d0ee0966 service nova] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6a287fe1-ef94-4d32-bbdb-10c4fe2bb22b req-89092423-49ec-4aeb-ac39-a205d0ee0966 service nova] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG nova.compute.manager [req-6a287fe1-ef94-4d32-bbdb-10c4fe2bb22b req-89092423-49ec-4aeb-ac39-a205d0ee0966 service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] No waiting events found dispatching network-vif-unplugged-281634e4-b965-40cf-b60f-9c122ec59050 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG nova.compute.manager [req-6a287fe1-ef94-4d32-bbdb-10c4fe2bb22b req-89092423-49ec-4aeb-ac39-a205d0ee0966 service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Received event network-vif-unplugged-281634e4-b965-40cf-b60f-9c122ec59050 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Releasing lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Instance network_info: |[{"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fcfc6f07-dcc8-40cc-85b2-f1763189d358 req-1c089f7c-18cb-4286-8a89-89c323acaeed service nova] Acquired lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:21:49 user nova-compute[72849]: DEBUG nova.network.neutron [req-fcfc6f07-dcc8-40cc-85b2-f1763189d358 req-1c089f7c-18cb-4286-8a89-89c323acaeed service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Refreshing network info cache for port a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Start _get_guest_xml network_info=[{"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:21:42Z,direct_url=<?>,disk_format='qcow2',id=e96995a9-02fd-46b4-a493-49c55a019fb8,min_disk=0,min_ram=0,name='tempest-scenario-img--1786088374',owner='8512a50775b24f798c5cf345f08e0dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:21:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'e96995a9-02fd-46b4-a493-49c55a019fb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:50 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:21:50 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:21:42Z,direct_url=<?>,disk_format='qcow2',id=e96995a9-02fd-46b4-a493-49c55a019fb8,min_disk=0,min_ram=0,name='tempest-scenario-img--1786088374',owner='8512a50775b24f798c5cf345f08e0dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:21:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1576542286',display_name='tempest-TestMinimumBasicScenario-server-1576542286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1576542286',id=18,image_ref='e96995a9-02fd-46b4-a493-49c55a019fb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLITvhTIKxyK1vxPra8HPdLGNslu1aZMvggvPZhZAqmN29/j8ALHmk9hr8DlNcPQ6RB8/ui+J8dT3ULem3B9LDvmcgD/X4+LLLqAj30wexD4v1PAuESvTiKNIJpS8gNsA==',key_name='tempest-TestMinimumBasicScenario-1485864520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8512a50775b24f798c5cf345f08e0dd2',ramdisk_id='',reservation_id='r-rs5ok5tt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e96995a9-02fd-46b4-a493-49c55a019fb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2032437405',owner_user_name='tempest-TestMinimumBasicScenario-2032437405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:21:47Z,user_data=None,user_id='d9420a64b5ea462681f3a9c6cf55986c',uuid=7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Converting VIF {"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:cb:17,bridge_name='br-int',has_traffic_filtering=True,id=a5ec1882-941b-4bf8-94c2-dd58f74762c6,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5ec1882-94') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.objects.instance [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:21:50 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Instance destroyed successfully.
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.objects.instance [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lazy-loading 'resources' on Instance uuid 8aa1e777-f613-457a-9458-d36b2b6010e9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:21:50 user nova-compute[72849]:   <uuid>7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff</uuid>
Aug 15 16:21:50 user nova-compute[72849]:   <name>instance-00000012</name>
Aug 15 16:21:50 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:21:50 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:21:50 user nova-compute[72849]:   <metadata>
Aug 15 16:21:50 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:21:50 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:21:50 user nova-compute[72849]:       <nova:name>tempest-TestMinimumBasicScenario-server-1576542286</nova:name>
Aug 15 16:21:50 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:21:50</nova:creationTime>
Aug 15 16:21:50 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:21:50 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:21:50 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:21:50 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:21:50 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:21:50 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:21:50 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:21:50 user nova-compute[72849]:       <nova:owner>
Aug 15 16:21:50 user nova-compute[72849]:         <nova:user uuid="d9420a64b5ea462681f3a9c6cf55986c">tempest-TestMinimumBasicScenario-2032437405-project-member</nova:user>
Aug 15 16:21:50 user nova-compute[72849]:         <nova:project uuid="8512a50775b24f798c5cf345f08e0dd2">tempest-TestMinimumBasicScenario-2032437405</nova:project>
Aug 15 16:21:50 user nova-compute[72849]:       </nova:owner>
Aug 15 16:21:50 user nova-compute[72849]:       <nova:root type="image" uuid="e96995a9-02fd-46b4-a493-49c55a019fb8"/>
Aug 15 16:21:50 user nova-compute[72849]:       <nova:ports>
Aug 15 16:21:50 user nova-compute[72849]:         <nova:port uuid="a5ec1882-941b-4bf8-94c2-dd58f74762c6">
Aug 15 16:21:50 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:21:50 user nova-compute[72849]:         </nova:port>
Aug 15 16:21:50 user nova-compute[72849]:       </nova:ports>
Aug 15 16:21:50 user nova-compute[72849]:     </nova:instance>
Aug 15 16:21:50 user nova-compute[72849]:   </metadata>
Aug 15 16:21:50 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:21:50 user nova-compute[72849]:     <system>
Aug 15 16:21:50 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:21:50 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:21:50 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:21:50 user nova-compute[72849]:       <entry name="serial">7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff</entry>
Aug 15 16:21:50 user nova-compute[72849]:       <entry name="uuid">7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff</entry>
Aug 15 16:21:50 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:21:50 user nova-compute[72849]:     </system>
Aug 15 16:21:50 user nova-compute[72849]:   </sysinfo>
Aug 15 16:21:50 user nova-compute[72849]:   <os>
Aug 15 16:21:50 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:21:50 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:21:50 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:21:50 user nova-compute[72849]:   </os>
Aug 15 16:21:50 user nova-compute[72849]:   <features>
Aug 15 16:21:50 user nova-compute[72849]:     <acpi/>
Aug 15 16:21:50 user nova-compute[72849]:     <apic/>
Aug 15 16:21:50 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:21:50 user nova-compute[72849]:   </features>
Aug 15 16:21:50 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:21:50 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:21:50 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:21:50 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:21:50 user nova-compute[72849]:   </clock>
Aug 15 16:21:50 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:21:50 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:21:50 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:21:50 user nova-compute[72849]:   </cpu>
Aug 15 16:21:50 user nova-compute[72849]:   <devices>
Aug 15 16:21:50 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:21:50 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:21:50 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk"/>
Aug 15 16:21:50 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:21:50 user nova-compute[72849]:     </disk>
Aug 15 16:21:50 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:21:50 user nova-compute[72849]:       <mac address="fa:16:3e:cd:cb:17"/>
Aug 15 16:21:50 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:21:50 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:21:50 user nova-compute[72849]:       <target dev="tapa5ec1882-94"/>
Aug 15 16:21:50 user nova-compute[72849]:     </interface>
Aug 15 16:21:50 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:21:50 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/console.log" append="off"/>
Aug 15 16:21:50 user nova-compute[72849]:     </serial>
Aug 15 16:21:50 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:21:50 user nova-compute[72849]:     <video>
Aug 15 16:21:50 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:21:50 user nova-compute[72849]:     </video>
Aug 15 16:21:50 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:21:50 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:21:50 user nova-compute[72849]:     </rng>
Aug 15 16:21:50 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:21:50 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:21:50 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:21:50 user nova-compute[72849]:     </memballoon>
Aug 15 16:21:50 user nova-compute[72849]:   </devices>
Aug 15 16:21:50 user nova-compute[72849]: </domain>
Aug 15 16:21:50 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1576542286',display_name='tempest-TestMinimumBasicScenario-server-1576542286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1576542286',id=18,image_ref='e96995a9-02fd-46b4-a493-49c55a019fb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLITvhTIKxyK1vxPra8HPdLGNslu1aZMvggvPZhZAqmN29/j8ALHmk9hr8DlNcPQ6RB8/ui+J8dT3ULem3B9LDvmcgD/X4+LLLqAj30wexD4v1PAuESvTiKNIJpS8gNsA==',key_name='tempest-TestMinimumBasicScenario-1485864520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8512a50775b24f798c5cf345f08e0dd2',ramdisk_id='',reservation_id='r-rs5ok5tt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e96995a9-02fd-46b4-a493-49c55a019fb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2032437405',owner_user_name='tempest-TestMinimumBasicScenario-2032437405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:21:47Z,user_data=None,user_id='d9420a64b5ea462681f3a9c6cf55986c',uuid=7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Converting VIF {"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:cb:17,bridge_name='br-int',has_traffic_filtering=True,id=a5ec1882-941b-4bf8-94c2-dd58f74762c6,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5ec1882-94') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG os_vif [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:cb:17,bridge_name='br-int',has_traffic_filtering=True,id=a5ec1882-941b-4bf8-94c2-dd58f74762c6,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5ec1882-94') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-781402979',display_name='tempest-VolumesSnapshotTestJSON-instance-781402979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-781402979',id=11,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd+9r5zIYSoU2xDqoNQDWikI3+IQKPE0XDwDyBa5ZxoE2wB1FZuNLpBS7ELhNP65xFQbr8HwTwHz4wbnRcEQ5HVK1EeJt/a09RCZggAX+f8wt3zuF/Wgmah4HAccPOD8A==',key_name='tempest-keypair-2063945134',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:18:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='065226f254df40baaf230ccd5f13f62a',ramdisk_id='',reservation_id='r-ec27d4ld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1243118890',owner_user_name='tempest-VolumesSnapshotTestJSON-1243118890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2471145e3ea84645bcfa51f4fcf4cbbc',uuid=8aa1e777-f613-457a-9458-d36b2b6010e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "281634e4-b965-40cf-b60f-9c122ec59050", "address": "fa:16:3e:18:f9:c0", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281634e4-b9", "ovs_interfaceid": "281634e4-b965-40cf-b60f-9c122ec59050", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Converting VIF {"id": "281634e4-b965-40cf-b60f-9c122ec59050", "address": "fa:16:3e:18:f9:c0", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281634e4-b9", "ovs_interfaceid": "281634e4-b965-40cf-b60f-9c122ec59050", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:f9:c0,bridge_name='br-int',has_traffic_filtering=True,id=281634e4-b965-40cf-b60f-9c122ec59050,network=Network(ea172a57-fdfb-45f3-b3df-e6f4751eb20b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281634e4-b9') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG os_vif [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:f9:c0,bridge_name='br-int',has_traffic_filtering=True,id=281634e4-b965-40cf-b60f-9c122ec59050,network=Network(ea172a57-fdfb-45f3-b3df-e6f4751eb20b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281634e4-b9') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap281634e4-b9, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5ec1882-94, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa5ec1882-94, col_values=(('external_ids', {'iface-id': 'a5ec1882-941b-4bf8-94c2-dd58f74762c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:cb:17', 'vm-uuid': '7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:50 user nova-compute[72849]: INFO os_vif [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:f9:c0,bridge_name='br-int',has_traffic_filtering=True,id=281634e4-b965-40cf-b60f-9c122ec59050,network=Network(ea172a57-fdfb-45f3-b3df-e6f4751eb20b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281634e4-b9')
Aug 15 16:21:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:50 user nova-compute[72849]: INFO os_vif [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:cb:17,bridge_name='br-int',has_traffic_filtering=True,id=a5ec1882-941b-4bf8-94c2-dd58f74762c6,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5ec1882-94')
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsuXNRmC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:21:50 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:21:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ae8920d-dba5-45d2-9974-b1c147634f10', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aaa9542-e9ca-49d0-a33b-631809998b7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d93184-bd96-4689-980e-5680ed707cf3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:21:50 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:21:50 user nova-compute[72849]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:21:50 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:21:50 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:21:50 user nova-compute[72849]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:21:50 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3582ca170>, {}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Disconnecting from: [] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.061s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] <== disconnect_volume: return (63ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:21:50 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Deleting instance files /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9_del
Aug 15 16:21:50 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Deletion of /opt/stack/data/nova/instances/8aa1e777-f613-457a-9458-d36b2b6010e9_del complete
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] No VIF found with MAC fa:16:3e:cd:cb:17, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:21:50 user nova-compute[72849]: INFO nova.compute.manager [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 15 16:21:50 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.network.neutron [req-fcfc6f07-dcc8-40cc-85b2-f1763189d358 req-1c089f7c-18cb-4286-8a89-89c323acaeed service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Updated VIF entry in instance network info cache for port a5ec1882-941b-4bf8-94c2-dd58f74762c6. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG nova.network.neutron [req-fcfc6f07-dcc8-40cc-85b2-f1763189d358 req-1c089f7c-18cb-4286-8a89-89c323acaeed service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Updating instance_info_cache with network_info: [{"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:21:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fcfc6f07-dcc8-40cc-85b2-f1763189d358 req-1c089f7c-18cb-4286-8a89-89c323acaeed service nova] Releasing lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:21:51 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:21:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:51 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Took 1.24 seconds to deallocate network for instance.
Aug 15 16:21:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:51 user nova-compute[72849]: WARNING nova.volume.cinder [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Attachment fcd88498-75f9-4785-bdbf-017b0dfa5eda does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = fcd88498-75f9-4785-bdbf-017b0dfa5eda. (HTTP 404) (Request-ID: req-2872a945-978b-4b28-8656-d9ca90a75836)
Aug 15 16:21:51 user nova-compute[72849]: INFO nova.compute.manager [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Took 0.05 seconds to detach 1 volumes for instance.
Aug 15 16:21:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-dd9212fa-b044-4423-8457-604a23ceb6ed req-1854c93f-1a63-4647-969d-0901b5200f3d service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Received event network-vif-plugged-281634e4-b965-40cf-b60f-9c122ec59050 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:21:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-dd9212fa-b044-4423-8457-604a23ceb6ed req-1854c93f-1a63-4647-969d-0901b5200f3d service nova] Acquiring lock "8aa1e777-f613-457a-9458-d36b2b6010e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-dd9212fa-b044-4423-8457-604a23ceb6ed req-1854c93f-1a63-4647-969d-0901b5200f3d service nova] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-dd9212fa-b044-4423-8457-604a23ceb6ed req-1854c93f-1a63-4647-969d-0901b5200f3d service nova] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-dd9212fa-b044-4423-8457-604a23ceb6ed req-1854c93f-1a63-4647-969d-0901b5200f3d service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] No waiting events found dispatching network-vif-plugged-281634e4-b965-40cf-b60f-9c122ec59050 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:21:52 user nova-compute[72849]: WARNING nova.compute.manager [req-dd9212fa-b044-4423-8457-604a23ceb6ed req-1854c93f-1a63-4647-969d-0901b5200f3d service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Received unexpected event network-vif-plugged-281634e4-b965-40cf-b60f-9c122ec59050 for instance with vm_state deleted and task_state None.
Aug 15 16:21:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-dd9212fa-b044-4423-8457-604a23ceb6ed req-1854c93f-1a63-4647-969d-0901b5200f3d service nova] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Received event network-vif-deleted-281634e4-b965-40cf-b60f-9c122ec59050 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:21:52 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:21:52 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:21:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.570s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:52 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Deleted allocations for instance 8aa1e777-f613-457a-9458-d36b2b6010e9
Aug 15 16:21:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-bdb212ae-5faa-48b9-8d3e-bf3bab168bc5 req-84763fb6-0f39-4320-b4fe-e4a696fc1a8f service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received event network-vif-plugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:21:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-bdb212ae-5faa-48b9-8d3e-bf3bab168bc5 req-84763fb6-0f39-4320-b4fe-e4a696fc1a8f service nova] Acquiring lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-bdb212ae-5faa-48b9-8d3e-bf3bab168bc5 req-84763fb6-0f39-4320-b4fe-e4a696fc1a8f service nova] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-bdb212ae-5faa-48b9-8d3e-bf3bab168bc5 req-84763fb6-0f39-4320-b4fe-e4a696fc1a8f service nova] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-bdb212ae-5faa-48b9-8d3e-bf3bab168bc5 req-84763fb6-0f39-4320-b4fe-e4a696fc1a8f service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] No waiting events found dispatching network-vif-plugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:21:52 user nova-compute[72849]: WARNING nova.compute.manager [req-bdb212ae-5faa-48b9-8d3e-bf3bab168bc5 req-84763fb6-0f39-4320-b4fe-e4a696fc1a8f service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received unexpected event network-vif-plugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 for instance with vm_state building and task_state spawning.
Aug 15 16:21:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f2bebaa1-81f5-458a-8cfd-5b74e15b6353 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "8aa1e777-f613-457a-9458-d36b2b6010e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.217s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:53 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116513.9909244, 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:21:53 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] VM Resumed (Lifecycle Event)
Aug 15 16:21:53 user nova-compute[72849]: DEBUG nova.compute.manager [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:21:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:21:54 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Instance spawned successfully.
Aug 15 16:21:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:21:54 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:21:54 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:21:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:21:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:21:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:21:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:21:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:21:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:21:54 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:21:54 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116513.9920428, 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:21:54 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] VM Started (Lifecycle Event)
Aug 15 16:21:54 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:21:54 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:21:54 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:21:54 user nova-compute[72849]: INFO nova.compute.manager [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Took 6.90 seconds to spawn the instance on the hypervisor.
Aug 15 16:21:54 user nova-compute[72849]: DEBUG nova.compute.manager [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:21:54 user nova-compute[72849]: INFO nova.compute.manager [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Took 7.83 seconds to build instance.
Aug 15 16:21:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-889663a1-5552-417e-bded-ffcc7ba5e2df tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.974s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-2ce36847-f19f-4f88-b577-b8539b3dc5f5 req-7c4d52c4-dc13-4b0e-afc4-996aa4a374de service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received event network-vif-plugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:21:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2ce36847-f19f-4f88-b577-b8539b3dc5f5 req-7c4d52c4-dc13-4b0e-afc4-996aa4a374de service nova] Acquiring lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2ce36847-f19f-4f88-b577-b8539b3dc5f5 req-7c4d52c4-dc13-4b0e-afc4-996aa4a374de service nova] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2ce36847-f19f-4f88-b577-b8539b3dc5f5 req-7c4d52c4-dc13-4b0e-afc4-996aa4a374de service nova] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-2ce36847-f19f-4f88-b577-b8539b3dc5f5 req-7c4d52c4-dc13-4b0e-afc4-996aa4a374de service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] No waiting events found dispatching network-vif-plugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:21:54 user nova-compute[72849]: WARNING nova.compute.manager [req-2ce36847-f19f-4f88-b577-b8539b3dc5f5 req-7c4d52c4-dc13-4b0e-afc4-996aa4a374de service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received unexpected event network-vif-plugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 for instance with vm_state active and task_state None.
Aug 15 16:21:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "dea53f90-39ad-4c38-b67b-e23a8ce03d23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "dea53f90-39ad-4c38-b67b-e23a8ce03d23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "dea53f90-39ad-4c38-b67b-e23a8ce03d23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "dea53f90-39ad-4c38-b67b-e23a8ce03d23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "dea53f90-39ad-4c38-b67b-e23a8ce03d23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:56 user nova-compute[72849]: INFO nova.compute.manager [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Terminating instance
Aug 15 16:21:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:21:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:57 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Instance destroyed successfully.
Aug 15 16:21:57 user nova-compute[72849]: DEBUG nova.objects.instance [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lazy-loading 'resources' on Instance uuid dea53f90-39ad-4c38-b67b-e23a8ce03d23 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:21:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-741975421',display_name='tempest-VolumesAdminNegativeTest-server-741975421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-741975421',id=14,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:19:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='279e48c00f91440082b8bfe112af9091',ramdisk_id='',reservation_id='r-48nzwqka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-879284905',owner_user_name='tempest-VolumesAdminNegativeTest-879284905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:19:58Z,user_data=None,user_id='8365a9dd961144a2b2cb303bb7854a45',uuid=dea53f90-39ad-4c38-b67b-e23a8ce03d23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09bced67-66f5-4fc8-96c7-367c28d28143", "address": "fa:16:3e:bb:c3:b2", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bced67-66", "ovs_interfaceid": "09bced67-66f5-4fc8-96c7-367c28d28143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:21:57 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Converting VIF {"id": "09bced67-66f5-4fc8-96c7-367c28d28143", "address": "fa:16:3e:bb:c3:b2", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bced67-66", "ovs_interfaceid": "09bced67-66f5-4fc8-96c7-367c28d28143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:21:57 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c3:b2,bridge_name='br-int',has_traffic_filtering=True,id=09bced67-66f5-4fc8-96c7-367c28d28143,network=Network(181b9566-bc94-42e7-b80e-1b78111cce19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bced67-66') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:21:57 user nova-compute[72849]: DEBUG os_vif [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c3:b2,bridge_name='br-int',has_traffic_filtering=True,id=09bced67-66f5-4fc8-96c7-367c28d28143,network=Network(181b9566-bc94-42e7-b80e-1b78111cce19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bced67-66') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:21:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09bced67-66, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:21:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:21:57 user nova-compute[72849]: INFO os_vif [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c3:b2,bridge_name='br-int',has_traffic_filtering=True,id=09bced67-66f5-4fc8-96c7-367c28d28143,network=Network(181b9566-bc94-42e7-b80e-1b78111cce19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bced67-66')
Aug 15 16:21:57 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Deleting instance files /opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23_del
Aug 15 16:21:57 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Deletion of /opt/stack/data/nova/instances/dea53f90-39ad-4c38-b67b-e23a8ce03d23_del complete
Aug 15 16:21:57 user nova-compute[72849]: INFO nova.compute.manager [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 15 16:21:57 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:21:57 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:21:57 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:21:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:21:58 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:21:58 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Took 1.05 seconds to deallocate network for instance.
Aug 15 16:21:58 user nova-compute[72849]: DEBUG nova.compute.manager [req-7d33a955-b759-44d9-ac6d-631d55572446 req-f77ea324-b314-4ef7-8241-afdb8f3c9e88 service nova] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Received event network-vif-deleted-09bced67-66f5-4fc8-96c7-367c28d28143 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:21:58 user nova-compute[72849]: INFO nova.compute.manager [req-7d33a955-b759-44d9-ac6d-631d55572446 req-f77ea324-b314-4ef7-8241-afdb8f3c9e88 service nova] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Neutron deleted interface 09bced67-66f5-4fc8-96c7-367c28d28143; detaching it from the instance and deleting it from the info cache
Aug 15 16:21:58 user nova-compute[72849]: DEBUG nova.network.neutron [req-7d33a955-b759-44d9-ac6d-631d55572446 req-f77ea324-b314-4ef7-8241-afdb8f3c9e88 service nova] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:21:58 user nova-compute[72849]: DEBUG nova.compute.manager [req-7d33a955-b759-44d9-ac6d-631d55572446 req-f77ea324-b314-4ef7-8241-afdb8f3c9e88 service nova] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Detach interface failed, port_id=09bced67-66f5-4fc8-96c7-367c28d28143, reason: Instance dea53f90-39ad-4c38-b67b-e23a8ce03d23 could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:21:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:21:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:21:59 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:21:59 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:21:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:59 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Deleted allocations for instance dea53f90-39ad-4c38-b67b-e23a8ce03d23
Aug 15 16:21:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a6e93adb-f64d-4d60-ba35-cdab39d6411d tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "dea53f90-39ad-4c38-b67b-e23a8ce03d23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.779s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:21:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:05 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116510.0694141, 8aa1e777-f613-457a-9458-d36b2b6010e9 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:22:05 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] VM Stopped (Lifecycle Event)
Aug 15 16:22:05 user nova-compute[72849]: DEBUG nova.compute.manager [None req-66d80233-46f6-452c-a22f-12d2db002cb1 None None] [instance: 8aa1e777-f613-457a-9458-d36b2b6010e9] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-54e5e984-66df-4ec5-b101-2c29fcded237 req-2863a7d9-e448-4fc4-b3c7-aa2efbecd27a service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received event network-changed-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-54e5e984-66df-4ec5-b101-2c29fcded237 req-2863a7d9-e448-4fc4-b3c7-aa2efbecd27a service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Refreshing instance network info cache due to event network-changed-a9418a97-870c-46fc-97bc-a65348a97f18. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:22:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-54e5e984-66df-4ec5-b101-2c29fcded237 req-2863a7d9-e448-4fc4-b3c7-aa2efbecd27a service nova] Acquiring lock "refresh_cache-052cde29-421b-4b17-9bcd-acd58456ddba" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:22:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-54e5e984-66df-4ec5-b101-2c29fcded237 req-2863a7d9-e448-4fc4-b3c7-aa2efbecd27a service nova] Acquired lock "refresh_cache-052cde29-421b-4b17-9bcd-acd58456ddba" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:22:08 user nova-compute[72849]: DEBUG nova.network.neutron [req-54e5e984-66df-4ec5-b101-2c29fcded237 req-2863a7d9-e448-4fc4-b3c7-aa2efbecd27a service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Refreshing network info cache for port a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:22:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "052cde29-421b-4b17-9bcd-acd58456ddba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "052cde29-421b-4b17-9bcd-acd58456ddba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:09 user nova-compute[72849]: DEBUG nova.objects.instance [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'flavor' on Instance uuid 052cde29-421b-4b17-9bcd-acd58456ddba {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "052cde29-421b-4b17-9bcd-acd58456ddba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "052cde29-421b-4b17-9bcd-acd58456ddba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "052cde29-421b-4b17-9bcd-acd58456ddba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:09 user nova-compute[72849]: INFO nova.compute.manager [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Attaching volume 760cfa28-9427-4744-8d35-84d61d641d6e to /dev/vdb
Aug 15 16:22:10 user nova-compute[72849]: DEBUG nova.network.neutron [req-54e5e984-66df-4ec5-b101-2c29fcded237 req-2863a7d9-e448-4fc4-b3c7-aa2efbecd27a service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Updated VIF entry in instance network info cache for port a9418a97-870c-46fc-97bc-a65348a97f18. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG nova.network.neutron [req-54e5e984-66df-4ec5-b101-2c29fcded237 req-2863a7d9-e448-4fc4-b3c7-aa2efbecd27a service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Updating instance_info_cache with network_info: [{"id": "a9418a97-870c-46fc-97bc-a65348a97f18", "address": "fa:16:3e:20:6f:8a", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9418a97-87", "ovs_interfaceid": "a9418a97-870c-46fc-97bc-a65348a97f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-54e5e984-66df-4ec5-b101-2c29fcded237 req-2863a7d9-e448-4fc4-b3c7-aa2efbecd27a service nova] Releasing lock "refresh_cache-052cde29-421b-4b17-9bcd-acd58456ddba" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG os_brick.utils [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83b3bb8-3f5f-49b7-83fc-312a806f3e73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b712d3-114f-4301-98f3-45a5fb62d5da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6f13e0-68cd-4a16-acd3-3286f9030b1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fde0d02-19ec-4ff7-92d0-43a17f7540e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:22:10 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:22:10 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3595cd-f61b-4f1d-9d28-69fc574c12e8]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG os_brick.utils [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:22:10 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Updating existing volume attachment record: 6d4e90e7-5501-4e11-90d4-6b44e33621e8 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:22:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquiring lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:22:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:12 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:22:12 user nova-compute[72849]: INFO nova.compute.claims [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Claim successful on node user
Aug 15 16:22:12 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116517.3582606, dea53f90-39ad-4c38-b67b-e23a8ce03d23 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:22:12 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] VM Stopped (Lifecycle Event)
Aug 15 16:22:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c48c1727-0509-4991-b171-a834c9495f21 None None] [instance: dea53f90-39ad-4c38-b67b-e23a8ce03d23] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:12 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:22:12 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:22:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:22:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:22:12 user nova-compute[72849]: DEBUG nova.network.neutron [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:22:12 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:22:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:22:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:22:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:22:12 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Creating image(s)
Aug 15 16:22:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "/opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "/opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.212s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG nova.policy [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0209ddf9fde4b71a069c9dfd3513e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c44524588624412a2fe9d7988490479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.185s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk 1073741824" returned: 0 in 0.050s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.196s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Cannot resize image /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG nova.objects.instance [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lazy-loading 'migration_context' on Instance uuid a3221960-e5ff-4185-a5dd-09f2cd293cb1 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Ensure instance console log exists: /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:14 user nova-compute[72849]: DEBUG nova.network.neutron [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Successfully created port: a1bba244-632e-4030-963f-55b89cbb736d {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.network.neutron [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Successfully updated port: a1bba244-632e-4030-963f-55b89cbb736d {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquiring lock "refresh_cache-a3221960-e5ff-4185-a5dd-09f2cd293cb1" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquired lock "refresh_cache-a3221960-e5ff-4185-a5dd-09f2cd293cb1" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.network.neutron [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-42de526f-820c-471c-9cc4-c287d498f7e5 req-5f44c572-f7ea-431f-9dc2-2ccf816e115c service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Received event network-changed-a1bba244-632e-4030-963f-55b89cbb736d {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-42de526f-820c-471c-9cc4-c287d498f7e5 req-5f44c572-f7ea-431f-9dc2-2ccf816e115c service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Refreshing instance network info cache due to event network-changed-a1bba244-632e-4030-963f-55b89cbb736d. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-42de526f-820c-471c-9cc4-c287d498f7e5 req-5f44c572-f7ea-431f-9dc2-2ccf816e115c service nova] Acquiring lock "refresh_cache-a3221960-e5ff-4185-a5dd-09f2cd293cb1" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.network.neutron [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.network.neutron [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Updating instance_info_cache with network_info: [{"id": "a1bba244-632e-4030-963f-55b89cbb736d", "address": "fa:16:3e:a8:49:ac", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1bba244-63", "ovs_interfaceid": "a1bba244-632e-4030-963f-55b89cbb736d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Releasing lock "refresh_cache-a3221960-e5ff-4185-a5dd-09f2cd293cb1" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Instance network_info: |[{"id": "a1bba244-632e-4030-963f-55b89cbb736d", "address": "fa:16:3e:a8:49:ac", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1bba244-63", "ovs_interfaceid": "a1bba244-632e-4030-963f-55b89cbb736d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-42de526f-820c-471c-9cc4-c287d498f7e5 req-5f44c572-f7ea-431f-9dc2-2ccf816e115c service nova] Acquired lock "refresh_cache-a3221960-e5ff-4185-a5dd-09f2cd293cb1" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.network.neutron [req-42de526f-820c-471c-9cc4-c287d498f7e5 req-5f44c572-f7ea-431f-9dc2-2ccf816e115c service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Refreshing network info cache for port a1bba244-632e-4030-963f-55b89cbb736d {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Start _get_guest_xml network_info=[{"id": "a1bba244-632e-4030-963f-55b89cbb736d", "address": "fa:16:3e:a8:49:ac", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1bba244-63", "ovs_interfaceid": "a1bba244-632e-4030-963f-55b89cbb736d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:22:15 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:22:15 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-108205641',display_name='tempest-ServersNegativeTestJSON-server-108205641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-108205641',id=19,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c44524588624412a2fe9d7988490479',ramdisk_id='',reservation_id='r-acer7roo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1396852941',owner_user_name='tempest-ServersNegativeTestJSON-1396852941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:13Z,user_data=None,user_id='f0209ddf9fde4b71a069c9dfd3513e7e',uuid=a3221960-e5ff-4185-a5dd-09f2cd293cb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1bba244-632e-4030-963f-55b89cbb736d", "address": "fa:16:3e:a8:49:ac", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1bba244-63", "ovs_interfaceid": "a1bba244-632e-4030-963f-55b89cbb736d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Converting VIF {"id": "a1bba244-632e-4030-963f-55b89cbb736d", "address": "fa:16:3e:a8:49:ac", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1bba244-63", "ovs_interfaceid": "a1bba244-632e-4030-963f-55b89cbb736d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:49:ac,bridge_name='br-int',has_traffic_filtering=True,id=a1bba244-632e-4030-963f-55b89cbb736d,network=Network(8b5ff7d7-7bfc-467c-aae2-eced27be5b87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1bba244-63') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.objects.instance [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lazy-loading 'pci_devices' on Instance uuid a3221960-e5ff-4185-a5dd-09f2cd293cb1 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:22:15 user nova-compute[72849]:   <uuid>a3221960-e5ff-4185-a5dd-09f2cd293cb1</uuid>
Aug 15 16:22:15 user nova-compute[72849]:   <name>instance-00000013</name>
Aug 15 16:22:15 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:22:15 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:22:15 user nova-compute[72849]:   <metadata>
Aug 15 16:22:15 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:22:15 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:22:15 user nova-compute[72849]:       <nova:name>tempest-ServersNegativeTestJSON-server-108205641</nova:name>
Aug 15 16:22:15 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:22:15</nova:creationTime>
Aug 15 16:22:15 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:22:15 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:22:15 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:22:15 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:22:15 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:22:15 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:22:15 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:22:15 user nova-compute[72849]:       <nova:owner>
Aug 15 16:22:15 user nova-compute[72849]:         <nova:user uuid="f0209ddf9fde4b71a069c9dfd3513e7e">tempest-ServersNegativeTestJSON-1396852941-project-member</nova:user>
Aug 15 16:22:15 user nova-compute[72849]:         <nova:project uuid="9c44524588624412a2fe9d7988490479">tempest-ServersNegativeTestJSON-1396852941</nova:project>
Aug 15 16:22:15 user nova-compute[72849]:       </nova:owner>
Aug 15 16:22:15 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:22:15 user nova-compute[72849]:       <nova:ports>
Aug 15 16:22:15 user nova-compute[72849]:         <nova:port uuid="a1bba244-632e-4030-963f-55b89cbb736d">
Aug 15 16:22:15 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:22:15 user nova-compute[72849]:         </nova:port>
Aug 15 16:22:15 user nova-compute[72849]:       </nova:ports>
Aug 15 16:22:15 user nova-compute[72849]:     </nova:instance>
Aug 15 16:22:15 user nova-compute[72849]:   </metadata>
Aug 15 16:22:15 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:22:15 user nova-compute[72849]:     <system>
Aug 15 16:22:15 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:22:15 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:22:15 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:22:15 user nova-compute[72849]:       <entry name="serial">a3221960-e5ff-4185-a5dd-09f2cd293cb1</entry>
Aug 15 16:22:15 user nova-compute[72849]:       <entry name="uuid">a3221960-e5ff-4185-a5dd-09f2cd293cb1</entry>
Aug 15 16:22:15 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:22:15 user nova-compute[72849]:     </system>
Aug 15 16:22:15 user nova-compute[72849]:   </sysinfo>
Aug 15 16:22:15 user nova-compute[72849]:   <os>
Aug 15 16:22:15 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:22:15 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:22:15 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:22:15 user nova-compute[72849]:   </os>
Aug 15 16:22:15 user nova-compute[72849]:   <features>
Aug 15 16:22:15 user nova-compute[72849]:     <acpi/>
Aug 15 16:22:15 user nova-compute[72849]:     <apic/>
Aug 15 16:22:15 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:22:15 user nova-compute[72849]:   </features>
Aug 15 16:22:15 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:22:15 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:22:15 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:22:15 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:22:15 user nova-compute[72849]:   </clock>
Aug 15 16:22:15 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:22:15 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:22:15 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:22:15 user nova-compute[72849]:   </cpu>
Aug 15 16:22:15 user nova-compute[72849]:   <devices>
Aug 15 16:22:15 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:22:15 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:22:15 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk"/>
Aug 15 16:22:15 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:22:15 user nova-compute[72849]:     </disk>
Aug 15 16:22:15 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:22:15 user nova-compute[72849]:       <mac address="fa:16:3e:a8:49:ac"/>
Aug 15 16:22:15 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:22:15 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:22:15 user nova-compute[72849]:       <target dev="tapa1bba244-63"/>
Aug 15 16:22:15 user nova-compute[72849]:     </interface>
Aug 15 16:22:15 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:22:15 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/console.log" append="off"/>
Aug 15 16:22:15 user nova-compute[72849]:     </serial>
Aug 15 16:22:15 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:22:15 user nova-compute[72849]:     <video>
Aug 15 16:22:15 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:22:15 user nova-compute[72849]:     </video>
Aug 15 16:22:15 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:22:15 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:22:15 user nova-compute[72849]:     </rng>
Aug 15 16:22:15 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:22:15 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:22:15 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:22:15 user nova-compute[72849]:     </memballoon>
Aug 15 16:22:15 user nova-compute[72849]:   </devices>
Aug 15 16:22:15 user nova-compute[72849]: </domain>
Aug 15 16:22:15 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-108205641',display_name='tempest-ServersNegativeTestJSON-server-108205641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-108205641',id=19,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c44524588624412a2fe9d7988490479',ramdisk_id='',reservation_id='r-acer7roo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1396852941',owner_user_name='tempest-ServersNegativeTestJSON-1396852941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:13Z,user_data=None,user_id='f0209ddf9fde4b71a069c9dfd3513e7e',uuid=a3221960-e5ff-4185-a5dd-09f2cd293cb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1bba244-632e-4030-963f-55b89cbb736d", "address": "fa:16:3e:a8:49:ac", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1bba244-63", "ovs_interfaceid": "a1bba244-632e-4030-963f-55b89cbb736d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Converting VIF {"id": "a1bba244-632e-4030-963f-55b89cbb736d", "address": "fa:16:3e:a8:49:ac", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1bba244-63", "ovs_interfaceid": "a1bba244-632e-4030-963f-55b89cbb736d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:49:ac,bridge_name='br-int',has_traffic_filtering=True,id=a1bba244-632e-4030-963f-55b89cbb736d,network=Network(8b5ff7d7-7bfc-467c-aae2-eced27be5b87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1bba244-63') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG os_vif [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:49:ac,bridge_name='br-int',has_traffic_filtering=True,id=a1bba244-632e-4030-963f-55b89cbb736d,network=Network(8b5ff7d7-7bfc-467c-aae2-eced27be5b87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1bba244-63') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1bba244-63, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa1bba244-63, col_values=(('external_ids', {'iface-id': 'a1bba244-632e-4030-963f-55b89cbb736d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:49:ac', 'vm-uuid': 'a3221960-e5ff-4185-a5dd-09f2cd293cb1'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:15 user nova-compute[72849]: INFO os_vif [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:49:ac,bridge_name='br-int',has_traffic_filtering=True,id=a1bba244-632e-4030-963f-55b89cbb736d,network=Network(8b5ff7d7-7bfc-467c-aae2-eced27be5b87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1bba244-63')
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:22:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] No VIF found with MAC fa:16:3e:a8:49:ac, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:22:16 user nova-compute[72849]: DEBUG nova.network.neutron [req-42de526f-820c-471c-9cc4-c287d498f7e5 req-5f44c572-f7ea-431f-9dc2-2ccf816e115c service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Updated VIF entry in instance network info cache for port a1bba244-632e-4030-963f-55b89cbb736d. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:22:16 user nova-compute[72849]: DEBUG nova.network.neutron [req-42de526f-820c-471c-9cc4-c287d498f7e5 req-5f44c572-f7ea-431f-9dc2-2ccf816e115c service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Updating instance_info_cache with network_info: [{"id": "a1bba244-632e-4030-963f-55b89cbb736d", "address": "fa:16:3e:a8:49:ac", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1bba244-63", "ovs_interfaceid": "a1bba244-632e-4030-963f-55b89cbb736d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-42de526f-820c-471c-9cc4-c287d498f7e5 req-5f44c572-f7ea-431f-9dc2-2ccf816e115c service nova] Releasing lock "refresh_cache-a3221960-e5ff-4185-a5dd-09f2cd293cb1" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:22:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-2f1eedda-c924-4df9-8db8-50fa059605cc req-f451d278-f267-4f0e-8ff9-de4176d6c8db service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Received event network-vif-plugged-a1bba244-632e-4030-963f-55b89cbb736d {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2f1eedda-c924-4df9-8db8-50fa059605cc req-f451d278-f267-4f0e-8ff9-de4176d6c8db service nova] Acquiring lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2f1eedda-c924-4df9-8db8-50fa059605cc req-f451d278-f267-4f0e-8ff9-de4176d6c8db service nova] Lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2f1eedda-c924-4df9-8db8-50fa059605cc req-f451d278-f267-4f0e-8ff9-de4176d6c8db service nova] Lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-2f1eedda-c924-4df9-8db8-50fa059605cc req-f451d278-f267-4f0e-8ff9-de4176d6c8db service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] No waiting events found dispatching network-vif-plugged-a1bba244-632e-4030-963f-55b89cbb736d {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:17 user nova-compute[72849]: WARNING nova.compute.manager [req-2f1eedda-c924-4df9-8db8-50fa059605cc req-f451d278-f267-4f0e-8ff9-de4176d6c8db service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Received unexpected event network-vif-plugged-a1bba244-632e-4030-963f-55b89cbb736d for instance with vm_state building and task_state spawning.
Aug 15 16:22:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:18 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:22:18 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 16:22:18 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] There are 0 instances to clean {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 16:22:19 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116539.6638944, a3221960-e5ff-4185-a5dd-09f2cd293cb1 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:22:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] VM Resumed (Lifecycle Event)
Aug 15 16:22:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:22:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:22:19 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Instance spawned successfully.
Aug 15 16:22:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:22:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:22:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:22:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:22:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:22:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:22:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:22:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:22:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:22:19 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116539.6651495, a3221960-e5ff-4185-a5dd-09f2cd293cb1 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:22:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] VM Started (Lifecycle Event)
Aug 15 16:22:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:22:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-942f4986-6616-4367-b328-2160ac11f1fe req-63859ad3-b97b-4ba2-bb97-8d633331595f service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Received event network-vif-plugged-a1bba244-632e-4030-963f-55b89cbb736d {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-942f4986-6616-4367-b328-2160ac11f1fe req-63859ad3-b97b-4ba2-bb97-8d633331595f service nova] Acquiring lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-942f4986-6616-4367-b328-2160ac11f1fe req-63859ad3-b97b-4ba2-bb97-8d633331595f service nova] Lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-942f4986-6616-4367-b328-2160ac11f1fe req-63859ad3-b97b-4ba2-bb97-8d633331595f service nova] Lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-942f4986-6616-4367-b328-2160ac11f1fe req-63859ad3-b97b-4ba2-bb97-8d633331595f service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] No waiting events found dispatching network-vif-plugged-a1bba244-632e-4030-963f-55b89cbb736d {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:19 user nova-compute[72849]: WARNING nova.compute.manager [req-942f4986-6616-4367-b328-2160ac11f1fe req-63859ad3-b97b-4ba2-bb97-8d633331595f service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Received unexpected event network-vif-plugged-a1bba244-632e-4030-963f-55b89cbb736d for instance with vm_state building and task_state spawning.
Aug 15 16:22:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:22:19 user nova-compute[72849]: INFO nova.compute.manager [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Took 7.00 seconds to spawn the instance on the hypervisor.
Aug 15 16:22:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:19 user nova-compute[72849]: INFO nova.compute.manager [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Took 7.92 seconds to build instance.
Aug 15 16:22:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f50616a5-fa20-4968-959a-9aaca37dadf1 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.050s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:20 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:22:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:22:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhjeSioA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:22:20 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:22:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:22:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:22:20 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:22:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:22:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:22:20 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:22:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3e3748-6bbe-4394-b9e5-a0d654fc6d15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:22:20 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d64008c-0446-4604-8d98-5a7aae86a626]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e] added
Aug 15 16:22:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c73361b-5b9b-46a1-81f1-509d7582dfb0]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e0f058-cb54-4ae1-af14-9a0673e600c9]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PhjeSioA {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PhjeSioA" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[366f7351-cdc1-487e-a80f-fb07aa8262d0]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PhjeSioA'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ade45ae-eaa5-4dc6-8c64-9aaee9994218]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[33598907-ca63-4a9e-a902-79add89d7d26]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:22:21 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:22:21 user nova-compute[72849]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:22:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:22:21 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:22:21 user nova-compute[72849]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:22:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d826bfa-7d18-4548-b197-b80dcf6c9955]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e, portal: 172.16.0.220,3260]
Aug 15 16:22:21 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e, portal: 172.16.0.220,3260] successful.
Aug 15 16:22:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf537f7-a3ed-48cf-9878-26b8d1ef1cc7]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1a8e96-afad-4f60-bc5c-c65efc0084f4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:22:21 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:22:21 user nova-compute[72849]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:22:21 user nova-compute[72849]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:22:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:22:21 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:22:21 user nova-compute[72849]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:22:21 user nova-compute[72849]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:22:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1458d5-2675-4c16-9631-889fb2aebb5f]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhjeSioA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23434373631386565', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434373631386565', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG nova.objects.instance [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'flavor' on Instance uuid 052cde29-421b-4b17-9bcd-acd58456ddba {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:22:22 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:22:22 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:22:22 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:22:22 user nova-compute[72849]:   <serial>760cfa28-9427-4744-8d35-84d61d641d6e</serial>
Aug 15 16:22:22 user nova-compute[72849]: </disk>
Aug 15 16:22:22 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] No VIF found with MAC fa:16:3e:20:6f:8a, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:22:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-13271509-ece9-4417-bd26-db869676c19a tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "052cde29-421b-4b17-9bcd-acd58456ddba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.126s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:23 user nova-compute[72849]: DEBUG nova.compute.manager [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:22:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:23 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:22:23 user nova-compute[72849]: INFO nova.compute.claims [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Claim successful on node user
Aug 15 16:22:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG nova.network.neutron [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:24 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:22:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:22:24 user nova-compute[72849]: INFO nova.virt.block_device [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Booting with volume 2a3534d2-37c8-4827-9b01-6f0c7cac0c70 at /dev/vda
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG os_brick.utils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG nova.policy [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b969d9f150524650bdb3f0535270ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7485d9d649d4d6e8d0eef09cc1b28d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afa5053-0b09-4e52-a829-8aec24d7d38a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f80211-9d84-4abb-9717-d54fffc3b80a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[167d9114-ef1d-4654-9cc2-feb1702a9be7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0035e55-307a-478a-8af4-0ba150a70b3f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:22:24 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[136d3780-c185-4a79-b3f6-4a1ec46947bd]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG os_brick.utils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updating existing volume attachment record: c4ec25eb-b034-4794-b27a-fe82e59cae4a {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:24 user nova-compute[72849]: INFO nova.compute.manager [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Rebuilding instance
Aug 15 16:22:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG nova.objects.instance [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'trusted_certs' on Instance uuid 052cde29-421b-4b17-9bcd-acd58456ddba {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG nova.compute.manager [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG nova.objects.instance [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'pci_requests' on Instance uuid 052cde29-421b-4b17-9bcd-acd58456ddba {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG nova.objects.instance [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'pci_devices' on Instance uuid 052cde29-421b-4b17-9bcd-acd58456ddba {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG nova.objects.instance [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'resources' on Instance uuid 052cde29-421b-4b17-9bcd-acd58456ddba {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG nova.objects.instance [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'migration_context' on Instance uuid 052cde29-421b-4b17-9bcd-acd58456ddba {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG nova.objects.instance [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72849) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.355s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:25 user nova-compute[72849]: INFO nova.compute.manager [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Rescuing
Aug 15 16:22:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "refresh_cache-46f0aa43-e313-4aff-bacc-aa5290193b00" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquired lock "refresh_cache-46f0aa43-e313-4aff-bacc-aa5290193b00" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG nova.network.neutron [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG nova.network.neutron [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Updating instance_info_cache with network_info: [{"id": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "address": "fa:16:3e:dc:17:58", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6eba8c-01", "ovs_interfaceid": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG nova.network.neutron [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Successfully created port: ba545c48-7768-4efb-ac4d-d4221464afaf {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Releasing lock "refresh_cache-46f0aa43-e313-4aff-bacc-aa5290193b00" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:26 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Instance destroyed successfully.
Aug 15 16:22:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-905ad3cc-2a90-4f34-89fa-017a5219cfc4 req-0498210d-2c3e-4dcd-85ae-894a23655e45 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received event network-vif-unplugged-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-905ad3cc-2a90-4f34-89fa-017a5219cfc4 req-0498210d-2c3e-4dcd-85ae-894a23655e45 service nova] Acquiring lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-905ad3cc-2a90-4f34-89fa-017a5219cfc4 req-0498210d-2c3e-4dcd-85ae-894a23655e45 service nova] Lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-905ad3cc-2a90-4f34-89fa-017a5219cfc4 req-0498210d-2c3e-4dcd-85ae-894a23655e45 service nova] Lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-905ad3cc-2a90-4f34-89fa-017a5219cfc4 req-0498210d-2c3e-4dcd-85ae-894a23655e45 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] No waiting events found dispatching network-vif-unplugged-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:26 user nova-compute[72849]: WARNING nova.compute.manager [req-905ad3cc-2a90-4f34-89fa-017a5219cfc4 req-0498210d-2c3e-4dcd-85ae-894a23655e45 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received unexpected event network-vif-unplugged-a9418a97-870c-46fc-97bc-a65348a97f18 for instance with vm_state active and task_state rebuilding.
Aug 15 16:22:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:26 user nova-compute[72849]: INFO nova.compute.manager [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Detaching volume 760cfa28-9427-4744-8d35-84d61d641d6e
Aug 15 16:22:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-c0c81826-a960-4eec-a26d-e2cbe70585c3 req-3a9866a8-2db4-4cac-a0cd-615665b93dbf service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Received event network-vif-unplugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c0c81826-a960-4eec-a26d-e2cbe70585c3 req-3a9866a8-2db4-4cac-a0cd-615665b93dbf service nova] Acquiring lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c0c81826-a960-4eec-a26d-e2cbe70585c3 req-3a9866a8-2db4-4cac-a0cd-615665b93dbf service nova] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c0c81826-a960-4eec-a26d-e2cbe70585c3 req-3a9866a8-2db4-4cac-a0cd-615665b93dbf service nova] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-c0c81826-a960-4eec-a26d-e2cbe70585c3 req-3a9866a8-2db4-4cac-a0cd-615665b93dbf service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] No waiting events found dispatching network-vif-unplugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:26 user nova-compute[72849]: WARNING nova.compute.manager [req-c0c81826-a960-4eec-a26d-e2cbe70585c3 req-3a9866a8-2db4-4cac-a0cd-615665b93dbf service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Received unexpected event network-vif-unplugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb for instance with vm_state active and task_state rescuing.
Aug 15 16:22:26 user nova-compute[72849]: INFO nova.virt.block_device [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Attempting to driver detach volume 760cfa28-9427-4744-8d35-84d61d641d6e from mountpoint /dev/vdb
Aug 15 16:22:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Attempting to detach device vdb from instance 052cde29-421b-4b17-9bcd-acd58456ddba from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:22:26 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:22:26 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:22:26 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:22:26 user nova-compute[72849]:   <serial>760cfa28-9427-4744-8d35-84d61d641d6e</serial>
Aug 15 16:22:26 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:22:26 user nova-compute[72849]: </disk>
Aug 15 16:22:26 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:26 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Successfully detached device vdb from instance 052cde29-421b-4b17-9bcd-acd58456ddba from the persistent domain config.
Aug 15 16:22:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhjeSioA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:22:26 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 16:22:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdbcbf6-5c68-4c13-93cf-dd1c01f9d461]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9493a0-056d-4ab5-9908-8e643ba0a78c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:22:26 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:22:26 user nova-compute[72849]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:22:26 user nova-compute[72849]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:22:26 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:22:26 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:22:26 user nova-compute[72849]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:22:26 user nova-compute[72849]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:22:26 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3582c9ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:22:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38936dc-ba87-4531-9ecd-5fce7f691ce5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.040s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[92062c62-3711-4fc2-9160-cb07d97811ce]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a43c6c8-6c08-4c3c-9e5b-dbb0bb9ada30]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bde2c6-84c4-4c30-98c1-6016dd61cc5c]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:27 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Instance destroyed successfully.
Aug 15 16:22:27 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Attempting rescue
Aug 15 16:22:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72849) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1346a202-f0ef-4b96-ae4f-70a0bdf61c86]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Instance directory exists: not creating {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 16:22:27 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Creating image(s)
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "/opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "/opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "/opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG nova.objects.instance [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'trusted_certs' on Instance uuid 46f0aa43-e313-4aff-bacc-aa5290193b00 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28d25a5-70a9-4b1e-b7b6-f5abc4cc29de]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e, portal: 172.16.0.220,3260]
Aug 15 16:22:27 user nova-compute[72849]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e, portal: 172.16.0.220,3260] successful.
Aug 15 16:22:27 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47ae48a-9182-4b0b-8892-c13acf8ba163]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.466s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] <== disconnect_volume: return (470ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG nova.network.neutron [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Successfully created port: 2eeb5ba8-9589-4373-afaf-e90135c84256 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.711s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:27 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:22:27 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:22:27 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=6964MB free_disk=25.243335723876953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue" returned: 0 in 0.059s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.772s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.objects.instance [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'migration_context' on Instance uuid 46f0aa43-e313-4aff-bacc-aa5290193b00 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Start _get_guest_xml network_info=[{"id": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "address": "fa:16:3e:dc:17:58", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "vif_mac": "fa:16:3e:dc:17:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6eba8c-01", "ovs_interfaceid": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.objects.instance [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'resources' on Instance uuid 46f0aa43-e313-4aff-bacc-aa5290193b00 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.objects.instance [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'numa_topology' on Instance uuid 46f0aa43-e313-4aff-bacc-aa5290193b00 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:28 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:22:28 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.objects.instance [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'vcpu_model' on Instance uuid 46f0aa43-e313-4aff-bacc-aa5290193b00 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:20:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1098266755',display_name='tempest-ServerRescueNegativeTestJSON-server-1098266755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1098266755',id=17,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63fff6abd55f4552b56b7f80f3b19990',ramdisk_id='',reservation_id='r-0yzyeyqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-817230683',owner_user_name='tempest-ServerRescueNegativeTestJSON-817230683-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:20:47Z,user_data=None,user_id='a6bc0fd1358a42debf05e9bc43b8e329',uuid=46f0aa43-e313-4aff-bacc-aa5290193b00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "address": "fa:16:3e:dc:17:58", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "vif_mac": "fa:16:3e:dc:17:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6eba8c-01", "ovs_interfaceid": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converting VIF {"id": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "address": "fa:16:3e:dc:17:58", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "vif_mac": "fa:16:3e:dc:17:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6eba8c-01", "ovs_interfaceid": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:17:58,bridge_name='br-int',has_traffic_filtering=True,id=2e6eba8c-01a5-4e16-95da-51ce996ed2eb,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6eba8c-01') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.objects.instance [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'pci_devices' on Instance uuid 46f0aa43-e313-4aff-bacc-aa5290193b00 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.network.neutron [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Successfully created port: 97188a57-9dc6-485a-9362-b44dbe9f2669 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Applying migration context for instance b0a869eb-9ee8-4c31-9786-5b8be7d362a9 as it has an incoming, in-progress migration 5def4dc0-2f71-4b78-ac69-f4756ff41fd3. Migration status is finished {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 16:22:28 user nova-compute[72849]: INFO nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updating resource usage from migration 5def4dc0-2f71-4b78-ac69-f4756ff41fd3
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:22:28 user nova-compute[72849]:   <uuid>46f0aa43-e313-4aff-bacc-aa5290193b00</uuid>
Aug 15 16:22:28 user nova-compute[72849]:   <name>instance-00000011</name>
Aug 15 16:22:28 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:22:28 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:22:28 user nova-compute[72849]:   <metadata>
Aug 15 16:22:28 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:22:28 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:22:28 user nova-compute[72849]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1098266755</nova:name>
Aug 15 16:22:28 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:22:28</nova:creationTime>
Aug 15 16:22:28 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:22:28 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:22:28 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:22:28 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:22:28 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:22:28 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:22:28 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:22:28 user nova-compute[72849]:       <nova:owner>
Aug 15 16:22:28 user nova-compute[72849]:         <nova:user uuid="a6bc0fd1358a42debf05e9bc43b8e329">tempest-ServerRescueNegativeTestJSON-817230683-project-member</nova:user>
Aug 15 16:22:28 user nova-compute[72849]:         <nova:project uuid="63fff6abd55f4552b56b7f80f3b19990">tempest-ServerRescueNegativeTestJSON-817230683</nova:project>
Aug 15 16:22:28 user nova-compute[72849]:       </nova:owner>
Aug 15 16:22:28 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:22:28 user nova-compute[72849]:       <nova:ports>
Aug 15 16:22:28 user nova-compute[72849]:         <nova:port uuid="2e6eba8c-01a5-4e16-95da-51ce996ed2eb">
Aug 15 16:22:28 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 16:22:28 user nova-compute[72849]:         </nova:port>
Aug 15 16:22:28 user nova-compute[72849]:       </nova:ports>
Aug 15 16:22:28 user nova-compute[72849]:     </nova:instance>
Aug 15 16:22:28 user nova-compute[72849]:   </metadata>
Aug 15 16:22:28 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:22:28 user nova-compute[72849]:     <system>
Aug 15 16:22:28 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:22:28 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:22:28 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:22:28 user nova-compute[72849]:       <entry name="serial">46f0aa43-e313-4aff-bacc-aa5290193b00</entry>
Aug 15 16:22:28 user nova-compute[72849]:       <entry name="uuid">46f0aa43-e313-4aff-bacc-aa5290193b00</entry>
Aug 15 16:22:28 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:22:28 user nova-compute[72849]:     </system>
Aug 15 16:22:28 user nova-compute[72849]:   </sysinfo>
Aug 15 16:22:28 user nova-compute[72849]:   <os>
Aug 15 16:22:28 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:22:28 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:22:28 user nova-compute[72849]:   </os>
Aug 15 16:22:28 user nova-compute[72849]:   <features>
Aug 15 16:22:28 user nova-compute[72849]:     <acpi/>
Aug 15 16:22:28 user nova-compute[72849]:     <apic/>
Aug 15 16:22:28 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:22:28 user nova-compute[72849]:   </features>
Aug 15 16:22:28 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:22:28 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:22:28 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:22:28 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:22:28 user nova-compute[72849]:   </clock>
Aug 15 16:22:28 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:22:28 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:22:28 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:22:28 user nova-compute[72849]:   </cpu>
Aug 15 16:22:28 user nova-compute[72849]:   <devices>
Aug 15 16:22:28 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:22:28 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:22:28 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue"/>
Aug 15 16:22:28 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:22:28 user nova-compute[72849]:     </disk>
Aug 15 16:22:28 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:22:28 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:22:28 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk"/>
Aug 15 16:22:28 user nova-compute[72849]:       <target dev="vdb" bus="virtio"/>
Aug 15 16:22:28 user nova-compute[72849]:     </disk>
Aug 15 16:22:28 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:22:28 user nova-compute[72849]:       <mac address="fa:16:3e:dc:17:58"/>
Aug 15 16:22:28 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:22:28 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:22:28 user nova-compute[72849]:       <target dev="tap2e6eba8c-01"/>
Aug 15 16:22:28 user nova-compute[72849]:     </interface>
Aug 15 16:22:28 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:22:28 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/console.log" append="off"/>
Aug 15 16:22:28 user nova-compute[72849]:     </serial>
Aug 15 16:22:28 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:22:28 user nova-compute[72849]:     <video>
Aug 15 16:22:28 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:22:28 user nova-compute[72849]:     </video>
Aug 15 16:22:28 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:22:28 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:22:28 user nova-compute[72849]:     </rng>
Aug 15 16:22:28 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:22:28 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:22:28 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:22:28 user nova-compute[72849]:     </memballoon>
Aug 15 16:22:28 user nova-compute[72849]:   </devices>
Aug 15 16:22:28 user nova-compute[72849]: </domain>
Aug 15 16:22:28 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:22:28 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Instance destroyed successfully.
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 341edacc-b44b-4d92-9fcd-982c252fcdd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 052cde29-421b-4b17-9bcd-acd58456ddba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc521d87-09aa-44ba-a87c-1cd5517b3707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 46f0aa43-e313-4aff-bacc-aa5290193b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Migration 5def4dc0-2f71-4b78-ac69-f4756ff41fd3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b0a869eb-9ee8-4c31-9786-5b8be7d362a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance a3221960-e5ff-4185-a5dd-09f2cd293cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 49874ea8-8d01-4de6-a3cc-fc35af67665e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] No VIF found with MAC fa:16:3e:dc:17:58, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing inventories for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 16:22:28 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Instance destroyed successfully.
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:20:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1165172925',display_name='tempest-ServerActionsTestOtherA-server-2077178336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1165172925',id=15,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWBknFznF3Br/e4erZ96RmBYDGn9QHpqMDloNSpP2DJ4x6ZpnS6SI2xoXmzVDqEscehLRvnBUFKCcKRhuMKezXg92SXubTl6wUnndM1gWudDEMYfZ38YquQQ+VVBgQblw==',key_name='tempest-keypair-1330851775',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='33a3a3412c95451db4dd0edc27f361cc',ramdisk_id='',reservation_id='r-8l740hjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-514064593',owner_user_name='tempest-ServerActionsTestOtherA-514064593-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60cbe30799ad4438b84251a254691b70',uuid=052cde29-421b-4b17-9bcd-acd58456ddba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9418a97-870c-46fc-97bc-a65348a97f18", "address": "fa:16:3e:20:6f:8a", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9418a97-87", "ovs_interfaceid": "a9418a97-870c-46fc-97bc-a65348a97f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converting VIF {"id": "a9418a97-870c-46fc-97bc-a65348a97f18", "address": "fa:16:3e:20:6f:8a", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9418a97-87", "ovs_interfaceid": "a9418a97-870c-46fc-97bc-a65348a97f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:6f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a9418a97-870c-46fc-97bc-a65348a97f18,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9418a97-87') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG os_vif [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:6f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a9418a97-870c-46fc-97bc-a65348a97f18,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9418a97-87') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9418a97-87, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating ProviderTree inventory for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating inventory in ProviderTree for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 16:22:28 user nova-compute[72849]: INFO os_vif [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:6f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a9418a97-870c-46fc-97bc-a65348a97f18,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9418a97-87')
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhjeSioA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:22:28 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 16:22:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing aggregate associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, aggregates: None {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b5557d-c050-426e-b9e3-62e165d9f23a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e487beb0-b44a-49f3-aa0a-927beb017735]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:22:28 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:22:28 user nova-compute[72849]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:22:28 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:22:28 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:22:28 user nova-compute[72849]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:22:28 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3582ed7e0>, {}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Disconnecting from: [] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.055s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] <== disconnect_volume: return (56ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:22:28 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Deleting instance files /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba_del
Aug 15 16:22:28 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Deletion of /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba_del complete
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing trait associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.manager [req-e3d06176-bde8-4f2f-91d9-54277d878707 req-6b283b62-b133-4991-b926-a830ad1a07fd service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received event network-vif-plugged-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e3d06176-bde8-4f2f-91d9-54277d878707 req-6b283b62-b133-4991-b926-a830ad1a07fd service nova] Acquiring lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e3d06176-bde8-4f2f-91d9-54277d878707 req-6b283b62-b133-4991-b926-a830ad1a07fd service nova] Lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e3d06176-bde8-4f2f-91d9-54277d878707 req-6b283b62-b133-4991-b926-a830ad1a07fd service nova] Lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.manager [req-e3d06176-bde8-4f2f-91d9-54277d878707 req-6b283b62-b133-4991-b926-a830ad1a07fd service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] No waiting events found dispatching network-vif-plugged-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:28 user nova-compute[72849]: WARNING nova.compute.manager [req-e3d06176-bde8-4f2f-91d9-54277d878707 req-6b283b62-b133-4991-b926-a830ad1a07fd service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received unexpected event network-vif-plugged-a9418a97-870c-46fc-97bc-a65348a97f18 for instance with vm_state active and task_state rebuilding.
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.network.neutron [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Port 25a67315-9859-4077-8f36-23635b760770 binding to destination host user is already ACTIVE {{(pid=72849) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquired lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.network.neutron [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:22:28 user nova-compute[72849]: INFO nova.virt.block_device [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Booting with volume 760cfa28-9427-4744-8d35-84d61d641d6e at /dev/vdb
Aug 15 16:22:28 user nova-compute[72849]: DEBUG os_brick.utils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2894b90a-6037-4428-abb9-be32fd2abdb4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.manager [req-d6f80178-ec17-48f4-ae74-ac261f67b7f0 req-d740af88-414d-4d9d-b4ad-c4f375677784 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Received event network-vif-plugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d6f80178-ec17-48f4-ae74-ac261f67b7f0 req-d740af88-414d-4d9d-b4ad-c4f375677784 service nova] Acquiring lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d6f80178-ec17-48f4-ae74-ac261f67b7f0 req-d740af88-414d-4d9d-b4ad-c4f375677784 service nova] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d6f80178-ec17-48f4-ae74-ac261f67b7f0 req-d740af88-414d-4d9d-b4ad-c4f375677784 service nova] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.compute.manager [req-d6f80178-ec17-48f4-ae74-ac261f67b7f0 req-d740af88-414d-4d9d-b4ad-c4f375677784 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] No waiting events found dispatching network-vif-plugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:28 user nova-compute[72849]: WARNING nova.compute.manager [req-d6f80178-ec17-48f4-ae74-ac261f67b7f0 req-d740af88-414d-4d9d-b4ad-c4f375677784 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Received unexpected event network-vif-plugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb for instance with vm_state active and task_state rescuing.
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f12bdfe-9647-4ae9-a382-17be80c5d381]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a69b24-546b-4004-8000-d6ba764eb7f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1463380a-59bd-4f75-8105-428842d68b69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:22:28 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:22:28 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea52e68-3caa-40c7-8c41-42046ac21aaa]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG os_brick.utils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:22:28 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Updating existing volume attachment record: 0e126295-96ac-4926-9843-ae3939ea92f8 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.258s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72849) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG nova.network.neutron [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Successfully created port: 62c51ab6-ca9a-4c11-bea6-ab58d22e80dc {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG nova.network.neutron [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updating instance_info_cache with network_info: [{"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Releasing lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:22:29 user nova-compute[72849]: INFO nova.compute.manager [None req-9e00e163-94f7-42ab-88b7-d2a2a523cf63 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Unrescuing
Aug 15 16:22:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9e00e163-94f7-42ab-88b7-d2a2a523cf63 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9e00e163-94f7-42ab-88b7-d2a2a523cf63 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquired lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9e00e163-94f7-42ab-88b7-d2a2a523cf63 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Creating tmpfile /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/tmpso36s7ei to verify with other compute node that the instance is on the same shared storage. {{(pid=72849) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9e00e163-94f7-42ab-88b7-d2a2a523cf63 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Updating instance_info_cache with network_info: [{"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9e00e163-94f7-42ab-88b7-d2a2a523cf63 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Releasing lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9e00e163-94f7-42ab-88b7-d2a2a523cf63 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lazy-loading 'flavor' on Instance uuid 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Didn't find any instances for network info cache update. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG nova.network.neutron [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Successfully created port: 07063ce8-2e0a-4d84-9dcc-7b09379d313a {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:22:30 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Instance destroyed successfully.
Aug 15 16:22:30 user nova-compute[72849]: DEBUG nova.objects.instance [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lazy-loading 'resources' on Instance uuid b0a869eb-9ee8-4c31-9786-5b8be7d362a9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1690114442',display_name='tempest-ServerActionsTestOtherB-server-1690114442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1690114442',id=3,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+hh3mOCKtCImu1/lg7z7Mltoc1di1aJCPq0550JQzfICBVP48YFxiWhHNSQqhuSWVzxUKF+hNAtXneGjvrY/qA0OutpYd9sLJegliqP2OTf5sqdDZP815XUZAuWEPAcQ==',key_name='tempest-keypair-493994408',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:21:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b16b734f348e4d9ca7faba1f84f188a8',ramdisk_id='',reservation_id='r-43bap4gi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1970367935',owner_user_name='tempest-ServerActionsTestOtherB-1970367935-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:21:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90af38c3a2a64683a12871bb2a5e0a0f',uuid=b0a869eb-9ee8-4c31-9786-5b8be7d362a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Converting VIF {"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG os_vif [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25a67315-98, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:30 user nova-compute[72849]: INFO os_vif [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98')
Aug 15 16:22:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVdiagcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:22:30 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:22:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfe758c-9e38-44fe-bba5-f7621ae4552f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf2e62d-6074-40cf-ab10-74457a92d619]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:22:30 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:22:30 user nova-compute[72849]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:22:30 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:22:30 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:22:30 user nova-compute[72849]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:22:30 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc358571090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5'): ({'sdd'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Removing single pathed devices sdd {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad52f948-fc83-488e-9529-b4e903ed5b6c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1775cadf-9254-4b4a-8d20-24f2d618a47e]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Flushing IO for device /dev/sdd {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9314088c-e2d4-4477-8657-7d2dc17d2cb4]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG nova.compute.manager [req-1dc9e8a1-5217-458c-ae22-3ab3c3594bc6 req-f80c624f-7c23-4d01-85c2-17272845b712 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received event network-vif-unplugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1dc9e8a1-5217-458c-ae22-3ab3c3594bc6 req-f80c624f-7c23-4d01-85c2-17272845b712 service nova] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1dc9e8a1-5217-458c-ae22-3ab3c3594bc6 req-f80c624f-7c23-4d01-85c2-17272845b712 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1dc9e8a1-5217-458c-ae22-3ab3c3594bc6 req-f80c624f-7c23-4d01-85c2-17272845b712 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG nova.compute.manager [req-1dc9e8a1-5217-458c-ae22-3ab3c3594bc6 req-f80c624f-7c23-4d01-85c2-17272845b712 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] No waiting events found dispatching network-vif-unplugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:30 user nova-compute[72849]: WARNING nova.compute.manager [req-1dc9e8a1-5217-458c-ae22-3ab3c3594bc6 req-f80c624f-7c23-4d01-85c2-17272845b712 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received unexpected event network-vif-unplugged-25a67315-9859-4077-8f36-23635b760770 for instance with vm_state resized and task_state resize_reverting.
Aug 15 16:22:30 user nova-compute[72849]: DEBUG nova.compute.manager [req-1dc9e8a1-5217-458c-ae22-3ab3c3594bc6 req-f80c624f-7c23-4d01-85c2-17272845b712 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received event network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1dc9e8a1-5217-458c-ae22-3ab3c3594bc6 req-f80c624f-7c23-4d01-85c2-17272845b712 service nova] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1dc9e8a1-5217-458c-ae22-3ab3c3594bc6 req-f80c624f-7c23-4d01-85c2-17272845b712 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1dc9e8a1-5217-458c-ae22-3ab3c3594bc6 req-f80c624f-7c23-4d01-85c2-17272845b712 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG nova.compute.manager [req-1dc9e8a1-5217-458c-ae22-3ab3c3594bc6 req-f80c624f-7c23-4d01-85c2-17272845b712 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] No waiting events found dispatching network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:30 user nova-compute[72849]: WARNING nova.compute.manager [req-1dc9e8a1-5217-458c-ae22-3ab3c3594bc6 req-f80c624f-7c23-4d01-85c2-17272845b712 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received unexpected event network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 for instance with vm_state resized and task_state resize_reverting.
Aug 15 16:22:30 user nova-compute[72849]: DEBUG nova.compute.manager [req-2c0dcd26-ac9d-4805-87a9-542b74e4eb27 req-e699f5b2-c379-46ae-be1f-e118f836c0a5 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received event network-vif-unplugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2c0dcd26-ac9d-4805-87a9-542b74e4eb27 req-e699f5b2-c379-46ae-be1f-e118f836c0a5 service nova] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2c0dcd26-ac9d-4805-87a9-542b74e4eb27 req-e699f5b2-c379-46ae-be1f-e118f836c0a5 service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2c0dcd26-ac9d-4805-87a9-542b74e4eb27 req-e699f5b2-c379-46ae-be1f-e118f836c0a5 service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG nova.compute.manager [req-2c0dcd26-ac9d-4805-87a9-542b74e4eb27 req-e699f5b2-c379-46ae-be1f-e118f836c0a5 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] No waiting events found dispatching network-vif-unplugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:30 user nova-compute[72849]: WARNING nova.compute.manager [req-2c0dcd26-ac9d-4805-87a9-542b74e4eb27 req-e699f5b2-c379-46ae-be1f-e118f836c0a5 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received unexpected event network-vif-unplugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 for instance with vm_state rescued and task_state unrescuing.
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5976ab-9a98-436f-8c18-401330bdb681]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] SCSI volumes sdd have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f928ce-4e9b-4e3c-854e-2a81b35d3d74]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:31 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acfe17a-6be1-4647-a15c-25bdd57d0f67]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:31 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260]
Aug 15 16:22:31 user nova-compute[72849]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260] successful.
Aug 15 16:22:31 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:31 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[61040c38-a915-4d80-a07f-11fe80df7efb]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:31 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:31 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:22:31 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] <== disconnect_volume: return (379ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:22:31 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:22:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:31 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Instance destroyed successfully.
Aug 15 16:22:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-7c115fed-1a94-4f46-b124-e9fe553be36c req-caea7c67-27f1-4937-b42a-19026fe8f18e service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received event network-changed-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-7c115fed-1a94-4f46-b124-e9fe553be36c req-caea7c67-27f1-4937-b42a-19026fe8f18e service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Refreshing instance network info cache due to event network-changed-fc17db49-50e4-4186-af46-e3cbd2dd7677. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:22:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7c115fed-1a94-4f46-b124-e9fe553be36c req-caea7c67-27f1-4937-b42a-19026fe8f18e service nova] Acquiring lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:22:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7c115fed-1a94-4f46-b124-e9fe553be36c req-caea7c67-27f1-4937-b42a-19026fe8f18e service nova] Acquired lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:22:31 user nova-compute[72849]: DEBUG nova.network.neutron [req-7c115fed-1a94-4f46-b124-e9fe553be36c req-caea7c67-27f1-4937-b42a-19026fe8f18e service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Refreshing network info cache for port fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:22:32 user nova-compute[72849]: DEBUG nova.network.neutron [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Successfully updated port: ba545c48-7768-4efb-ac4d-d4221464afaf {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:22:32 user nova-compute[72849]: DEBUG nova.network.neutron [req-7c115fed-1a94-4f46-b124-e9fe553be36c req-caea7c67-27f1-4937-b42a-19026fe8f18e service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Updated VIF entry in instance network info cache for port fc17db49-50e4-4186-af46-e3cbd2dd7677. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:22:32 user nova-compute[72849]: DEBUG nova.network.neutron [req-7c115fed-1a94-4f46-b124-e9fe553be36c req-caea7c67-27f1-4937-b42a-19026fe8f18e service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Updating instance_info_cache with network_info: [{"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7c115fed-1a94-4f46-b124-e9fe553be36c req-caea7c67-27f1-4937-b42a-19026fe8f18e service nova] Releasing lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:22:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:32 user nova-compute[72849]: DEBUG nova.objects.instance [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lazy-loading 'migration_context' on Instance uuid b0a869eb-9ee8-4c31-9786-5b8be7d362a9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-f3cd7bb7-a983-4051-8f7d-feb96b0f93df req-6f18e438-3177-4600-86f7-6cdf5d93d5cb service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received event network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f3cd7bb7-a983-4051-8f7d-feb96b0f93df req-6f18e438-3177-4600-86f7-6cdf5d93d5cb service nova] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f3cd7bb7-a983-4051-8f7d-feb96b0f93df req-6f18e438-3177-4600-86f7-6cdf5d93d5cb service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f3cd7bb7-a983-4051-8f7d-feb96b0f93df req-6f18e438-3177-4600-86f7-6cdf5d93d5cb service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-f3cd7bb7-a983-4051-8f7d-feb96b0f93df req-6f18e438-3177-4600-86f7-6cdf5d93d5cb service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] No waiting events found dispatching network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:33 user nova-compute[72849]: WARNING nova.compute.manager [req-f3cd7bb7-a983-4051-8f7d-feb96b0f93df req-6f18e438-3177-4600-86f7-6cdf5d93d5cb service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received unexpected event network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 for instance with vm_state rescued and task_state unrescuing.
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-f3cd7bb7-a983-4051-8f7d-feb96b0f93df req-6f18e438-3177-4600-86f7-6cdf5d93d5cb service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-changed-ba545c48-7768-4efb-ac4d-d4221464afaf {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-f3cd7bb7-a983-4051-8f7d-feb96b0f93df req-6f18e438-3177-4600-86f7-6cdf5d93d5cb service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Refreshing instance network info cache due to event network-changed-ba545c48-7768-4efb-ac4d-d4221464afaf. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f3cd7bb7-a983-4051-8f7d-feb96b0f93df req-6f18e438-3177-4600-86f7-6cdf5d93d5cb service nova] Acquiring lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f3cd7bb7-a983-4051-8f7d-feb96b0f93df req-6f18e438-3177-4600-86f7-6cdf5d93d5cb service nova] Acquired lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.network.neutron [req-f3cd7bb7-a983-4051-8f7d-feb96b0f93df req-6f18e438-3177-4600-86f7-6cdf5d93d5cb service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Refreshing network info cache for port ba545c48-7768-4efb-ac4d-d4221464afaf {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-e1aad77f-f80e-4909-a0b2-36c7f3874bed req-f11a6e84-3dd8-4466-b229-9744d092c485 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Received event network-vif-plugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e1aad77f-f80e-4909-a0b2-36c7f3874bed req-f11a6e84-3dd8-4466-b229-9744d092c485 service nova] Acquiring lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e1aad77f-f80e-4909-a0b2-36c7f3874bed req-f11a6e84-3dd8-4466-b229-9744d092c485 service nova] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e1aad77f-f80e-4909-a0b2-36c7f3874bed req-f11a6e84-3dd8-4466-b229-9744d092c485 service nova] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-e1aad77f-f80e-4909-a0b2-36c7f3874bed req-f11a6e84-3dd8-4466-b229-9744d092c485 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] No waiting events found dispatching network-vif-plugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:33 user nova-compute[72849]: WARNING nova.compute.manager [req-e1aad77f-f80e-4909-a0b2-36c7f3874bed req-f11a6e84-3dd8-4466-b229-9744d092c485 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Received unexpected event network-vif-plugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb for instance with vm_state active and task_state rescuing.
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-e1aad77f-f80e-4909-a0b2-36c7f3874bed req-f11a6e84-3dd8-4466-b229-9744d092c485 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Received event network-vif-plugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e1aad77f-f80e-4909-a0b2-36c7f3874bed req-f11a6e84-3dd8-4466-b229-9744d092c485 service nova] Acquiring lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e1aad77f-f80e-4909-a0b2-36c7f3874bed req-f11a6e84-3dd8-4466-b229-9744d092c485 service nova] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e1aad77f-f80e-4909-a0b2-36c7f3874bed req-f11a6e84-3dd8-4466-b229-9744d092c485 service nova] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-e1aad77f-f80e-4909-a0b2-36c7f3874bed req-f11a6e84-3dd8-4466-b229-9744d092c485 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] No waiting events found dispatching network-vif-plugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:33 user nova-compute[72849]: WARNING nova.compute.manager [req-e1aad77f-f80e-4909-a0b2-36c7f3874bed req-f11a6e84-3dd8-4466-b229-9744d092c485 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Received unexpected event network-vif-plugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb for instance with vm_state active and task_state rescuing.
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Removed pending event for 46f0aa43-e313-4aff-bacc-aa5290193b00 due to event {{(pid=72849) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116553.1052725, 46f0aa43-e313-4aff-bacc-aa5290193b00 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:22:33 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] VM Resumed (Lifecycle Event)
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.network.neutron [req-f3cd7bb7-a983-4051-8f7d-feb96b0f93df req-6f18e438-3177-4600-86f7-6cdf5d93d5cb service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f5842e59-c3e6-41c5-b614-291179496dcc tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:22:33 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116553.1079583, 46f0aa43-e313-4aff-bacc-aa5290193b00 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:22:33 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] VM Started (Lifecycle Event)
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:22:33 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 16:22:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.758s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.network.neutron [req-f3cd7bb7-a983-4051-8f7d-feb96b0f93df req-6f18e438-3177-4600-86f7-6cdf5d93d5cb service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f3cd7bb7-a983-4051-8f7d-feb96b0f93df req-6f18e438-3177-4600-86f7-6cdf5d93d5cb service nova] Releasing lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:22:33 user nova-compute[72849]: INFO nova.compute.manager [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Swapping old allocation on dict_keys(['2d8a3c24-a12f-4e34-9906-d3707a50726d']) held by migration 5def4dc0-2f71-4b78-ac69-f4756ff41fd3 for instance
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-88bdc48f-8008-442f-b93a-85e63a780f23 req-b468d478-0e40-49fd-be6d-b056d4abad1a service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received event network-changed-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-88bdc48f-8008-442f-b93a-85e63a780f23 req-b468d478-0e40-49fd-be6d-b056d4abad1a service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Refreshing instance network info cache due to event network-changed-fc17db49-50e4-4186-af46-e3cbd2dd7677. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-88bdc48f-8008-442f-b93a-85e63a780f23 req-b468d478-0e40-49fd-be6d-b056d4abad1a service nova] Acquiring lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:22:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-88bdc48f-8008-442f-b93a-85e63a780f23 req-b468d478-0e40-49fd-be6d-b056d4abad1a service nova] Acquired lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:22:34 user nova-compute[72849]: DEBUG nova.network.neutron [req-88bdc48f-8008-442f-b93a-85e63a780f23 req-b468d478-0e40-49fd-be6d-b056d4abad1a service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Refreshing network info cache for port fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:22:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:34 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Overwriting current allocation {'allocations': {'2d8a3c24-a12f-4e34-9906-d3707a50726d': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 24}}, 'project_id': 'b16b734f348e4d9ca7faba1f84f188a8', 'user_id': '90af38c3a2a64683a12871bb2a5e0a0f', 'consumer_generation': 1} on consumer b0a869eb-9ee8-4c31-9786-5b8be7d362a9 {{(pid=72849) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 15 16:22:34 user nova-compute[72849]: DEBUG nova.network.neutron [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Successfully updated port: 2bf7d6a4-fc72-48df-b1af-c208baebcf8a {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:22:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:22:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquired lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:22:34 user nova-compute[72849]: DEBUG nova.network.neutron [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received event network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] No waiting events found dispatching network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:35 user nova-compute[72849]: WARNING nova.compute.manager [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received unexpected event network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 for instance with vm_state rescued and task_state unrescuing.
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-changed-2bf7d6a4-fc72-48df-b1af-c208baebcf8a {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Refreshing instance network info cache due to event network-changed-2bf7d6a4-fc72-48df-b1af-c208baebcf8a. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] Acquiring lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] Acquired lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.network.neutron [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Refreshing network info cache for port 2bf7d6a4-fc72-48df-b1af-c208baebcf8a {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.network.neutron [req-88bdc48f-8008-442f-b93a-85e63a780f23 req-b468d478-0e40-49fd-be6d-b056d4abad1a service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Updated VIF entry in instance network info cache for port fc17db49-50e4-4186-af46-e3cbd2dd7677. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.network.neutron [req-88bdc48f-8008-442f-b93a-85e63a780f23 req-b468d478-0e40-49fd-be6d-b056d4abad1a service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Updating instance_info_cache with network_info: [{"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-88bdc48f-8008-442f-b93a-85e63a780f23 req-b468d478-0e40-49fd-be6d-b056d4abad1a service nova] Releasing lock "refresh_cache-0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.network.neutron [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updating instance_info_cache with network_info: [{"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Releasing lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG os_brick.utils [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7475e14e-febf-41f0-b801-53722a7f41cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:35 user nova-compute[72849]: WARNING nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] While synchronizing instance power states, found 12 instances in the database and 9 instances on the hypervisor.
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 388aa265-fc0a-4928-935e-5e04e65199f6 {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid b0a869eb-9ee8-4c31-9786-5b8be7d362a9 {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 341edacc-b44b-4d92-9fcd-982c252fcdd6 {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 052cde29-421b-4b17-9bcd-acd58456ddba {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid cc521d87-09aa-44ba-a87c-1cd5517b3707 {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 46f0aa43-e313-4aff-bacc-aa5290193b00 {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid a3221960-e5ff-4185-a5dd-09f2cd293cb1 {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 49874ea8-8d01-4de6-a3cc-fc35af67665e {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "388aa265-fc0a-4928-935e-5e04e65199f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "388aa265-fc0a-4928-935e-5e04e65199f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:35 user nova-compute[72849]: INFO nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:35 user nova-compute[72849]: INFO nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "341edacc-b44b-4d92-9fcd-982c252fcdd6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "052cde29-421b-4b17-9bcd-acd58456ddba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "052cde29-421b-4b17-9bcd-acd58456ddba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:35 user nova-compute[72849]: INFO nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "052cde29-421b-4b17-9bcd-acd58456ddba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "cc521d87-09aa-44ba-a87c-1cd5517b3707" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "46f0aa43-e313-4aff-bacc-aa5290193b00" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[19371674-5f33-4236-b9a5-3a6f2e477d13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.network.neutron [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0fd0f5-8041-4189-9bc9-4183695f7475]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b74718-6df3-4b5c-9d3d-9e2476c32909]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "388aa265-fc0a-4928-935e-5e04e65199f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:22:35 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad5b890-b535-481f-9e27-54dab2f73d41]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG os_brick.utils [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] <== get_connector_properties: return (215ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.155s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.160s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.183s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.195s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.network.neutron [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] Releasing lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received event network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] No waiting events found dispatching network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:35 user nova-compute[72849]: WARNING nova.compute.manager [req-dd9aabbc-ca71-47af-884a-95ab37fc2af9 req-e527795e-b2aa-47f1-a23f-2f02ec977698 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received unexpected event network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 for instance with vm_state rescued and task_state unrescuing.
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Removed pending event for 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 due to event {{(pid=72849) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116555.7432775, 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:22:35 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] VM Resumed (Lifecycle Event)
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9e00e163-94f7-42ab-88b7-d2a2a523cf63 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:22:35 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116555.7536447, 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:22:35 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] VM Started (Lifecycle Event)
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:22:35 user nova-compute[72849]: DEBUG nova.network.neutron [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Successfully updated port: 2dd0250b-e417-49b0-b438-c4b8500bf84d {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:22:36 user nova-compute[72849]: DEBUG nova.network.neutron [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Successfully updated port: 2eeb5ba8-9589-4373-afaf-e90135c84256 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:22:37 user nova-compute[72849]: DEBUG nova.compute.manager [req-84115405-aa25-45cf-a251-59edca794998 req-dac21390-03e0-4773-9e65-eeabd2ccc884 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-changed-2dd0250b-e417-49b0-b438-c4b8500bf84d {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:37 user nova-compute[72849]: DEBUG nova.compute.manager [req-84115405-aa25-45cf-a251-59edca794998 req-dac21390-03e0-4773-9e65-eeabd2ccc884 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Refreshing instance network info cache due to event network-changed-2dd0250b-e417-49b0-b438-c4b8500bf84d. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:22:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-84115405-aa25-45cf-a251-59edca794998 req-dac21390-03e0-4773-9e65-eeabd2ccc884 service nova] Acquiring lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:22:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-84115405-aa25-45cf-a251-59edca794998 req-dac21390-03e0-4773-9e65-eeabd2ccc884 service nova] Acquired lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:22:37 user nova-compute[72849]: DEBUG nova.network.neutron [req-84115405-aa25-45cf-a251-59edca794998 req-dac21390-03e0-4773-9e65-eeabd2ccc884 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Refreshing network info cache for port 2dd0250b-e417-49b0-b438-c4b8500bf84d {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:22:37 user nova-compute[72849]: DEBUG nova.network.neutron [req-84115405-aa25-45cf-a251-59edca794998 req-dac21390-03e0-4773-9e65-eeabd2ccc884 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:22:37 user nova-compute[72849]: DEBUG nova.network.neutron [req-84115405-aa25-45cf-a251-59edca794998 req-dac21390-03e0-4773-9e65-eeabd2ccc884 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-84115405-aa25-45cf-a251-59edca794998 req-dac21390-03e0-4773-9e65-eeabd2ccc884 service nova] Releasing lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:22:37 user nova-compute[72849]: DEBUG nova.compute.manager [req-84115405-aa25-45cf-a251-59edca794998 req-dac21390-03e0-4773-9e65-eeabd2ccc884 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-changed-2eeb5ba8-9589-4373-afaf-e90135c84256 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:37 user nova-compute[72849]: DEBUG nova.compute.manager [req-84115405-aa25-45cf-a251-59edca794998 req-dac21390-03e0-4773-9e65-eeabd2ccc884 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Refreshing instance network info cache due to event network-changed-2eeb5ba8-9589-4373-afaf-e90135c84256. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:22:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-84115405-aa25-45cf-a251-59edca794998 req-dac21390-03e0-4773-9e65-eeabd2ccc884 service nova] Acquiring lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:22:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-84115405-aa25-45cf-a251-59edca794998 req-dac21390-03e0-4773-9e65-eeabd2ccc884 service nova] Acquired lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:22:37 user nova-compute[72849]: DEBUG nova.network.neutron [req-84115405-aa25-45cf-a251-59edca794998 req-dac21390-03e0-4773-9e65-eeabd2ccc884 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Refreshing network info cache for port 2eeb5ba8-9589-4373-afaf-e90135c84256 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:22:37 user nova-compute[72849]: DEBUG nova.network.neutron [req-84115405-aa25-45cf-a251-59edca794998 req-dac21390-03e0-4773-9e65-eeabd2ccc884 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:22:37 user nova-compute[72849]: DEBUG nova.network.neutron [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Successfully updated port: 97188a57-9dc6-485a-9362-b44dbe9f2669 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:22:37 user nova-compute[72849]: DEBUG nova.network.neutron [req-84115405-aa25-45cf-a251-59edca794998 req-dac21390-03e0-4773-9e65-eeabd2ccc884 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-84115405-aa25-45cf-a251-59edca794998 req-dac21390-03e0-4773-9e65-eeabd2ccc884 service nova] Releasing lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:22:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:38 user nova-compute[72849]: DEBUG nova.network.neutron [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Successfully updated port: 62c51ab6-ca9a-4c11-bea6-ab58d22e80dc {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:22:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-e645077a-b358-41c9-aea3-af4fbc5cdcb0 req-9fd95117-4849-4b59-b9aa-14898ea3a314 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-changed-97188a57-9dc6-485a-9362-b44dbe9f2669 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-e645077a-b358-41c9-aea3-af4fbc5cdcb0 req-9fd95117-4849-4b59-b9aa-14898ea3a314 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Refreshing instance network info cache due to event network-changed-97188a57-9dc6-485a-9362-b44dbe9f2669. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:22:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e645077a-b358-41c9-aea3-af4fbc5cdcb0 req-9fd95117-4849-4b59-b9aa-14898ea3a314 service nova] Acquiring lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:22:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e645077a-b358-41c9-aea3-af4fbc5cdcb0 req-9fd95117-4849-4b59-b9aa-14898ea3a314 service nova] Acquired lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:22:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-e645077a-b358-41c9-aea3-af4fbc5cdcb0 req-9fd95117-4849-4b59-b9aa-14898ea3a314 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Refreshing network info cache for port 97188a57-9dc6-485a-9362-b44dbe9f2669 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:22:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-e645077a-b358-41c9-aea3-af4fbc5cdcb0 req-9fd95117-4849-4b59-b9aa-14898ea3a314 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:22:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-e645077a-b358-41c9-aea3-af4fbc5cdcb0 req-9fd95117-4849-4b59-b9aa-14898ea3a314 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e645077a-b358-41c9-aea3-af4fbc5cdcb0 req-9fd95117-4849-4b59-b9aa-14898ea3a314 service nova] Releasing lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:22:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-e645077a-b358-41c9-aea3-af4fbc5cdcb0 req-9fd95117-4849-4b59-b9aa-14898ea3a314 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-changed-62c51ab6-ca9a-4c11-bea6-ab58d22e80dc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-e645077a-b358-41c9-aea3-af4fbc5cdcb0 req-9fd95117-4849-4b59-b9aa-14898ea3a314 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Refreshing instance network info cache due to event network-changed-62c51ab6-ca9a-4c11-bea6-ab58d22e80dc. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:22:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e645077a-b358-41c9-aea3-af4fbc5cdcb0 req-9fd95117-4849-4b59-b9aa-14898ea3a314 service nova] Acquiring lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:22:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e645077a-b358-41c9-aea3-af4fbc5cdcb0 req-9fd95117-4849-4b59-b9aa-14898ea3a314 service nova] Acquired lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:22:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-e645077a-b358-41c9-aea3-af4fbc5cdcb0 req-9fd95117-4849-4b59-b9aa-14898ea3a314 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Refreshing network info cache for port 62c51ab6-ca9a-4c11-bea6-ab58d22e80dc {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:22:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-e645077a-b358-41c9-aea3-af4fbc5cdcb0 req-9fd95117-4849-4b59-b9aa-14898ea3a314 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:22:39 user nova-compute[72849]: DEBUG nova.network.neutron [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Successfully updated port: 07063ce8-2e0a-4d84-9dcc-7b09379d313a {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:22:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Acquiring lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:22:40 user nova-compute[72849]: DEBUG nova.network.neutron [req-e645077a-b358-41c9-aea3-af4fbc5cdcb0 req-9fd95117-4849-4b59-b9aa-14898ea3a314 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e645077a-b358-41c9-aea3-af4fbc5cdcb0 req-9fd95117-4849-4b59-b9aa-14898ea3a314 service nova] Releasing lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:22:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Acquired lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:22:40 user nova-compute[72849]: DEBUG nova.network.neutron [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:22:40 user nova-compute[72849]: DEBUG nova.network.neutron [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:22:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:22:41 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Creating image(s)
Aug 15 16:22:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "/opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "/opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "/opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-37596c35-c79c-460b-9e0c-84c6a2c0481e req-dd000938-cecb-42cd-b1e8-85674d7c0a42 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-changed-07063ce8-2e0a-4d84-9dcc-7b09379d313a {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-37596c35-c79c-460b-9e0c-84c6a2c0481e req-dd000938-cecb-42cd-b1e8-85674d7c0a42 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Refreshing instance network info cache due to event network-changed-07063ce8-2e0a-4d84-9dcc-7b09379d313a. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:22:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-37596c35-c79c-460b-9e0c-84c6a2c0481e req-dd000938-cecb-42cd-b1e8-85674d7c0a42 service nova] Acquiring lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:22:41 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116546.431224, 052cde29-421b-4b17-9bcd-acd58456ddba => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:22:41 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] VM Stopped (Lifecycle Event)
Aug 15 16:22:41 user nova-compute[72849]: DEBUG nova.compute.manager [None req-248928d2-e4ac-495d-abc5-53804ae6f181 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.230s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.238s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk 1073741824" returned: 0 in 0.065s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.222s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Cannot resize image /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Ensure instance console log exists: /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Start _get_guest_xml network_info=[{"id": "a9418a97-870c-46fc-97bc-a65348a97f18", "address": "fa:16:3e:20:6f:8a", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9418a97-87", "ovs_interfaceid": "a9418a97-870c-46fc-97bc-a65348a97f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhjeSioA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '052cde29-421b-4b17-9bcd-acd58456ddba', 'attached_at': '', 'detached_at': '', 'volume_id': '760cfa28-9427-4744-8d35-84d61d641d6e', 'serial': '760cfa28-9427-4744-8d35-84d61d641d6e'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '0e126295-96ac-4926-9843-ae3939ea92f8', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:22:42 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 16:22:42 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.objects.instance [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'vcpu_model' on Instance uuid 052cde29-421b-4b17-9bcd-acd58456ddba {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhjeSioA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:22:42 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:22:42 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:22:42 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf96c8a-85b3-483b-ac6f-366e787f2e1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:22:42 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[437cb0c8-d760-4bd0-a6a9-a4ad988a68e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e] added
Aug 15 16:22:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c559c416-8c06-4b55-98b2-7a71f2d3506b]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9152092e-b4d7-47b6-8d46-b2aa5a9f9c04]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PhjeSioA {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PhjeSioA" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacd7392-1af2-4ca6-9850-74dafcd898f5]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PhjeSioA'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cac6788-7f69-4513-83e8-cab92edc765e]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fef1e80-522c-4c18-9233-bbdca366ec9d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:22:42 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:22:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:22:42 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:22:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a3af36-4142-481f-9b4a-96abe5e47a95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e, portal: 172.16.0.220,3260]
Aug 15 16:22:42 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e, portal: 172.16.0.220,3260] successful.
Aug 15 16:22:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97cfd3b-4374-4347-9014-c6d77f778cee]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61c9db7-683d-4398-8252-cd511ea3e9b5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:22:42 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:22:42 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:22:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:22:42 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:22:42 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:22:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15f065b-c383-4c59-9431-707ced9be686]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhjeSioA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:22:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG nova.network.neutron [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updating instance_info_cache with network_info: [{"id": "ba545c48-7768-4efb-ac4d-d4221464afaf", "address": "fa:16:3e:35:31:31", "network": {"id": "921f34cb-0177-4df4-8312-859dbdb9f7e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1824696117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba545c48-77", "ovs_interfaceid": "ba545c48-7768-4efb-ac4d-d4221464afaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "address": "fa:16:3e:68:5d:6b", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7d6a4-fc", "ovs_interfaceid": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "address": "fa:16:3e:cd:c5:53", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd0250b-e4", "ovs_interfaceid": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eeb5ba8-9589-4373-afaf-e90135c84256", "address": "fa:16:3e:0d:73:3f", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb5ba8-95", "ovs_interfaceid": "2eeb5ba8-9589-4373-afaf-e90135c84256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97188a57-9dc6-485a-9362-b44dbe9f2669", "address": "fa:16:3e:42:2f:1e", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97188a57-9d", "ovs_interfaceid": "97188a57-9dc6-485a-9362-b44dbe9f2669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "address": "fa:16:3e:e5:50:d8", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c51ab6-ca", "ovs_interfaceid": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "address": "fa:16:3e:16:8e:16", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07063ce8-2e", "ovs_interfaceid": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Releasing lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG nova.compute.manager [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Instance network_info: |[{"id": "ba545c48-7768-4efb-ac4d-d4221464afaf", "address": "fa:16:3e:35:31:31", "network": {"id": "921f34cb-0177-4df4-8312-859dbdb9f7e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1824696117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba545c48-77", "ovs_interfaceid": "ba545c48-7768-4efb-ac4d-d4221464afaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "address": "fa:16:3e:68:5d:6b", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7d6a4-fc", "ovs_interfaceid": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "address": "fa:16:3e:cd:c5:53", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd0250b-e4", "ovs_interfaceid": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eeb5ba8-9589-4373-afaf-e90135c84256", "address": "fa:16:3e:0d:73:3f", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb5ba8-95", "ovs_interfaceid": "2eeb5ba8-9589-4373-afaf-e90135c84256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97188a57-9dc6-485a-9362-b44dbe9f2669", "address": "fa:16:3e:42:2f:1e", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97188a57-9d", "ovs_interfaceid": "97188a57-9dc6-485a-9362-b44dbe9f2669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "address": "fa:16:3e:e5:50:d8", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c51ab6-ca", "ovs_interfaceid": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "address": "fa:16:3e:16:8e:16", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07063ce8-2e", "ovs_interfaceid": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-37596c35-c79c-460b-9e0c-84c6a2c0481e req-dd000938-cecb-42cd-b1e8-85674d7c0a42 service nova] Acquired lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG nova.network.neutron [req-37596c35-c79c-460b-9e0c-84c6a2c0481e req-dd000938-cecb-42cd-b1e8-85674d7c0a42 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Refreshing network info cache for port 07063ce8-2e0a-4d84-9dcc-7b09379d313a {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23434373631386565', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434373631386565', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG nova.network.neutron [req-37596c35-c79c-460b-9e0c-84c6a2c0481e req-dd000938-cecb-42cd-b1e8-85674d7c0a42 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updated VIF entry in instance network info cache for port 07063ce8-2e0a-4d84-9dcc-7b09379d313a. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG nova.network.neutron [req-37596c35-c79c-460b-9e0c-84c6a2c0481e req-dd000938-cecb-42cd-b1e8-85674d7c0a42 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updating instance_info_cache with network_info: [{"id": "ba545c48-7768-4efb-ac4d-d4221464afaf", "address": "fa:16:3e:35:31:31", "network": {"id": "921f34cb-0177-4df4-8312-859dbdb9f7e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1824696117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba545c48-77", "ovs_interfaceid": "ba545c48-7768-4efb-ac4d-d4221464afaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "address": "fa:16:3e:68:5d:6b", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7d6a4-fc", "ovs_interfaceid": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "address": "fa:16:3e:cd:c5:53", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd0250b-e4", "ovs_interfaceid": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eeb5ba8-9589-4373-afaf-e90135c84256", "address": "fa:16:3e:0d:73:3f", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb5ba8-95", "ovs_interfaceid": "2eeb5ba8-9589-4373-afaf-e90135c84256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97188a57-9dc6-485a-9362-b44dbe9f2669", "address": "fa:16:3e:42:2f:1e", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97188a57-9d", "ovs_interfaceid": "97188a57-9dc6-485a-9362-b44dbe9f2669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "address": "fa:16:3e:e5:50:d8", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c51ab6-ca", "ovs_interfaceid": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "address": "fa:16:3e:16:8e:16", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07063ce8-2e", "ovs_interfaceid": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T16:20:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1165172925',display_name='tempest-ServerActionsTestOtherA-server-2077178336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1165172925',id=15,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWBknFznF3Br/e4erZ96RmBYDGn9QHpqMDloNSpP2DJ4x6ZpnS6SI2xoXmzVDqEscehLRvnBUFKCcKRhuMKezXg92SXubTl6wUnndM1gWudDEMYfZ38YquQQ+VVBgQblw==',key_name='tempest-keypair-1330851775',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='33a3a3412c95451db4dd0edc27f361cc',ramdisk_id='',reservation_id='r-8l740hjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-514064593',owner_user_name='tempest-ServerActionsTestOtherA-514064593-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60cbe30799ad4438b84251a254691b70',uuid=052cde29-421b-4b17-9bcd-acd58456ddba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9418a97-870c-46fc-97bc-a65348a97f18", "address": "fa:16:3e:20:6f:8a", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9418a97-87", "ovs_interfaceid": "a9418a97-870c-46fc-97bc-a65348a97f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converting VIF {"id": "a9418a97-870c-46fc-97bc-a65348a97f18", "address": "fa:16:3e:20:6f:8a", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9418a97-87", "ovs_interfaceid": "a9418a97-870c-46fc-97bc-a65348a97f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:6f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a9418a97-870c-46fc-97bc-a65348a97f18,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9418a97-87') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:22:43 user nova-compute[72849]:   <uuid>052cde29-421b-4b17-9bcd-acd58456ddba</uuid>
Aug 15 16:22:43 user nova-compute[72849]:   <name>instance-0000000f</name>
Aug 15 16:22:43 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:22:43 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:22:43 user nova-compute[72849]:   <metadata>
Aug 15 16:22:43 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:22:43 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:22:43 user nova-compute[72849]:       <nova:name>tempest-ServerActionsTestOtherA-server-2077178336</nova:name>
Aug 15 16:22:43 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:22:42</nova:creationTime>
Aug 15 16:22:43 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:22:43 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:22:43 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:22:43 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:22:43 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:22:43 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:22:43 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:22:43 user nova-compute[72849]:       <nova:owner>
Aug 15 16:22:43 user nova-compute[72849]:         <nova:user uuid="60cbe30799ad4438b84251a254691b70">tempest-ServerActionsTestOtherA-514064593-project-member</nova:user>
Aug 15 16:22:43 user nova-compute[72849]:         <nova:project uuid="33a3a3412c95451db4dd0edc27f361cc">tempest-ServerActionsTestOtherA-514064593</nova:project>
Aug 15 16:22:43 user nova-compute[72849]:       </nova:owner>
Aug 15 16:22:43 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:22:43 user nova-compute[72849]:       <nova:ports>
Aug 15 16:22:43 user nova-compute[72849]:         <nova:port uuid="a9418a97-870c-46fc-97bc-a65348a97f18">
Aug 15 16:22:43 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:22:43 user nova-compute[72849]:         </nova:port>
Aug 15 16:22:43 user nova-compute[72849]:       </nova:ports>
Aug 15 16:22:43 user nova-compute[72849]:     </nova:instance>
Aug 15 16:22:43 user nova-compute[72849]:   </metadata>
Aug 15 16:22:43 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:22:43 user nova-compute[72849]:     <system>
Aug 15 16:22:43 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:22:43 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:22:43 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:22:43 user nova-compute[72849]:       <entry name="serial">052cde29-421b-4b17-9bcd-acd58456ddba</entry>
Aug 15 16:22:43 user nova-compute[72849]:       <entry name="uuid">052cde29-421b-4b17-9bcd-acd58456ddba</entry>
Aug 15 16:22:43 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:22:43 user nova-compute[72849]:     </system>
Aug 15 16:22:43 user nova-compute[72849]:   </sysinfo>
Aug 15 16:22:43 user nova-compute[72849]:   <os>
Aug 15 16:22:43 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:22:43 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:22:43 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:22:43 user nova-compute[72849]:   </os>
Aug 15 16:22:43 user nova-compute[72849]:   <features>
Aug 15 16:22:43 user nova-compute[72849]:     <acpi/>
Aug 15 16:22:43 user nova-compute[72849]:     <apic/>
Aug 15 16:22:43 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:22:43 user nova-compute[72849]:   </features>
Aug 15 16:22:43 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:22:43 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:22:43 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:22:43 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:22:43 user nova-compute[72849]:   </clock>
Aug 15 16:22:43 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:22:43 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:22:43 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:22:43 user nova-compute[72849]:   </cpu>
Aug 15 16:22:43 user nova-compute[72849]:   <devices>
Aug 15 16:22:43 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:22:43 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:22:43 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk"/>
Aug 15 16:22:43 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:22:43 user nova-compute[72849]:     </disk>
Aug 15 16:22:43 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:22:43 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:22:43 user nova-compute[72849]:       <source dev="/dev/sdb"/>
Aug 15 16:22:43 user nova-compute[72849]:       <target dev="vdb" bus="virtio"/>
Aug 15 16:22:43 user nova-compute[72849]:       <serial>760cfa28-9427-4744-8d35-84d61d641d6e</serial>
Aug 15 16:22:43 user nova-compute[72849]:     </disk>
Aug 15 16:22:43 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:22:43 user nova-compute[72849]:       <mac address="fa:16:3e:20:6f:8a"/>
Aug 15 16:22:43 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:22:43 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:22:43 user nova-compute[72849]:       <target dev="tapa9418a97-87"/>
Aug 15 16:22:43 user nova-compute[72849]:     </interface>
Aug 15 16:22:43 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:22:43 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/console.log" append="off"/>
Aug 15 16:22:43 user nova-compute[72849]:     </serial>
Aug 15 16:22:43 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:22:43 user nova-compute[72849]:     <video>
Aug 15 16:22:43 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:22:43 user nova-compute[72849]:     </video>
Aug 15 16:22:43 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:22:43 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:22:43 user nova-compute[72849]:     </rng>
Aug 15 16:22:43 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:22:43 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:22:43 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:22:43 user nova-compute[72849]:     </memballoon>
Aug 15 16:22:43 user nova-compute[72849]:   </devices>
Aug 15 16:22:43 user nova-compute[72849]: </domain>
Aug 15 16:22:43 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T16:20:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1165172925',display_name='tempest-ServerActionsTestOtherA-server-2077178336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1165172925',id=15,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWBknFznF3Br/e4erZ96RmBYDGn9QHpqMDloNSpP2DJ4x6ZpnS6SI2xoXmzVDqEscehLRvnBUFKCcKRhuMKezXg92SXubTl6wUnndM1gWudDEMYfZ38YquQQ+VVBgQblw==',key_name='tempest-keypair-1330851775',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='33a3a3412c95451db4dd0edc27f361cc',ramdisk_id='',reservation_id='r-8l740hjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-514064593',owner_user_name='tempest-ServerActionsTestOtherA-514064593-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60cbe30799ad4438b84251a254691b70',uuid=052cde29-421b-4b17-9bcd-acd58456ddba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9418a97-870c-46fc-97bc-a65348a97f18", "address": "fa:16:3e:20:6f:8a", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9418a97-87", "ovs_interfaceid": "a9418a97-870c-46fc-97bc-a65348a97f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converting VIF {"id": "a9418a97-870c-46fc-97bc-a65348a97f18", "address": "fa:16:3e:20:6f:8a", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9418a97-87", "ovs_interfaceid": "a9418a97-870c-46fc-97bc-a65348a97f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:6f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a9418a97-870c-46fc-97bc-a65348a97f18,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9418a97-87') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG os_vif [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:6f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a9418a97-870c-46fc-97bc-a65348a97f18,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9418a97-87') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-37596c35-c79c-460b-9e0c-84c6a2c0481e req-dd000938-cecb-42cd-b1e8-85674d7c0a42 service nova] Releasing lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9418a97-87, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9418a97-87, col_values=(('external_ids', {'iface-id': 'a9418a97-870c-46fc-97bc-a65348a97f18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:6f:8a', 'vm-uuid': '052cde29-421b-4b17-9bcd-acd58456ddba'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:43 user nova-compute[72849]: INFO os_vif [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:6f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a9418a97-870c-46fc-97bc-a65348a97f18,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9418a97-87')
Aug 15 16:22:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:22:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] No VIF found with MAC fa:16:3e:20:6f:8a, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:22:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:45 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116550.6271799, b0a869eb-9ee8-4c31-9786-5b8be7d362a9 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:22:45 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] VM Stopped (Lifecycle Event)
Aug 15 16:22:45 user nova-compute[72849]: DEBUG nova.compute.manager [None req-59ab62fa-27a2-45c4-9460-197aaabd86fe None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-0a014b67-c7a7-4d1c-aef7-4f4842500c92 req-6e5212cc-c139-42ca-84dd-388ed3410736 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received event network-vif-plugged-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0a014b67-c7a7-4d1c-aef7-4f4842500c92 req-6e5212cc-c139-42ca-84dd-388ed3410736 service nova] Acquiring lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0a014b67-c7a7-4d1c-aef7-4f4842500c92 req-6e5212cc-c139-42ca-84dd-388ed3410736 service nova] Lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0a014b67-c7a7-4d1c-aef7-4f4842500c92 req-6e5212cc-c139-42ca-84dd-388ed3410736 service nova] Lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-0a014b67-c7a7-4d1c-aef7-4f4842500c92 req-6e5212cc-c139-42ca-84dd-388ed3410736 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] No waiting events found dispatching network-vif-plugged-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:45 user nova-compute[72849]: WARNING nova.compute.manager [req-0a014b67-c7a7-4d1c-aef7-4f4842500c92 req-6e5212cc-c139-42ca-84dd-388ed3410736 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received unexpected event network-vif-plugged-a9418a97-870c-46fc-97bc-a65348a97f18 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 16:22:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Starting finish_revert_migration {{(pid=72849) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Start _get_guest_xml network_info=[{"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVdiagcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b0a869eb-9ee8-4c31-9786-5b8be7d362a9', 'attached_at': '2023-08-15T16:22:47.000000', 'detached_at': '', 'volume_id': '4f25b0b3-328d-4f59-9947-1023da21eef5', 'serial': '4f25b0b3-328d-4f59-9947-1023da21eef5'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'c891f6d6-8c59-4c74-8627-047e34369673', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:22:47 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:22:47 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.objects.instance [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lazy-loading 'vcpu_model' on Instance uuid b0a869eb-9ee8-4c31-9786-5b8be7d362a9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVdiagcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:22:47 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:22:47 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:22:47 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa450b8-4250-4f3a-b471-aee9560b737b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:22:47 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed00b7cb-8ce6-4145-9e3b-5c91511b859a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5] added
Aug 15 16:22:47 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[575c1d0c-2ff1-4a24-97ee-b08f8e40e1a6]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd531637-1c10-456d-ba74-508c6a3ffbcf]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVdiagcD {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVdiagcD" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7a1463-c30e-4b05-8eac-5344a953bf00]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zVdiagcD'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd97280-c0ee-4a21-9bd6-1b66a522749e]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab82eac-467d-4f4d-948e-05959177b0a8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:22:47 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:22:47 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:22:47 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:22:47 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:22:47 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:22:47 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5583913-c367-4fd2-bff2-8a78756e96e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260]
Aug 15 16:22:47 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260] successful.
Aug 15 16:22:47 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cf372d-b1ae-4a46-9aca-4596a14de4ce]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[19107b00-1953-4f30-a17f-bbf51225c78f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:22:47 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:22:47 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:22:47 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:22:47 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:22:47 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:22:47 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:22:47 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:22:47 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[022b8f7d-8339-4f1d-bf2f-d6f936cabac7]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVdiagcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:22:47 user nova-compute[72849]: INFO nova.virt.block_device [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Booting with volume c2708688-451b-4230-aab4-87eee35b2e7d at /dev/vdb
Aug 15 16:22:47 user nova-compute[72849]: DEBUG os_brick.utils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116567.8954358, 052cde29-421b-4b17-9bcd-acd58456ddba => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:22:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] VM Resumed (Lifecycle Event)
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[032ee3a5-1dac-41dc-b08f-5f2d1f7b9156]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.compute.manager [req-e1687e2b-8610-4964-be21-09d58996efe0 req-eac60a8c-5dec-413f-bc3b-cd470824897c service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received event network-vif-plugged-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e1687e2b-8610-4964-be21-09d58996efe0 req-eac60a8c-5dec-413f-bc3b-cd470824897c service nova] Acquiring lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e1687e2b-8610-4964-be21-09d58996efe0 req-eac60a8c-5dec-413f-bc3b-cd470824897c service nova] Lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e1687e2b-8610-4964-be21-09d58996efe0 req-eac60a8c-5dec-413f-bc3b-cd470824897c service nova] Lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.compute.manager [req-e1687e2b-8610-4964-be21-09d58996efe0 req-eac60a8c-5dec-413f-bc3b-cd470824897c service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] No waiting events found dispatching network-vif-plugged-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:47 user nova-compute[72849]: WARNING nova.compute.manager [req-e1687e2b-8610-4964-be21-09d58996efe0 req-eac60a8c-5dec-413f-bc3b-cd470824897c service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received unexpected event network-vif-plugged-a9418a97-870c-46fc-97bc-a65348a97f18 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:47 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Instance spawned successfully.
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4405abd1-24b9-4ee0-9595-7a1997c9bef3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0784fc62-46c9-4a69-ba04-280e318b16f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5ce359-e5fa-41c3-b301-c6a887b036cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:22:48 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116567.89639, 052cde29-421b-4b17-9bcd-acd58456ddba => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:22:48 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] VM Started (Lifecycle Event)
Aug 15 16:22:48 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:22:48 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:22:48 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3bcaf9-291f-46c0-93c0-6ebb9458a671]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG os_brick.utils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updating existing volume attachment record: c33cac37-259c-47f9-95f4-2c872985b35d {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:22:48 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.objects.instance [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72849) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-31147c39-48e6-44f9-8e2a-e7909defa920 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.166s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26337383938643864', 'path': '/dev/sdd'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337383938643864', 'path': '/dev/sdd'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1690114442',display_name='tempest-ServerActionsTestOtherB-server-1690114442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1690114442',id=3,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+hh3mOCKtCImu1/lg7z7Mltoc1di1aJCPq0550JQzfICBVP48YFxiWhHNSQqhuSWVzxUKF+hNAtXneGjvrY/qA0OutpYd9sLJegliqP2OTf5sqdDZP815XUZAuWEPAcQ==',key_name='tempest-keypair-493994408',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:21:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b16b734f348e4d9ca7faba1f84f188a8',ramdisk_id='',reservation_id='r-43bap4gi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1970367935',owner_user_name='tempest-ServerActionsTestOtherB-1970367935-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90af38c3a2a64683a12871bb2a5e0a0f',uuid=b0a869eb-9ee8-4c31-9786-5b8be7d362a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Converting VIF {"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:22:48 user nova-compute[72849]:   <uuid>b0a869eb-9ee8-4c31-9786-5b8be7d362a9</uuid>
Aug 15 16:22:48 user nova-compute[72849]:   <name>instance-00000003</name>
Aug 15 16:22:48 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:22:48 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:22:48 user nova-compute[72849]:   <metadata>
Aug 15 16:22:48 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:22:48 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:22:48 user nova-compute[72849]:       <nova:name>tempest-ServerActionsTestOtherB-server-1690114442</nova:name>
Aug 15 16:22:48 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:22:47</nova:creationTime>
Aug 15 16:22:48 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:22:48 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:22:48 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:22:48 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:22:48 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:22:48 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:22:48 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:22:48 user nova-compute[72849]:       <nova:owner>
Aug 15 16:22:48 user nova-compute[72849]:         <nova:user uuid="90af38c3a2a64683a12871bb2a5e0a0f">tempest-ServerActionsTestOtherB-1970367935-project-member</nova:user>
Aug 15 16:22:48 user nova-compute[72849]:         <nova:project uuid="b16b734f348e4d9ca7faba1f84f188a8">tempest-ServerActionsTestOtherB-1970367935</nova:project>
Aug 15 16:22:48 user nova-compute[72849]:       </nova:owner>
Aug 15 16:22:48 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:22:48 user nova-compute[72849]:       <nova:ports>
Aug 15 16:22:48 user nova-compute[72849]:         <nova:port uuid="25a67315-9859-4077-8f36-23635b760770">
Aug 15 16:22:48 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 16:22:48 user nova-compute[72849]:         </nova:port>
Aug 15 16:22:48 user nova-compute[72849]:       </nova:ports>
Aug 15 16:22:48 user nova-compute[72849]:     </nova:instance>
Aug 15 16:22:48 user nova-compute[72849]:   </metadata>
Aug 15 16:22:48 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:22:48 user nova-compute[72849]:     <system>
Aug 15 16:22:48 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:22:48 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:22:48 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:22:48 user nova-compute[72849]:       <entry name="serial">b0a869eb-9ee8-4c31-9786-5b8be7d362a9</entry>
Aug 15 16:22:48 user nova-compute[72849]:       <entry name="uuid">b0a869eb-9ee8-4c31-9786-5b8be7d362a9</entry>
Aug 15 16:22:48 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:22:48 user nova-compute[72849]:     </system>
Aug 15 16:22:48 user nova-compute[72849]:   </sysinfo>
Aug 15 16:22:48 user nova-compute[72849]:   <os>
Aug 15 16:22:48 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:22:48 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:22:48 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:22:48 user nova-compute[72849]:   </os>
Aug 15 16:22:48 user nova-compute[72849]:   <features>
Aug 15 16:22:48 user nova-compute[72849]:     <acpi/>
Aug 15 16:22:48 user nova-compute[72849]:     <apic/>
Aug 15 16:22:48 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:22:48 user nova-compute[72849]:   </features>
Aug 15 16:22:48 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:22:48 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:22:48 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:22:48 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:22:48 user nova-compute[72849]:   </clock>
Aug 15 16:22:48 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:22:48 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:22:48 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:22:48 user nova-compute[72849]:   </cpu>
Aug 15 16:22:48 user nova-compute[72849]:   <devices>
Aug 15 16:22:48 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:22:48 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:22:48 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk"/>
Aug 15 16:22:48 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:22:48 user nova-compute[72849]:     </disk>
Aug 15 16:22:48 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:22:48 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:22:48 user nova-compute[72849]:       <source dev="/dev/sdd"/>
Aug 15 16:22:48 user nova-compute[72849]:       <target dev="vdb" bus="virtio"/>
Aug 15 16:22:48 user nova-compute[72849]:       <serial>4f25b0b3-328d-4f59-9947-1023da21eef5</serial>
Aug 15 16:22:48 user nova-compute[72849]:     </disk>
Aug 15 16:22:48 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:22:48 user nova-compute[72849]:       <mac address="fa:16:3e:32:86:b5"/>
Aug 15 16:22:48 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:22:48 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:22:48 user nova-compute[72849]:       <target dev="tap25a67315-98"/>
Aug 15 16:22:48 user nova-compute[72849]:     </interface>
Aug 15 16:22:48 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:22:48 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/console.log" append="off"/>
Aug 15 16:22:48 user nova-compute[72849]:     </serial>
Aug 15 16:22:48 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:22:48 user nova-compute[72849]:     <video>
Aug 15 16:22:48 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:22:48 user nova-compute[72849]:     </video>
Aug 15 16:22:48 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:22:48 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:22:48 user nova-compute[72849]:     </rng>
Aug 15 16:22:48 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:22:48 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:22:48 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:22:48 user nova-compute[72849]:     </memballoon>
Aug 15 16:22:48 user nova-compute[72849]:   </devices>
Aug 15 16:22:48 user nova-compute[72849]: </domain>
Aug 15 16:22:48 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1690114442',display_name='tempest-ServerActionsTestOtherB-server-1690114442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1690114442',id=3,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+hh3mOCKtCImu1/lg7z7Mltoc1di1aJCPq0550JQzfICBVP48YFxiWhHNSQqhuSWVzxUKF+hNAtXneGjvrY/qA0OutpYd9sLJegliqP2OTf5sqdDZP815XUZAuWEPAcQ==',key_name='tempest-keypair-493994408',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:21:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b16b734f348e4d9ca7faba1f84f188a8',ramdisk_id='',reservation_id='r-43bap4gi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1970367935',owner_user_name='tempest-ServerActionsTestOtherB-1970367935-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90af38c3a2a64683a12871bb2a5e0a0f',uuid=b0a869eb-9ee8-4c31-9786-5b8be7d362a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Converting VIF {"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG os_vif [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25a67315-98, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25a67315-98, col_values=(('external_ids', {'iface-id': '25a67315-9859-4077-8f36-23635b760770', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:86:b5', 'vm-uuid': 'b0a869eb-9ee8-4c31-9786-5b8be7d362a9'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:22:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:48 user nova-compute[72849]: INFO os_vif [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98')
Aug 15 16:22:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:50 user nova-compute[72849]: DEBUG nova.compute.manager [req-0af403e2-fd3c-4cd3-b1eb-94c684cf402e req-b42450c0-aafe-4d4e-9a80-87240dc3bd52 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received event network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0af403e2-fd3c-4cd3-b1eb-94c684cf402e req-b42450c0-aafe-4d4e-9a80-87240dc3bd52 service nova] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0af403e2-fd3c-4cd3-b1eb-94c684cf402e req-b42450c0-aafe-4d4e-9a80-87240dc3bd52 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0af403e2-fd3c-4cd3-b1eb-94c684cf402e req-b42450c0-aafe-4d4e-9a80-87240dc3bd52 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:50 user nova-compute[72849]: DEBUG nova.compute.manager [req-0af403e2-fd3c-4cd3-b1eb-94c684cf402e req-b42450c0-aafe-4d4e-9a80-87240dc3bd52 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] No waiting events found dispatching network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:50 user nova-compute[72849]: WARNING nova.compute.manager [req-0af403e2-fd3c-4cd3-b1eb-94c684cf402e req-b42450c0-aafe-4d4e-9a80-87240dc3bd52 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received unexpected event network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 for instance with vm_state resized and task_state resize_reverting.
Aug 15 16:22:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-54d567e2-0dc6-4e8e-86d2-838830861b7e req-d35658a5-2253-4ccd-866e-301ac71adbf9 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received event network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-54d567e2-0dc6-4e8e-86d2-838830861b7e req-d35658a5-2253-4ccd-866e-301ac71adbf9 service nova] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-54d567e2-0dc6-4e8e-86d2-838830861b7e req-d35658a5-2253-4ccd-866e-301ac71adbf9 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-54d567e2-0dc6-4e8e-86d2-838830861b7e req-d35658a5-2253-4ccd-866e-301ac71adbf9 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-54d567e2-0dc6-4e8e-86d2-838830861b7e req-d35658a5-2253-4ccd-866e-301ac71adbf9 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] No waiting events found dispatching network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:52 user nova-compute[72849]: WARNING nova.compute.manager [req-54d567e2-0dc6-4e8e-86d2-838830861b7e req-d35658a5-2253-4ccd-866e-301ac71adbf9 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received unexpected event network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 for instance with vm_state resized and task_state resize_reverting.
Aug 15 16:22:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:53 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116573.132675, b0a869eb-9ee8-4c31-9786-5b8be7d362a9 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:22:53 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] VM Resumed (Lifecycle Event)
Aug 15 16:22:53 user nova-compute[72849]: DEBUG nova.compute.manager [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:22:53 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Instance running successfully.
Aug 15 16:22:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] finish_revert_migration finished successfully. {{(pid=72849) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 15 16:22:53 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:53 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:22:53 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 16:22:53 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116573.1347663, b0a869eb-9ee8-4c31-9786-5b8be7d362a9 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:22:53 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] VM Started (Lifecycle Event)
Aug 15 16:22:53 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:22:53 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:22:53 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 16:22:53 user nova-compute[72849]: INFO nova.compute.manager [None req-31d25a99-6db3-4fa0-ae78-937a563e942b tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updating instance to original state: 'active'
Aug 15 16:22:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "341edacc-b44b-4d92-9fcd-982c252fcdd6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "341edacc-b44b-4d92-9fcd-982c252fcdd6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:54 user nova-compute[72849]: INFO nova.compute.manager [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Terminating instance
Aug 15 16:22:54 user nova-compute[72849]: DEBUG nova.compute.manager [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:22:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-a885a864-b287-4183-aedc-6c4efb2063ab req-47002202-fcb4-4fb5-9aa7-2fc2a77ebb9c service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Received event network-vif-unplugged-c605963e-3827-4ad6-ab40-665c92c252b1 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a885a864-b287-4183-aedc-6c4efb2063ab req-47002202-fcb4-4fb5-9aa7-2fc2a77ebb9c service nova] Acquiring lock "341edacc-b44b-4d92-9fcd-982c252fcdd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a885a864-b287-4183-aedc-6c4efb2063ab req-47002202-fcb4-4fb5-9aa7-2fc2a77ebb9c service nova] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a885a864-b287-4183-aedc-6c4efb2063ab req-47002202-fcb4-4fb5-9aa7-2fc2a77ebb9c service nova] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-a885a864-b287-4183-aedc-6c4efb2063ab req-47002202-fcb4-4fb5-9aa7-2fc2a77ebb9c service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] No waiting events found dispatching network-vif-unplugged-c605963e-3827-4ad6-ab40-665c92c252b1 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-a885a864-b287-4183-aedc-6c4efb2063ab req-47002202-fcb4-4fb5-9aa7-2fc2a77ebb9c service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Received event network-vif-unplugged-c605963e-3827-4ad6-ab40-665c92c252b1 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:22:55 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Instance destroyed successfully.
Aug 15 16:22:55 user nova-compute[72849]: DEBUG nova.objects.instance [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lazy-loading 'resources' on Instance uuid 341edacc-b44b-4d92-9fcd-982c252fcdd6 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:22:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2019744280',display_name='tempest-VolumesAdminNegativeTest-server-2019744280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2019744280',id=5,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIh4ux07h/0R5+g46sQRbNMw3iBqjprs8fZH70Eoqy8r9mMfiYTpH1vobXzu1H2NUG93m9fnNq6a9nTKLOqhb0pfk2n8b3WxEfv5J/WXt8sezZRjPg2dFQxoFQg8TaTGeQ==',key_name='tempest-keypair-992049436',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:17:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='279e48c00f91440082b8bfe112af9091',ramdisk_id='',reservation_id='r-jngi2uvb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-879284905',owner_user_name='tempest-VolumesAdminNegativeTest-879284905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:17:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8365a9dd961144a2b2cb303bb7854a45',uuid=341edacc-b44b-4d92-9fcd-982c252fcdd6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c605963e-3827-4ad6-ab40-665c92c252b1", "address": "fa:16:3e:0a:d9:a5", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605963e-38", "ovs_interfaceid": "c605963e-3827-4ad6-ab40-665c92c252b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:22:55 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Converting VIF {"id": "c605963e-3827-4ad6-ab40-665c92c252b1", "address": "fa:16:3e:0a:d9:a5", "network": {"id": "181b9566-bc94-42e7-b80e-1b78111cce19", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1393259565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "279e48c00f91440082b8bfe112af9091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605963e-38", "ovs_interfaceid": "c605963e-3827-4ad6-ab40-665c92c252b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:22:55 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:d9:a5,bridge_name='br-int',has_traffic_filtering=True,id=c605963e-3827-4ad6-ab40-665c92c252b1,network=Network(181b9566-bc94-42e7-b80e-1b78111cce19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605963e-38') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:22:55 user nova-compute[72849]: DEBUG os_vif [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:d9:a5,bridge_name='br-int',has_traffic_filtering=True,id=c605963e-3827-4ad6-ab40-665c92c252b1,network=Network(181b9566-bc94-42e7-b80e-1b78111cce19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605963e-38') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:22:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc605963e-38, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:22:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:22:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:22:55 user nova-compute[72849]: INFO os_vif [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:d9:a5,bridge_name='br-int',has_traffic_filtering=True,id=c605963e-3827-4ad6-ab40-665c92c252b1,network=Network(181b9566-bc94-42e7-b80e-1b78111cce19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605963e-38')
Aug 15 16:22:55 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Deleting instance files /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6_del
Aug 15 16:22:55 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Deletion of /opt/stack/data/nova/instances/341edacc-b44b-4d92-9fcd-982c252fcdd6_del complete
Aug 15 16:22:55 user nova-compute[72849]: INFO nova.compute.manager [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 15 16:22:55 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:22:55 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:22:55 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:22:56 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:56 user nova-compute[72849]: DEBUG nova.compute.manager [req-42b948de-b67b-4ca4-806a-60a48d24edf4 req-ef8621e0-db8b-4d14-bd43-a0d09c0c4d6f service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Received event network-vif-deleted-c605963e-3827-4ad6-ab40-665c92c252b1 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:56 user nova-compute[72849]: INFO nova.compute.manager [req-42b948de-b67b-4ca4-806a-60a48d24edf4 req-ef8621e0-db8b-4d14-bd43-a0d09c0c4d6f service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Neutron deleted interface c605963e-3827-4ad6-ab40-665c92c252b1; detaching it from the instance and deleting it from the info cache
Aug 15 16:22:56 user nova-compute[72849]: DEBUG nova.network.neutron [req-42b948de-b67b-4ca4-806a-60a48d24edf4 req-ef8621e0-db8b-4d14-bd43-a0d09c0c4d6f service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:22:56 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Took 1.15 seconds to deallocate network for instance.
Aug 15 16:22:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-42b948de-b67b-4ca4-806a-60a48d24edf4 req-ef8621e0-db8b-4d14-bd43-a0d09c0c4d6f service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Detach interface failed, port_id=c605963e-3827-4ad6-ab40-665c92c252b1, reason: Instance 341edacc-b44b-4d92-9fcd-982c252fcdd6 could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:22:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-bd32cb3c-04ee-473d-b7de-c27577c5d55f req-31f7363b-455b-410c-bfc3-1cef18bdb813 service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Received event network-vif-plugged-c605963e-3827-4ad6-ab40-665c92c252b1 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:22:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-bd32cb3c-04ee-473d-b7de-c27577c5d55f req-31f7363b-455b-410c-bfc3-1cef18bdb813 service nova] Acquiring lock "341edacc-b44b-4d92-9fcd-982c252fcdd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:22:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-bd32cb3c-04ee-473d-b7de-c27577c5d55f req-31f7363b-455b-410c-bfc3-1cef18bdb813 service nova] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:22:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-bd32cb3c-04ee-473d-b7de-c27577c5d55f req-31f7363b-455b-410c-bfc3-1cef18bdb813 service nova] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-bd32cb3c-04ee-473d-b7de-c27577c5d55f req-31f7363b-455b-410c-bfc3-1cef18bdb813 service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] No waiting events found dispatching network-vif-plugged-c605963e-3827-4ad6-ab40-665c92c252b1 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:22:57 user nova-compute[72849]: WARNING nova.compute.manager [req-bd32cb3c-04ee-473d-b7de-c27577c5d55f req-31f7363b-455b-410c-bfc3-1cef18bdb813 service nova] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Received unexpected event network-vif-plugged-c605963e-3827-4ad6-ab40-665c92c252b1 for instance with vm_state deleted and task_state None.
Aug 15 16:22:57 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:22:57 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:22:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.645s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:57 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Deleted allocations for instance 341edacc-b44b-4d92-9fcd-982c252fcdd6
Aug 15 16:22:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-38d6e090-7409-446c-8303-ec6c241ea385 tempest-VolumesAdminNegativeTest-879284905 tempest-VolumesAdminNegativeTest-879284905-project-member] Lock "341edacc-b44b-4d92-9fcd-982c252fcdd6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.065s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:22:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:06 user nova-compute[72849]: INFO nova.compute.manager [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Detaching volume c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4
Aug 15 16:23:06 user nova-compute[72849]: INFO nova.virt.block_device [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Attempting to driver detach volume c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 from mountpoint /dev/vdb
Aug 15 16:23:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Attempting to detach device vdb from instance 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:23:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:23:06 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:23:06 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:23:06 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:23:06 user nova-compute[72849]:   <serial>c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4</serial>
Aug 15 16:23:06 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:23:06 user nova-compute[72849]: </disk>
Aug 15 16:23:06 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:23:06 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Successfully detached device vdb from instance 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 from the persistent domain config.
Aug 15 16:23:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:23:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:23:06 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:23:06 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:23:06 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:23:06 user nova-compute[72849]:   <serial>c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4</serial>
Aug 15 16:23:06 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:23:06 user nova-compute[72849]: </disk>
Aug 15 16:23:06 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:23:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692116586.9397223, 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:23:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:23:06 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Successfully detached device vdb from instance 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 from the live domain config.
Aug 15 16:23:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:23:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhqNZgHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:23:06 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:23:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:23:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:23:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:23:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[de072edc-0e79-4c2e-bdfd-08039ded8004]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e1719c-0e77-41c8-8447-611bd58aea64]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:23:07 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:23:07 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:23:07 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:23:07 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:23:07 user nova-compute[72849]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 (non-flash)
Aug 15 16:23:07 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:23:07 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:23:07 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc358105ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4'): ({'sdc'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Removing single pathed devices sdc {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a027a6-2d51-419a-b3d3-dea4a8eda76a]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebb971b-4e32-4049-b8c5-3cefafe01a0d]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Flushing IO for device /dev/sdc {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[55436ed0-7ea0-460f-8e3f-da0bc69011ca]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[198b45e3-79d5-444b-a05b-0af740f050cb]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[93616522-2140-4ac1-8750-28d39b719c53]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba045fa1-c896-4215-8662-5dbbde0abd26]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4, portal: 172.16.0.220,3260]
Aug 15 16:23:07 user nova-compute[72849]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4, portal: 172.16.0.220,3260] successful.
Aug 15 16:23:07 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d17af5-0bfc-4d74-bcc3-d6eee0999bf4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f1e439-68eb-4efc-9a13-67080d39d8b1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] <== disconnect_volume: return (352ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:23:07 user nova-compute[72849]: INFO nova.virt.block_device [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Booting with volume 82364061-e57a-498f-be94-6b55efdfdc78 at /dev/vdc
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.utils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38b78a6-84c6-47cb-81fe-25c70fb4a0ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9117dc9c-9970-4dfe-b82e-ae5fdea0cb21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb44befa-7d58-4fdf-8168-2673445d74e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cb34b8-ffcb-4246-becc-6cc06dd24910]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:23:07 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:23:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf55b5a-8799-41cd-a9eb-661ca57ded44]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG os_brick.utils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updating existing volume attachment record: d991fd98-0ade-4fe8-b903-62eae2440ea8 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:23:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:08 user nova-compute[72849]: DEBUG nova.objects.instance [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lazy-loading 'flavor' on Instance uuid 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:23:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6c6b15d9-d232-40bb-aef7-a9c934cd6104 tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.083s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:08 user nova-compute[72849]: INFO nova.compute.manager [None req-cefb7b7c-0bc7-4f3b-b480-5391b38b4775 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Unrescuing
Aug 15 16:23:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefb7b7c-0bc7-4f3b-b480-5391b38b4775 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "refresh_cache-84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:23:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefb7b7c-0bc7-4f3b-b480-5391b38b4775 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquired lock "refresh_cache-84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:23:08 user nova-compute[72849]: DEBUG nova.network.neutron [None req-cefb7b7c-0bc7-4f3b-b480-5391b38b4775 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:23:09 user nova-compute[72849]: DEBUG nova.network.neutron [None req-cefb7b7c-0bc7-4f3b-b480-5391b38b4775 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Updating instance_info_cache with network_info: [{"id": "993c798d-2a87-4ee5-80ea-484b8848ca54", "address": "fa:16:3e:e2:8e:fc", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993c798d-2a", "ovs_interfaceid": "993c798d-2a87-4ee5-80ea-484b8848ca54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:23:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefb7b7c-0bc7-4f3b-b480-5391b38b4775 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Releasing lock "refresh_cache-84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:23:09 user nova-compute[72849]: DEBUG nova.objects.instance [None req-cefb7b7c-0bc7-4f3b-b480-5391b38b4775 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'flavor' on Instance uuid 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:23:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-9a965f17-276d-4d31-aeb2-5acb5156e839 req-7e31cbbc-ad8d-4972-9b8a-0a48b8d0bf8c service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-vif-unplugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9a965f17-276d-4d31-aeb2-5acb5156e839 req-7e31cbbc-ad8d-4972-9b8a-0a48b8d0bf8c service nova] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9a965f17-276d-4d31-aeb2-5acb5156e839 req-7e31cbbc-ad8d-4972-9b8a-0a48b8d0bf8c service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9a965f17-276d-4d31-aeb2-5acb5156e839 req-7e31cbbc-ad8d-4972-9b8a-0a48b8d0bf8c service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-9a965f17-276d-4d31-aeb2-5acb5156e839 req-7e31cbbc-ad8d-4972-9b8a-0a48b8d0bf8c service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] No waiting events found dispatching network-vif-unplugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:09 user nova-compute[72849]: WARNING nova.compute.manager [req-9a965f17-276d-4d31-aeb2-5acb5156e839 req-7e31cbbc-ad8d-4972-9b8a-0a48b8d0bf8c service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received unexpected event network-vif-unplugged-993c798d-2a87-4ee5-80ea-484b8848ca54 for instance with vm_state rescued and task_state unrescuing.
Aug 15 16:23:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:10 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Instance destroyed successfully.
Aug 15 16:23:10 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116575.629897, 341edacc-b44b-4d92-9fcd-982c252fcdd6 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:23:10 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] VM Stopped (Lifecycle Event)
Aug 15 16:23:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5186b0fe-d91b-44bb-941c-630451fd799a None None] [instance: 341edacc-b44b-4d92-9fcd-982c252fcdd6] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:23:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-341af5fb-c8d8-46d2-bcee-6411b735e949 req-69b7463d-3a7f-4086-bc02-00e65942e28e service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-341af5fb-c8d8-46d2-bcee-6411b735e949 req-69b7463d-3a7f-4086-bc02-00e65942e28e service nova] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-341af5fb-c8d8-46d2-bcee-6411b735e949 req-69b7463d-3a7f-4086-bc02-00e65942e28e service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-341af5fb-c8d8-46d2-bcee-6411b735e949 req-69b7463d-3a7f-4086-bc02-00e65942e28e service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-341af5fb-c8d8-46d2-bcee-6411b735e949 req-69b7463d-3a7f-4086-bc02-00e65942e28e service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] No waiting events found dispatching network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:11 user nova-compute[72849]: WARNING nova.compute.manager [req-341af5fb-c8d8-46d2-bcee-6411b735e949 req-69b7463d-3a7f-4086-bc02-00e65942e28e service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received unexpected event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 for instance with vm_state rescued and task_state unrescuing.
Aug 15 16:23:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-01c62d1a-e49c-4b59-90d8-5a99650dbaf9 req-b39bb515-7a44-4c4b-b4c3-2c236119fbfd service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-01c62d1a-e49c-4b59-90d8-5a99650dbaf9 req-b39bb515-7a44-4c4b-b4c3-2c236119fbfd service nova] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-01c62d1a-e49c-4b59-90d8-5a99650dbaf9 req-b39bb515-7a44-4c4b-b4c3-2c236119fbfd service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-01c62d1a-e49c-4b59-90d8-5a99650dbaf9 req-b39bb515-7a44-4c4b-b4c3-2c236119fbfd service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-01c62d1a-e49c-4b59-90d8-5a99650dbaf9 req-b39bb515-7a44-4c4b-b4c3-2c236119fbfd service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] No waiting events found dispatching network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:13 user nova-compute[72849]: WARNING nova.compute.manager [req-01c62d1a-e49c-4b59-90d8-5a99650dbaf9 req-b39bb515-7a44-4c4b-b4c3-2c236119fbfd service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received unexpected event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 for instance with vm_state rescued and task_state unrescuing.
Aug 15 16:23:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-01c62d1a-e49c-4b59-90d8-5a99650dbaf9 req-b39bb515-7a44-4c4b-b4c3-2c236119fbfd service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-01c62d1a-e49c-4b59-90d8-5a99650dbaf9 req-b39bb515-7a44-4c4b-b4c3-2c236119fbfd service nova] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-01c62d1a-e49c-4b59-90d8-5a99650dbaf9 req-b39bb515-7a44-4c4b-b4c3-2c236119fbfd service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-01c62d1a-e49c-4b59-90d8-5a99650dbaf9 req-b39bb515-7a44-4c4b-b4c3-2c236119fbfd service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-01c62d1a-e49c-4b59-90d8-5a99650dbaf9 req-b39bb515-7a44-4c4b-b4c3-2c236119fbfd service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] No waiting events found dispatching network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:13 user nova-compute[72849]: WARNING nova.compute.manager [req-01c62d1a-e49c-4b59-90d8-5a99650dbaf9 req-b39bb515-7a44-4c4b-b4c3-2c236119fbfd service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received unexpected event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 for instance with vm_state rescued and task_state unrescuing.
Aug 15 16:23:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Removed pending event for 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab due to event {{(pid=72849) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 16:23:14 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116594.3002944, 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:23:14 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] VM Resumed (Lifecycle Event)
Aug 15 16:23:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-cefb7b7c-0bc7-4f3b-b480-5391b38b4775 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:23:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:23:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:23:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "25db7eb1-fa77-4342-922c-4f82f8f27702" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:14 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 16:23:14 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116594.3021848, 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:23:14 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] VM Started (Lifecycle Event)
Aug 15 16:23:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:23:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:23:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:23:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:14 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:23:14 user nova-compute[72849]: INFO nova.compute.claims [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Claim successful on node user
Aug 15 16:23:15 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:23:15 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:23:15 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:23:15 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Creating image(s)
Aug 15 16:23:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "/opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "/opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "/opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG nova.policy [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2471145e3ea84645bcfa51f4fcf4cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065226f254df40baaf230ccd5f13f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.203s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.187s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk 1073741824" returned: 0 in 0.060s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.207s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:16 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:23:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:16 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Successfully created port: bb502cd2-eea4-4ce2-8cd2-98fd80832595 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:23:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:16 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Cannot resize image /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:23:16 user nova-compute[72849]: DEBUG nova.objects.instance [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lazy-loading 'migration_context' on Instance uuid 25db7eb1-fa77-4342-922c-4f82f8f27702 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:23:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:23:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Ensure instance console log exists: /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:23:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Successfully updated port: bb502cd2-eea4-4ce2-8cd2-98fd80832595 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "refresh_cache-25db7eb1-fa77-4342-922c-4f82f8f27702" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquired lock "refresh_cache-25db7eb1-fa77-4342-922c-4f82f8f27702" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-203259c4-261d-4f9b-9f3d-2454a129826f req-ad446765-ef66-4ef5-b057-e2169e5ff782 service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Received event network-changed-bb502cd2-eea4-4ce2-8cd2-98fd80832595 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-203259c4-261d-4f9b-9f3d-2454a129826f req-ad446765-ef66-4ef5-b057-e2169e5ff782 service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Refreshing instance network info cache due to event network-changed-bb502cd2-eea4-4ce2-8cd2-98fd80832595. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-203259c4-261d-4f9b-9f3d-2454a129826f req-ad446765-ef66-4ef5-b057-e2169e5ff782 service nova] Acquiring lock "refresh_cache-25db7eb1-fa77-4342-922c-4f82f8f27702" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Updating instance_info_cache with network_info: [{"id": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "address": "fa:16:3e:85:7c:de", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb502cd2-ee", "ovs_interfaceid": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Releasing lock "refresh_cache-25db7eb1-fa77-4342-922c-4f82f8f27702" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Instance network_info: |[{"id": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "address": "fa:16:3e:85:7c:de", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb502cd2-ee", "ovs_interfaceid": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-203259c4-261d-4f9b-9f3d-2454a129826f req-ad446765-ef66-4ef5-b057-e2169e5ff782 service nova] Acquired lock "refresh_cache-25db7eb1-fa77-4342-922c-4f82f8f27702" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.network.neutron [req-203259c4-261d-4f9b-9f3d-2454a129826f req-ad446765-ef66-4ef5-b057-e2169e5ff782 service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Refreshing network info cache for port bb502cd2-eea4-4ce2-8cd2-98fd80832595 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Start _get_guest_xml network_info=[{"id": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "address": "fa:16:3e:85:7c:de", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb502cd2-ee", "ovs_interfaceid": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:23:17 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:23:17 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:23:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-358556613',display_name='tempest-VolumesSnapshotTestJSON-instance-358556613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-358556613',id=21,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGv5s9QZs5pS5hVziUQTZuawXqnwvd8zWxFI0r907PaXvIDlOGdEX50IMebvlb6CiaEctT2UmLitjVxNDSnPjrh70a0vrIpQhINU7Ty3grTCenfExKvDB+DRtfET41CWXQ==',key_name='tempest-keypair-1205732152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='065226f254df40baaf230ccd5f13f62a',ramdisk_id='',reservation_id='r-j9npdjww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1243118890',owner_user_name='tempest-VolumesSnapshotTestJSON-1243118890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:23:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2471145e3ea84645bcfa51f4fcf4cbbc',uuid=25db7eb1-fa77-4342-922c-4f82f8f27702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "address": "fa:16:3e:85:7c:de", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb502cd2-ee", "ovs_interfaceid": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Converting VIF {"id": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "address": "fa:16:3e:85:7c:de", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb502cd2-ee", "ovs_interfaceid": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:7c:de,bridge_name='br-int',has_traffic_filtering=True,id=bb502cd2-eea4-4ce2-8cd2-98fd80832595,network=Network(ea172a57-fdfb-45f3-b3df-e6f4751eb20b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb502cd2-ee') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.objects.instance [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lazy-loading 'pci_devices' on Instance uuid 25db7eb1-fa77-4342-922c-4f82f8f27702 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:23:17 user nova-compute[72849]:   <uuid>25db7eb1-fa77-4342-922c-4f82f8f27702</uuid>
Aug 15 16:23:17 user nova-compute[72849]:   <name>instance-00000015</name>
Aug 15 16:23:17 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:23:17 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:23:17 user nova-compute[72849]:   <metadata>
Aug 15 16:23:17 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:23:17 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:23:17 user nova-compute[72849]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-358556613</nova:name>
Aug 15 16:23:17 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:23:17</nova:creationTime>
Aug 15 16:23:17 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:23:17 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:23:17 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:23:17 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:23:17 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:23:17 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:23:17 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:23:17 user nova-compute[72849]:       <nova:owner>
Aug 15 16:23:17 user nova-compute[72849]:         <nova:user uuid="2471145e3ea84645bcfa51f4fcf4cbbc">tempest-VolumesSnapshotTestJSON-1243118890-project-member</nova:user>
Aug 15 16:23:17 user nova-compute[72849]:         <nova:project uuid="065226f254df40baaf230ccd5f13f62a">tempest-VolumesSnapshotTestJSON-1243118890</nova:project>
Aug 15 16:23:17 user nova-compute[72849]:       </nova:owner>
Aug 15 16:23:17 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:23:17 user nova-compute[72849]:       <nova:ports>
Aug 15 16:23:17 user nova-compute[72849]:         <nova:port uuid="bb502cd2-eea4-4ce2-8cd2-98fd80832595">
Aug 15 16:23:17 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 16:23:17 user nova-compute[72849]:         </nova:port>
Aug 15 16:23:17 user nova-compute[72849]:       </nova:ports>
Aug 15 16:23:17 user nova-compute[72849]:     </nova:instance>
Aug 15 16:23:17 user nova-compute[72849]:   </metadata>
Aug 15 16:23:17 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:23:17 user nova-compute[72849]:     <system>
Aug 15 16:23:17 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:23:17 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:23:17 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:23:17 user nova-compute[72849]:       <entry name="serial">25db7eb1-fa77-4342-922c-4f82f8f27702</entry>
Aug 15 16:23:17 user nova-compute[72849]:       <entry name="uuid">25db7eb1-fa77-4342-922c-4f82f8f27702</entry>
Aug 15 16:23:17 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:23:17 user nova-compute[72849]:     </system>
Aug 15 16:23:17 user nova-compute[72849]:   </sysinfo>
Aug 15 16:23:17 user nova-compute[72849]:   <os>
Aug 15 16:23:17 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:23:17 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:23:17 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:23:17 user nova-compute[72849]:   </os>
Aug 15 16:23:17 user nova-compute[72849]:   <features>
Aug 15 16:23:17 user nova-compute[72849]:     <acpi/>
Aug 15 16:23:17 user nova-compute[72849]:     <apic/>
Aug 15 16:23:17 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:23:17 user nova-compute[72849]:   </features>
Aug 15 16:23:17 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:23:17 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:23:17 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:23:17 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:23:17 user nova-compute[72849]:   </clock>
Aug 15 16:23:17 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:23:17 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:23:17 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:23:17 user nova-compute[72849]:   </cpu>
Aug 15 16:23:17 user nova-compute[72849]:   <devices>
Aug 15 16:23:17 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:23:17 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:23:17 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk"/>
Aug 15 16:23:17 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:23:17 user nova-compute[72849]:     </disk>
Aug 15 16:23:17 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:23:17 user nova-compute[72849]:       <mac address="fa:16:3e:85:7c:de"/>
Aug 15 16:23:17 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:23:17 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:23:17 user nova-compute[72849]:       <target dev="tapbb502cd2-ee"/>
Aug 15 16:23:17 user nova-compute[72849]:     </interface>
Aug 15 16:23:17 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:23:17 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/console.log" append="off"/>
Aug 15 16:23:17 user nova-compute[72849]:     </serial>
Aug 15 16:23:17 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:23:17 user nova-compute[72849]:     <video>
Aug 15 16:23:17 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:23:17 user nova-compute[72849]:     </video>
Aug 15 16:23:17 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:23:17 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:23:17 user nova-compute[72849]:     </rng>
Aug 15 16:23:17 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:23:17 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:23:17 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:23:17 user nova-compute[72849]:     </memballoon>
Aug 15 16:23:17 user nova-compute[72849]:   </devices>
Aug 15 16:23:17 user nova-compute[72849]: </domain>
Aug 15 16:23:17 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:23:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-358556613',display_name='tempest-VolumesSnapshotTestJSON-instance-358556613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-358556613',id=21,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGv5s9QZs5pS5hVziUQTZuawXqnwvd8zWxFI0r907PaXvIDlOGdEX50IMebvlb6CiaEctT2UmLitjVxNDSnPjrh70a0vrIpQhINU7Ty3grTCenfExKvDB+DRtfET41CWXQ==',key_name='tempest-keypair-1205732152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='065226f254df40baaf230ccd5f13f62a',ramdisk_id='',reservation_id='r-j9npdjww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1243118890',owner_user_name='tempest-VolumesSnapshotTestJSON-1243118890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:23:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2471145e3ea84645bcfa51f4fcf4cbbc',uuid=25db7eb1-fa77-4342-922c-4f82f8f27702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "address": "fa:16:3e:85:7c:de", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb502cd2-ee", "ovs_interfaceid": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Converting VIF {"id": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "address": "fa:16:3e:85:7c:de", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb502cd2-ee", "ovs_interfaceid": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:7c:de,bridge_name='br-int',has_traffic_filtering=True,id=bb502cd2-eea4-4ce2-8cd2-98fd80832595,network=Network(ea172a57-fdfb-45f3-b3df-e6f4751eb20b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb502cd2-ee') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG os_vif [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:7c:de,bridge_name='br-int',has_traffic_filtering=True,id=bb502cd2-eea4-4ce2-8cd2-98fd80832595,network=Network(ea172a57-fdfb-45f3-b3df-e6f4751eb20b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb502cd2-ee') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb502cd2-ee, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb502cd2-ee, col_values=(('external_ids', {'iface-id': 'bb502cd2-eea4-4ce2-8cd2-98fd80832595', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:7c:de', 'vm-uuid': '25db7eb1-fa77-4342-922c-4f82f8f27702'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:17 user nova-compute[72849]: INFO os_vif [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:7c:de,bridge_name='br-int',has_traffic_filtering=True,id=bb502cd2-eea4-4ce2-8cd2-98fd80832595,network=Network(ea172a57-fdfb-45f3-b3df-e6f4751eb20b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb502cd2-ee')
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] No VIF found with MAC fa:16:3e:85:7c:de, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:23:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:18 user nova-compute[72849]: DEBUG nova.network.neutron [req-203259c4-261d-4f9b-9f3d-2454a129826f req-ad446765-ef66-4ef5-b057-e2169e5ff782 service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Updated VIF entry in instance network info cache for port bb502cd2-eea4-4ce2-8cd2-98fd80832595. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:23:18 user nova-compute[72849]: DEBUG nova.network.neutron [req-203259c4-261d-4f9b-9f3d-2454a129826f req-ad446765-ef66-4ef5-b057-e2169e5ff782 service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Updating instance_info_cache with network_info: [{"id": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "address": "fa:16:3e:85:7c:de", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb502cd2-ee", "ovs_interfaceid": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:23:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-203259c4-261d-4f9b-9f3d-2454a129826f req-ad446765-ef66-4ef5-b057-e2169e5ff782 service nova] Releasing lock "refresh_cache-25db7eb1-fa77-4342-922c-4f82f8f27702" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:23:19 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Creating image(s)
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Did not create local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Ensure instance console log exists: /opt/stack/data/nova/instances/49874ea8-8d01-4de6-a3cc-fc35af67665e/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Start _get_guest_xml network_info=[{"id": "ba545c48-7768-4efb-ac4d-d4221464afaf", "address": "fa:16:3e:35:31:31", "network": {"id": "921f34cb-0177-4df4-8312-859dbdb9f7e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1824696117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba545c48-77", "ovs_interfaceid": "ba545c48-7768-4efb-ac4d-d4221464afaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "address": "fa:16:3e:68:5d:6b", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7d6a4-fc", "ovs_interfaceid": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "address": "fa:16:3e:cd:c5:53", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd0250b-e4", "ovs_interfaceid": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eeb5ba8-9589-4373-afaf-e90135c84256", "address": "fa:16:3e:0d:73:3f", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb5ba8-95", "ovs_interfaceid": "2eeb5ba8-9589-4373-afaf-e90135c84256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97188a57-9dc6-485a-9362-b44dbe9f2669", "address": "fa:16:3e:42:2f:1e", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97188a57-9d", "ovs_interfaceid": "97188a57-9dc6-485a-9362-b44dbe9f2669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "address": "fa:16:3e:e5:50:d8", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c51ab6-ca", "ovs_interfaceid": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "address": "fa:16:3e:16:8e:16", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07063ce8-2e", "ovs_interfaceid": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNopVOwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '49874ea8-8d01-4de6-a3cc-fc35af67665e', 'attached_at': '', 'detached_at': '', 'volume_id': '2a3534d2-37c8-4827-9b01-6f0c7cac0c70', 'serial': '2a3534d2-37c8-4827-9b01-6f0c7cac0c70'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'c4ec25eb-b034-4794-b27a-fe82e59cae4a', 'volume_type': None}, {'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHwTmcfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '49874ea8-8d01-4de6-a3cc-fc35af67665e', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2708688-451b-4230-aab4-87eee35b2e7d', 'serial': 'c2708688-451b-4230-aab4-87eee35b2e7d'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'c33cac37-259c-47f9-95f4-2c872985b35d', 'volume_type': None}, {'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xATusrDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '49874ea8-8d01-4de6-a3cc-fc35af67665e', 'attached_at': '', 'detached_at': '', 'volume_id': '82364061-e57a-498f-be94-6b55efdfdc78', 'serial': '82364061-e57a-498f-be94-6b55efdfdc78'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'd991fd98-0ade-4fe8-b903-62eae2440ea8', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:23:19 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:23:19 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNopVOwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:23:19 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:23:19 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:23:19 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-84669a2d-bde0-4eb5-9765-ba8a2543ec45 req-0188828b-d808-49a4-8ef0-f031a9fe1d9d service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Received event network-vif-plugged-bb502cd2-eea4-4ce2-8cd2-98fd80832595 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-84669a2d-bde0-4eb5-9765-ba8a2543ec45 req-0188828b-d808-49a4-8ef0-f031a9fe1d9d service nova] Acquiring lock "25db7eb1-fa77-4342-922c-4f82f8f27702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-84669a2d-bde0-4eb5-9765-ba8a2543ec45 req-0188828b-d808-49a4-8ef0-f031a9fe1d9d service nova] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-84669a2d-bde0-4eb5-9765-ba8a2543ec45 req-0188828b-d808-49a4-8ef0-f031a9fe1d9d service nova] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-84669a2d-bde0-4eb5-9765-ba8a2543ec45 req-0188828b-d808-49a4-8ef0-f031a9fe1d9d service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] No waiting events found dispatching network-vif-plugged-bb502cd2-eea4-4ce2-8cd2-98fd80832595 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:19 user nova-compute[72849]: WARNING nova.compute.manager [req-84669a2d-bde0-4eb5-9765-ba8a2543ec45 req-0188828b-d808-49a4-8ef0-f031a9fe1d9d service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Received unexpected event network-vif-plugged-bb502cd2-eea4-4ce2-8cd2-98fd80832595 for instance with vm_state building and task_state spawning.
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47e42ea-5f35-4a1f-a2ff-65b0f588d887]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:23:19 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a37d8c5-7ba8-47ec-a3d6-20666daa38a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70] added
Aug 15 16:23:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c7e878-4e33-48d4-adcd-822ad2b37cb6]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f025dc-0e83-4681-9e3e-174444dc3046]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZNopVOwf {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZNopVOwf" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f59ee59-128e-42d9-bfb3-993ef5db9568]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZNopVOwf'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdb9796-6d2e-4018-9c5c-2163eb80e781]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f4e1e1-1495-4fa9-b1f2-8a2b5bb607bc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:23:19 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:23:19 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:23:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:23:19 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:23:19 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:23:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[25436ccf-87d0-4a17-8ad0-83b46e910503]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70, portal: 172.16.0.220,3260]
Aug 15 16:23:19 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70, portal: 172.16.0.220,3260] successful.
Aug 15 16:23:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a8bdd9-1672-4ddb-bef2-4574afc7081b]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b85976-c6bb-4aec-bd0e-a7e65f839ed8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:23:19 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:23:19 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:23:19 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:23:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:23:19 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:23:19 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:23:19 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:23:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b1d148-bd8e-49cb-8bd7-0264819dc3b5]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNopVOwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26165323762626636', 'path': '/dev/sdc'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165323762626636', 'path': '/dev/sdc'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHwTmcfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:23:20 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:23:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:23:20 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:23:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:23:20 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[918a5f38-0499-4b17-a154-d7543e795dae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:23:20 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf5639c-3be4-46e5-bd0c-9800a128a93a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d] added
Aug 15 16:23:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccae8179-cc81-496a-b47a-e3f68a0d3c7e]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[039f6f1c-2ad3-47cc-a34a-c33c33aaf059]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gHwTmcfl {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gHwTmcfl" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1140c3f5-9530-4012-a9af-c2cc425fd496]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gHwTmcfl'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[93caa445-735f-4735-b772-44c1329466ac]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9827a8a6-09df-40e6-b292-42c83e2d0c4a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:23:20 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:23:20 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:23:20 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:23:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:23:20 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:23:20 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:23:20 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:23:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:23:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:21 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116601.2587976, 25db7eb1-fa77-4342-922c-4f82f8f27702 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:23:21 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] VM Resumed (Lifecycle Event)
Aug 15 16:23:21 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:23:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:23:21 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Instance spawned successfully.
Aug 15 16:23:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:23:21 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:23:21 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:23:21 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:23:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:23:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:23:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:23:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:23:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:23:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:23:21 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:23:21 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116601.2628827, 25db7eb1-fa77-4342-922c-4f82f8f27702 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:23:21 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] VM Started (Lifecycle Event)
Aug 15 16:23:21 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:23:21 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:23:21 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:23:21 user nova-compute[72849]: INFO nova.compute.manager [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Took 5.93 seconds to spawn the instance on the hypervisor.
Aug 15 16:23:21 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:23:21 user nova-compute[72849]: INFO nova.compute.manager [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Took 6.82 seconds to build instance.
Aug 15 16:23:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-3758ecc8-c712-4b4b-867b-e5f1de802b34 req-8d01de4a-9e24-4fed-be05-98c2b2da59e0 service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Received event network-vif-plugged-bb502cd2-eea4-4ce2-8cd2-98fd80832595 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3758ecc8-c712-4b4b-867b-e5f1de802b34 req-8d01de4a-9e24-4fed-be05-98c2b2da59e0 service nova] Acquiring lock "25db7eb1-fa77-4342-922c-4f82f8f27702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3758ecc8-c712-4b4b-867b-e5f1de802b34 req-8d01de4a-9e24-4fed-be05-98c2b2da59e0 service nova] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3758ecc8-c712-4b4b-867b-e5f1de802b34 req-8d01de4a-9e24-4fed-be05-98c2b2da59e0 service nova] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-3758ecc8-c712-4b4b-867b-e5f1de802b34 req-8d01de4a-9e24-4fed-be05-98c2b2da59e0 service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] No waiting events found dispatching network-vif-plugged-bb502cd2-eea4-4ce2-8cd2-98fd80832595 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:21 user nova-compute[72849]: WARNING nova.compute.manager [req-3758ecc8-c712-4b4b-867b-e5f1de802b34 req-8d01de4a-9e24-4fed-be05-98c2b2da59e0 service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Received unexpected event network-vif-plugged-bb502cd2-eea4-4ce2-8cd2-98fd80832595 for instance with vm_state active and task_state None.
Aug 15 16:23:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c3681622-eff2-4288-9b42-97a96c0c0bd2 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.115s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --login" returned: 0 in 1.071s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2474a956-9e2a-4290-ba33-9b42ccb40f01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d, portal: 172.16.0.220,3260]
Aug 15 16:23:22 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d, portal: 172.16.0.220,3260] successful.
Aug 15 16:23:22 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a339b175-7fd9-4aa8-b13c-7d61f67a3136]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdad8d8-199b-430c-a4b8-5474c28b3e69]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:23:22 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:23:22 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:23:22 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:23:22 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:23:22 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:23:22 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:23:22 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:23:22 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:23:22 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:23:22 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.286s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d68ce4-2a1d-478f-bbc0-74209c873fbb]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: None {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHwTmcfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.327s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] <== connect_volume: return (2328ms) {'type': 'block', 'scsi_wwn': '23365333838356466', 'path': '/dev/sde'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365333838356466', 'path': '/dev/sde'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xATusrDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:23:23 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:23:23 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:23:23 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c461d04f-5fa9-4863-85cf-5724038d31dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:23:23 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f3e406-ed2d-4a04-bef3-5d78ec946037]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78] added
Aug 15 16:23:23 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b013501a-6365-4fdc-b3c9-0204cdcb9da5]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd80a84-42f7-4a76-ad48-8f97fb089ac1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xATusrDU {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xATusrDU" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[36de8a13-5494-4d57-a5f0-f1b12077cf4a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xATusrDU'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3eb6e1d-3909-4194-b3c1-cc564c1efe84]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f4a19b-7607-43cd-940f-1f4cff0f7043]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:23:23 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:23:23 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:23:23 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:23:23 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:23:23 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:23:23 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:23:23 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:23:23 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:23:23 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:23:23 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7411a96b-fda3-4f3e-8cad-091b7f7150b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78, portal: 172.16.0.220,3260]
Aug 15 16:23:23 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78, portal: 172.16.0.220,3260] successful.
Aug 15 16:23:23 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d2b947-9b19-45a6-bcef-8764865681b1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b66d55-4eca-483f-b4d9-e9308f52bd19]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:23:23 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:23:23 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:23:23 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:23:23 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:23:23 user nova-compute[72849]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)
Aug 15 16:23:23 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:23:23 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:23:23 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:23:23 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:23:23 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:23:23 user nova-compute[72849]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)
Aug 15 16:23:23 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] HCTL ('38', '-', '-', 0) found on session 22 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66604eb-d18a-4e79-afcf-6c41c9d4819f]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Searching for a device in session 22 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xATusrDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '26565653638633537', 'path': '/dev/sdg'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565653638633537', 'path': '/dev/sdg'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba545c48-7768-4efb-ac4d-d4221464afaf", "address": "fa:16:3e:35:31:31", "network": {"id": "921f34cb-0177-4df4-8312-859dbdb9f7e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1824696117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba545c48-77", "ovs_interfaceid": "ba545c48-7768-4efb-ac4d-d4221464afaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "ba545c48-7768-4efb-ac4d-d4221464afaf", "address": "fa:16:3e:35:31:31", "network": {"id": "921f34cb-0177-4df4-8312-859dbdb9f7e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1824696117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba545c48-77", "ovs_interfaceid": "ba545c48-7768-4efb-ac4d-d4221464afaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:31:31,bridge_name='br-int',has_traffic_filtering=True,id=ba545c48-7768-4efb-ac4d-d4221464afaf,network=Network(921f34cb-0177-4df4-8312-859dbdb9f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba545c48-77') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "address": "fa:16:3e:68:5d:6b", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7d6a4-fc", "ovs_interfaceid": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "address": "fa:16:3e:68:5d:6b", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7d6a4-fc", "ovs_interfaceid": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=2bf7d6a4-fc72-48df-b1af-c208baebcf8a,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2bf7d6a4-fc') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "address": "fa:16:3e:cd:c5:53", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd0250b-e4", "ovs_interfaceid": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "address": "fa:16:3e:cd:c5:53", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd0250b-e4", "ovs_interfaceid": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c5:53,bridge_name='br-int',has_traffic_filtering=True,id=2dd0250b-e417-49b0-b438-c4b8500bf84d,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dd0250b-e4') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eeb5ba8-9589-4373-afaf-e90135c84256", "address": "fa:16:3e:0d:73:3f", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb5ba8-95", "ovs_interfaceid": "2eeb5ba8-9589-4373-afaf-e90135c84256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "2eeb5ba8-9589-4373-afaf-e90135c84256", "address": "fa:16:3e:0d:73:3f", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb5ba8-95", "ovs_interfaceid": "2eeb5ba8-9589-4373-afaf-e90135c84256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:73:3f,bridge_name='br-int',has_traffic_filtering=True,id=2eeb5ba8-9589-4373-afaf-e90135c84256,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb5ba8-95') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97188a57-9dc6-485a-9362-b44dbe9f2669", "address": "fa:16:3e:42:2f:1e", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97188a57-9d", "ovs_interfaceid": "97188a57-9dc6-485a-9362-b44dbe9f2669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "97188a57-9dc6-485a-9362-b44dbe9f2669", "address": "fa:16:3e:42:2f:1e", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97188a57-9d", "ovs_interfaceid": "97188a57-9dc6-485a-9362-b44dbe9f2669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:2f:1e,bridge_name='br-int',has_traffic_filtering=True,id=97188a57-9dc6-485a-9362-b44dbe9f2669,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97188a57-9d') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "address": "fa:16:3e:e5:50:d8", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c51ab6-ca", "ovs_interfaceid": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "address": "fa:16:3e:e5:50:d8", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c51ab6-ca", "ovs_interfaceid": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:50:d8,bridge_name='br-int',has_traffic_filtering=True,id=62c51ab6-ca9a-4c11-bea6-ab58d22e80dc,network=Network(3c093662-951c-4b22-b6fe-68ef0c7cff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62c51ab6-ca') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "address": "fa:16:3e:16:8e:16", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07063ce8-2e", "ovs_interfaceid": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "address": "fa:16:3e:16:8e:16", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07063ce8-2e", "ovs_interfaceid": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=07063ce8-2e0a-4d84-9dcc-7b09379d313a,network=Network(3c093662-951c-4b22-b6fe-68ef0c7cff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07063ce8-2e') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.objects.instance [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lazy-loading 'pci_devices' on Instance uuid 49874ea8-8d01-4de6-a3cc-fc35af67665e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:23:24 user nova-compute[72849]:   <uuid>49874ea8-8d01-4de6-a3cc-fc35af67665e</uuid>
Aug 15 16:23:24 user nova-compute[72849]:   <name>instance-00000014</name>
Aug 15 16:23:24 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:23:24 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:23:24 user nova-compute[72849]:   <metadata>
Aug 15 16:23:24 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:23:24 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:23:24 user nova-compute[72849]:       <nova:name>tempest-device-tagging-server-1582159344</nova:name>
Aug 15 16:23:24 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:23:19</nova:creationTime>
Aug 15 16:23:24 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:23:24 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:23:24 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:23:24 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:23:24 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:23:24 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:23:24 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:23:24 user nova-compute[72849]:       <nova:owner>
Aug 15 16:23:24 user nova-compute[72849]:         <nova:user uuid="b969d9f150524650bdb3f0535270ecd4">tempest-TaggedBootDevicesTest_v242-2042209791-project-member</nova:user>
Aug 15 16:23:24 user nova-compute[72849]:         <nova:project uuid="a7485d9d649d4d6e8d0eef09cc1b28d7">tempest-TaggedBootDevicesTest_v242-2042209791</nova:project>
Aug 15 16:23:24 user nova-compute[72849]:       </nova:owner>
Aug 15 16:23:24 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:23:24 user nova-compute[72849]:       <nova:ports>
Aug 15 16:23:24 user nova-compute[72849]:         <nova:port uuid="ba545c48-7768-4efb-ac4d-d4221464afaf">
Aug 15 16:23:24 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 16:23:24 user nova-compute[72849]:         </nova:port>
Aug 15 16:23:24 user nova-compute[72849]:         <nova:port uuid="2bf7d6a4-fc72-48df-b1af-c208baebcf8a">
Aug 15 16:23:24 user nova-compute[72849]:           <nova:ip type="fixed" address="10.1.1.244" ipVersion="4"/>
Aug 15 16:23:24 user nova-compute[72849]:         </nova:port>
Aug 15 16:23:24 user nova-compute[72849]:         <nova:port uuid="2dd0250b-e417-49b0-b438-c4b8500bf84d">
Aug 15 16:23:24 user nova-compute[72849]:           <nova:ip type="fixed" address="10.1.1.159" ipVersion="4"/>
Aug 15 16:23:24 user nova-compute[72849]:         </nova:port>
Aug 15 16:23:24 user nova-compute[72849]:         <nova:port uuid="2eeb5ba8-9589-4373-afaf-e90135c84256">
Aug 15 16:23:24 user nova-compute[72849]:           <nova:ip type="fixed" address="10.1.1.158" ipVersion="4"/>
Aug 15 16:23:24 user nova-compute[72849]:         </nova:port>
Aug 15 16:23:24 user nova-compute[72849]:         <nova:port uuid="97188a57-9dc6-485a-9362-b44dbe9f2669">
Aug 15 16:23:24 user nova-compute[72849]:           <nova:ip type="fixed" address="10.1.1.156" ipVersion="4"/>
Aug 15 16:23:24 user nova-compute[72849]:         </nova:port>
Aug 15 16:23:24 user nova-compute[72849]:         <nova:port uuid="62c51ab6-ca9a-4c11-bea6-ab58d22e80dc">
Aug 15 16:23:24 user nova-compute[72849]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 15 16:23:24 user nova-compute[72849]:         </nova:port>
Aug 15 16:23:24 user nova-compute[72849]:         <nova:port uuid="07063ce8-2e0a-4d84-9dcc-7b09379d313a">
Aug 15 16:23:24 user nova-compute[72849]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 15 16:23:24 user nova-compute[72849]:         </nova:port>
Aug 15 16:23:24 user nova-compute[72849]:       </nova:ports>
Aug 15 16:23:24 user nova-compute[72849]:     </nova:instance>
Aug 15 16:23:24 user nova-compute[72849]:   </metadata>
Aug 15 16:23:24 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:23:24 user nova-compute[72849]:     <system>
Aug 15 16:23:24 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:23:24 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:23:24 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:23:24 user nova-compute[72849]:       <entry name="serial">49874ea8-8d01-4de6-a3cc-fc35af67665e</entry>
Aug 15 16:23:24 user nova-compute[72849]:       <entry name="uuid">49874ea8-8d01-4de6-a3cc-fc35af67665e</entry>
Aug 15 16:23:24 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:23:24 user nova-compute[72849]:     </system>
Aug 15 16:23:24 user nova-compute[72849]:   </sysinfo>
Aug 15 16:23:24 user nova-compute[72849]:   <os>
Aug 15 16:23:24 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:23:24 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:23:24 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:23:24 user nova-compute[72849]:   </os>
Aug 15 16:23:24 user nova-compute[72849]:   <features>
Aug 15 16:23:24 user nova-compute[72849]:     <acpi/>
Aug 15 16:23:24 user nova-compute[72849]:     <apic/>
Aug 15 16:23:24 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:23:24 user nova-compute[72849]:   </features>
Aug 15 16:23:24 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:23:24 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:23:24 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:23:24 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:23:24 user nova-compute[72849]:   </clock>
Aug 15 16:23:24 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:23:24 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:23:24 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:23:24 user nova-compute[72849]:   </cpu>
Aug 15 16:23:24 user nova-compute[72849]:   <devices>
Aug 15 16:23:24 user nova-compute[72849]:     <disk type="file" device="cdrom">
Aug 15 16:23:24 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 16:23:24 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/49874ea8-8d01-4de6-a3cc-fc35af67665e/disk.config"/>
Aug 15 16:23:24 user nova-compute[72849]:       <target dev="hda" bus="ide"/>
Aug 15 16:23:24 user nova-compute[72849]:     </disk>
Aug 15 16:23:24 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:23:24 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:23:24 user nova-compute[72849]:       <source dev="/dev/sdc"/>
Aug 15 16:23:24 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:23:24 user nova-compute[72849]:       <serial>2a3534d2-37c8-4827-9b01-6f0c7cac0c70</serial>
Aug 15 16:23:24 user nova-compute[72849]:     </disk>
Aug 15 16:23:24 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:23:24 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:23:24 user nova-compute[72849]:       <source dev="/dev/sde"/>
Aug 15 16:23:24 user nova-compute[72849]:       <target dev="vdb" bus="virtio"/>
Aug 15 16:23:24 user nova-compute[72849]:       <serial>c2708688-451b-4230-aab4-87eee35b2e7d</serial>
Aug 15 16:23:24 user nova-compute[72849]:     </disk>
Aug 15 16:23:24 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:23:24 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:23:24 user nova-compute[72849]:       <source dev="/dev/sdg"/>
Aug 15 16:23:24 user nova-compute[72849]:       <target dev="vdc" bus="virtio"/>
Aug 15 16:23:24 user nova-compute[72849]:       <serial>82364061-e57a-498f-be94-6b55efdfdc78</serial>
Aug 15 16:23:24 user nova-compute[72849]:     </disk>
Aug 15 16:23:24 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:23:24 user nova-compute[72849]:       <mac address="fa:16:3e:35:31:31"/>
Aug 15 16:23:24 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:23:24 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:23:24 user nova-compute[72849]:       <target dev="tapba545c48-77"/>
Aug 15 16:23:24 user nova-compute[72849]:     </interface>
Aug 15 16:23:24 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:23:24 user nova-compute[72849]:       <mac address="fa:16:3e:68:5d:6b"/>
Aug 15 16:23:24 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:23:24 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:23:24 user nova-compute[72849]:       <target dev="tap2bf7d6a4-fc"/>
Aug 15 16:23:24 user nova-compute[72849]:     </interface>
Aug 15 16:23:24 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:23:24 user nova-compute[72849]:       <mac address="fa:16:3e:cd:c5:53"/>
Aug 15 16:23:24 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:23:24 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:23:24 user nova-compute[72849]:       <target dev="tap2dd0250b-e4"/>
Aug 15 16:23:24 user nova-compute[72849]:     </interface>
Aug 15 16:23:24 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:23:24 user nova-compute[72849]:       <mac address="fa:16:3e:0d:73:3f"/>
Aug 15 16:23:24 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:23:24 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:23:24 user nova-compute[72849]:       <target dev="tap2eeb5ba8-95"/>
Aug 15 16:23:24 user nova-compute[72849]:     </interface>
Aug 15 16:23:24 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:23:24 user nova-compute[72849]:       <mac address="fa:16:3e:42:2f:1e"/>
Aug 15 16:23:24 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:23:24 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:23:24 user nova-compute[72849]:       <target dev="tap97188a57-9d"/>
Aug 15 16:23:24 user nova-compute[72849]:     </interface>
Aug 15 16:23:24 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:23:24 user nova-compute[72849]:       <mac address="fa:16:3e:e5:50:d8"/>
Aug 15 16:23:24 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:23:24 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:23:24 user nova-compute[72849]:       <target dev="tap62c51ab6-ca"/>
Aug 15 16:23:24 user nova-compute[72849]:     </interface>
Aug 15 16:23:24 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:23:24 user nova-compute[72849]:       <mac address="fa:16:3e:16:8e:16"/>
Aug 15 16:23:24 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:23:24 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:23:24 user nova-compute[72849]:       <target dev="tap07063ce8-2e"/>
Aug 15 16:23:24 user nova-compute[72849]:     </interface>
Aug 15 16:23:24 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:23:24 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/49874ea8-8d01-4de6-a3cc-fc35af67665e/console.log" append="off"/>
Aug 15 16:23:24 user nova-compute[72849]:     </serial>
Aug 15 16:23:24 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:23:24 user nova-compute[72849]:     <video>
Aug 15 16:23:24 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:23:24 user nova-compute[72849]:     </video>
Aug 15 16:23:24 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:23:24 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:23:24 user nova-compute[72849]:     </rng>
Aug 15 16:23:24 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:23:24 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:23:24 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:23:24 user nova-compute[72849]:     </memballoon>
Aug 15 16:23:24 user nova-compute[72849]:   </devices>
Aug 15 16:23:24 user nova-compute[72849]: </domain>
Aug 15 16:23:24 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba545c48-7768-4efb-ac4d-d4221464afaf", "address": "fa:16:3e:35:31:31", "network": {"id": "921f34cb-0177-4df4-8312-859dbdb9f7e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1824696117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba545c48-77", "ovs_interfaceid": "ba545c48-7768-4efb-ac4d-d4221464afaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "ba545c48-7768-4efb-ac4d-d4221464afaf", "address": "fa:16:3e:35:31:31", "network": {"id": "921f34cb-0177-4df4-8312-859dbdb9f7e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1824696117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba545c48-77", "ovs_interfaceid": "ba545c48-7768-4efb-ac4d-d4221464afaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:31:31,bridge_name='br-int',has_traffic_filtering=True,id=ba545c48-7768-4efb-ac4d-d4221464afaf,network=Network(921f34cb-0177-4df4-8312-859dbdb9f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba545c48-77') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG os_vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:31:31,bridge_name='br-int',has_traffic_filtering=True,id=ba545c48-7768-4efb-ac4d-d4221464afaf,network=Network(921f34cb-0177-4df4-8312-859dbdb9f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba545c48-77') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba545c48-77, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba545c48-77, col_values=(('external_ids', {'iface-id': 'ba545c48-7768-4efb-ac4d-d4221464afaf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:31:31', 'vm-uuid': '49874ea8-8d01-4de6-a3cc-fc35af67665e'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: INFO os_vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:31:31,bridge_name='br-int',has_traffic_filtering=True,id=ba545c48-7768-4efb-ac4d-d4221464afaf,network=Network(921f34cb-0177-4df4-8312-859dbdb9f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba545c48-77')
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "address": "fa:16:3e:68:5d:6b", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7d6a4-fc", "ovs_interfaceid": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "address": "fa:16:3e:68:5d:6b", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7d6a4-fc", "ovs_interfaceid": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=2bf7d6a4-fc72-48df-b1af-c208baebcf8a,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2bf7d6a4-fc') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG os_vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=2bf7d6a4-fc72-48df-b1af-c208baebcf8a,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2bf7d6a4-fc') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bf7d6a4-fc, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2bf7d6a4-fc, col_values=(('external_ids', {'iface-id': '2bf7d6a4-fc72-48df-b1af-c208baebcf8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:5d:6b', 'vm-uuid': '49874ea8-8d01-4de6-a3cc-fc35af67665e'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: INFO os_vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=2bf7d6a4-fc72-48df-b1af-c208baebcf8a,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2bf7d6a4-fc')
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "address": "fa:16:3e:cd:c5:53", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd0250b-e4", "ovs_interfaceid": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "address": "fa:16:3e:cd:c5:53", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd0250b-e4", "ovs_interfaceid": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c5:53,bridge_name='br-int',has_traffic_filtering=True,id=2dd0250b-e417-49b0-b438-c4b8500bf84d,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dd0250b-e4') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG os_vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c5:53,bridge_name='br-int',has_traffic_filtering=True,id=2dd0250b-e417-49b0-b438-c4b8500bf84d,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dd0250b-e4') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dd0250b-e4, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2dd0250b-e4, col_values=(('external_ids', {'iface-id': '2dd0250b-e417-49b0-b438-c4b8500bf84d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:c5:53', 'vm-uuid': '49874ea8-8d01-4de6-a3cc-fc35af67665e'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: INFO os_vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c5:53,bridge_name='br-int',has_traffic_filtering=True,id=2dd0250b-e417-49b0-b438-c4b8500bf84d,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dd0250b-e4')
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eeb5ba8-9589-4373-afaf-e90135c84256", "address": "fa:16:3e:0d:73:3f", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb5ba8-95", "ovs_interfaceid": "2eeb5ba8-9589-4373-afaf-e90135c84256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "2eeb5ba8-9589-4373-afaf-e90135c84256", "address": "fa:16:3e:0d:73:3f", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb5ba8-95", "ovs_interfaceid": "2eeb5ba8-9589-4373-afaf-e90135c84256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:73:3f,bridge_name='br-int',has_traffic_filtering=True,id=2eeb5ba8-9589-4373-afaf-e90135c84256,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb5ba8-95') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG os_vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:73:3f,bridge_name='br-int',has_traffic_filtering=True,id=2eeb5ba8-9589-4373-afaf-e90135c84256,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb5ba8-95') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eeb5ba8-95, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2eeb5ba8-95, col_values=(('external_ids', {'iface-id': '2eeb5ba8-9589-4373-afaf-e90135c84256', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:73:3f', 'vm-uuid': '49874ea8-8d01-4de6-a3cc-fc35af67665e'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: INFO os_vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:73:3f,bridge_name='br-int',has_traffic_filtering=True,id=2eeb5ba8-9589-4373-afaf-e90135c84256,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb5ba8-95')
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97188a57-9dc6-485a-9362-b44dbe9f2669", "address": "fa:16:3e:42:2f:1e", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97188a57-9d", "ovs_interfaceid": "97188a57-9dc6-485a-9362-b44dbe9f2669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "97188a57-9dc6-485a-9362-b44dbe9f2669", "address": "fa:16:3e:42:2f:1e", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97188a57-9d", "ovs_interfaceid": "97188a57-9dc6-485a-9362-b44dbe9f2669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:2f:1e,bridge_name='br-int',has_traffic_filtering=True,id=97188a57-9dc6-485a-9362-b44dbe9f2669,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97188a57-9d') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG os_vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:2f:1e,bridge_name='br-int',has_traffic_filtering=True,id=97188a57-9dc6-485a-9362-b44dbe9f2669,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97188a57-9d') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97188a57-9d, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap97188a57-9d, col_values=(('external_ids', {'iface-id': '97188a57-9dc6-485a-9362-b44dbe9f2669', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:2f:1e', 'vm-uuid': '49874ea8-8d01-4de6-a3cc-fc35af67665e'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: INFO os_vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:2f:1e,bridge_name='br-int',has_traffic_filtering=True,id=97188a57-9dc6-485a-9362-b44dbe9f2669,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97188a57-9d')
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "address": "fa:16:3e:e5:50:d8", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c51ab6-ca", "ovs_interfaceid": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "address": "fa:16:3e:e5:50:d8", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c51ab6-ca", "ovs_interfaceid": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:50:d8,bridge_name='br-int',has_traffic_filtering=True,id=62c51ab6-ca9a-4c11-bea6-ab58d22e80dc,network=Network(3c093662-951c-4b22-b6fe-68ef0c7cff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62c51ab6-ca') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG os_vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:50:d8,bridge_name='br-int',has_traffic_filtering=True,id=62c51ab6-ca9a-4c11-bea6-ab58d22e80dc,network=Network(3c093662-951c-4b22-b6fe-68ef0c7cff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62c51ab6-ca') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62c51ab6-ca, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62c51ab6-ca, col_values=(('external_ids', {'iface-id': '62c51ab6-ca9a-4c11-bea6-ab58d22e80dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:50:d8', 'vm-uuid': '49874ea8-8d01-4de6-a3cc-fc35af67665e'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:25 user nova-compute[72849]: INFO os_vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:50:d8,bridge_name='br-int',has_traffic_filtering=True,id=62c51ab6-ca9a-4c11-bea6-ab58d22e80dc,network=Network(3c093662-951c-4b22-b6fe-68ef0c7cff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62c51ab6-ca')
Aug 15 16:23:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "address": "fa:16:3e:16:8e:16", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07063ce8-2e", "ovs_interfaceid": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "address": "fa:16:3e:16:8e:16", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07063ce8-2e", "ovs_interfaceid": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=07063ce8-2e0a-4d84-9dcc-7b09379d313a,network=Network(3c093662-951c-4b22-b6fe-68ef0c7cff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07063ce8-2e') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG os_vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=07063ce8-2e0a-4d84-9dcc-7b09379d313a,network=Network(3c093662-951c-4b22-b6fe-68ef0c7cff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07063ce8-2e') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07063ce8-2e, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap07063ce8-2e, col_values=(('external_ids', {'iface-id': '07063ce8-2e0a-4d84-9dcc-7b09379d313a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:8e:16', 'vm-uuid': '49874ea8-8d01-4de6-a3cc-fc35af67665e'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:25 user nova-compute[72849]: INFO os_vif [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=07063ce8-2e0a-4d84-9dcc-7b09379d313a,network=Network(3c093662-951c-4b22-b6fe-68ef0c7cff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07063ce8-2e')
Aug 15 16:23:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] No BDM found with device name hda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] No VIF found with MAC fa:16:3e:35:31:31, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] No VIF found with MAC fa:16:3e:42:2f:1e, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:23:25 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Using config drive
Aug 15 16:23:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:25 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Creating config drive at /opt/stack/data/nova/instances/49874ea8-8d01-4de6-a3cc-fc35af67665e/disk.config
Aug 15 16:23:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/49874ea8-8d01-4de6-a3cc-fc35af67665e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0xn9lcdd {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/49874ea8-8d01-4de6-a3cc-fc35af67665e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0xn9lcdd" returned: 0 in 0.059s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:23:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:23:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116611.4611058, 49874ea8-8d01-4de6-a3cc-fc35af67665e => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:23:31 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] VM Resumed (Lifecycle Event)
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-3a7aa009-5316-4a15-a319-e60144449f31 req-6199b7e1-b9bd-44de-827f-e84c8ba578fe service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-ba545c48-7768-4efb-ac4d-d4221464afaf {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3a7aa009-5316-4a15-a319-e60144449f31 req-6199b7e1-b9bd-44de-827f-e84c8ba578fe service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3a7aa009-5316-4a15-a319-e60144449f31 req-6199b7e1-b9bd-44de-827f-e84c8ba578fe service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3a7aa009-5316-4a15-a319-e60144449f31 req-6199b7e1-b9bd-44de-827f-e84c8ba578fe service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-3a7aa009-5316-4a15-a319-e60144449f31 req-6199b7e1-b9bd-44de-827f-e84c8ba578fe service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-ba545c48-7768-4efb-ac4d-d4221464afaf {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:31 user nova-compute[72849]: WARNING nova.compute.manager [req-3a7aa009-5316-4a15-a319-e60144449f31 req-6199b7e1-b9bd-44de-827f-e84c8ba578fe service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-ba545c48-7768-4efb-ac4d-d4221464afaf for instance with vm_state building and task_state spawning.
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-c54e6219-c13f-4053-9ee6-ba735c3f8e96 req-0c03f1f8-e4e9-44d3-ab33-81f961f0a7e7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-2eeb5ba8-9589-4373-afaf-e90135c84256 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c54e6219-c13f-4053-9ee6-ba735c3f8e96 req-0c03f1f8-e4e9-44d3-ab33-81f961f0a7e7 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c54e6219-c13f-4053-9ee6-ba735c3f8e96 req-0c03f1f8-e4e9-44d3-ab33-81f961f0a7e7 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c54e6219-c13f-4053-9ee6-ba735c3f8e96 req-0c03f1f8-e4e9-44d3-ab33-81f961f0a7e7 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-c54e6219-c13f-4053-9ee6-ba735c3f8e96 req-0c03f1f8-e4e9-44d3-ab33-81f961f0a7e7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-2eeb5ba8-9589-4373-afaf-e90135c84256 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:31 user nova-compute[72849]: WARNING nova.compute.manager [req-c54e6219-c13f-4053-9ee6-ba735c3f8e96 req-0c03f1f8-e4e9-44d3-ab33-81f961f0a7e7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-2eeb5ba8-9589-4373-afaf-e90135c84256 for instance with vm_state building and task_state spawning.
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-71847ec7-eef8-44a0-a84d-3c4438ac1abb req-ec1d6df6-a54f-4cb6-a9d6-743425a1e7f2 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-97188a57-9dc6-485a-9362-b44dbe9f2669 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-71847ec7-eef8-44a0-a84d-3c4438ac1abb req-ec1d6df6-a54f-4cb6-a9d6-743425a1e7f2 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-71847ec7-eef8-44a0-a84d-3c4438ac1abb req-ec1d6df6-a54f-4cb6-a9d6-743425a1e7f2 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-71847ec7-eef8-44a0-a84d-3c4438ac1abb req-ec1d6df6-a54f-4cb6-a9d6-743425a1e7f2 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-71847ec7-eef8-44a0-a84d-3c4438ac1abb req-ec1d6df6-a54f-4cb6-a9d6-743425a1e7f2 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-97188a57-9dc6-485a-9362-b44dbe9f2669 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:31 user nova-compute[72849]: WARNING nova.compute.manager [req-71847ec7-eef8-44a0-a84d-3c4438ac1abb req-ec1d6df6-a54f-4cb6-a9d6-743425a1e7f2 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-97188a57-9dc6-485a-9362-b44dbe9f2669 for instance with vm_state building and task_state spawning.
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-ba545c48-7768-4efb-ac4d-d4221464afaf {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-ba545c48-7768-4efb-ac4d-d4221464afaf {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:31 user nova-compute[72849]: WARNING nova.compute.manager [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-ba545c48-7768-4efb-ac4d-d4221464afaf for instance with vm_state building and task_state spawning.
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-2bf7d6a4-fc72-48df-b1af-c208baebcf8a {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-2bf7d6a4-fc72-48df-b1af-c208baebcf8a {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:31 user nova-compute[72849]: WARNING nova.compute.manager [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-2bf7d6a4-fc72-48df-b1af-c208baebcf8a for instance with vm_state building and task_state spawning.
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-2bf7d6a4-fc72-48df-b1af-c208baebcf8a {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-2bf7d6a4-fc72-48df-b1af-c208baebcf8a {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:31 user nova-compute[72849]: WARNING nova.compute.manager [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-2bf7d6a4-fc72-48df-b1af-c208baebcf8a for instance with vm_state building and task_state spawning.
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-2dd0250b-e417-49b0-b438-c4b8500bf84d {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-2dd0250b-e417-49b0-b438-c4b8500bf84d {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:31 user nova-compute[72849]: WARNING nova.compute.manager [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-2dd0250b-e417-49b0-b438-c4b8500bf84d for instance with vm_state building and task_state spawning.
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-2dd0250b-e417-49b0-b438-c4b8500bf84d {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-2dd0250b-e417-49b0-b438-c4b8500bf84d {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:31 user nova-compute[72849]: WARNING nova.compute.manager [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-2dd0250b-e417-49b0-b438-c4b8500bf84d for instance with vm_state building and task_state spawning.
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-62c51ab6-ca9a-4c11-bea6-ab58d22e80dc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-62c51ab6-ca9a-4c11-bea6-ab58d22e80dc {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:31 user nova-compute[72849]: WARNING nova.compute.manager [req-accae263-a2fe-4808-bc82-2ce709637c56 req-f0860d36-b2c9-4cb9-8769-3517604aba87 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-62c51ab6-ca9a-4c11-bea6-ab58d22e80dc for instance with vm_state building and task_state spawning.
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-85ab3094-e702-4f56-b092-cc63d76a86a1 req-ad8d0a0d-985d-42bf-9f55-ecd1c1b1fb03 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-2eeb5ba8-9589-4373-afaf-e90135c84256 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-85ab3094-e702-4f56-b092-cc63d76a86a1 req-ad8d0a0d-985d-42bf-9f55-ecd1c1b1fb03 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-85ab3094-e702-4f56-b092-cc63d76a86a1 req-ad8d0a0d-985d-42bf-9f55-ecd1c1b1fb03 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-85ab3094-e702-4f56-b092-cc63d76a86a1 req-ad8d0a0d-985d-42bf-9f55-ecd1c1b1fb03 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-85ab3094-e702-4f56-b092-cc63d76a86a1 req-ad8d0a0d-985d-42bf-9f55-ecd1c1b1fb03 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-2eeb5ba8-9589-4373-afaf-e90135c84256 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:31 user nova-compute[72849]: WARNING nova.compute.manager [req-85ab3094-e702-4f56-b092-cc63d76a86a1 req-ad8d0a0d-985d-42bf-9f55-ecd1c1b1fb03 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-2eeb5ba8-9589-4373-afaf-e90135c84256 for instance with vm_state building and task_state spawning.
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-790b5579-0702-435d-a52b-a3978ba72dde req-0f480eb8-e0a4-47df-8f60-9a155ec305bd service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-97188a57-9dc6-485a-9362-b44dbe9f2669 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-790b5579-0702-435d-a52b-a3978ba72dde req-0f480eb8-e0a4-47df-8f60-9a155ec305bd service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-790b5579-0702-435d-a52b-a3978ba72dde req-0f480eb8-e0a4-47df-8f60-9a155ec305bd service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-790b5579-0702-435d-a52b-a3978ba72dde req-0f480eb8-e0a4-47df-8f60-9a155ec305bd service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-790b5579-0702-435d-a52b-a3978ba72dde req-0f480eb8-e0a4-47df-8f60-9a155ec305bd service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-97188a57-9dc6-485a-9362-b44dbe9f2669 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:31 user nova-compute[72849]: WARNING nova.compute.manager [req-790b5579-0702-435d-a52b-a3978ba72dde req-0f480eb8-e0a4-47df-8f60-9a155ec305bd service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-97188a57-9dc6-485a-9362-b44dbe9f2669 for instance with vm_state building and task_state spawning.
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-c7a83e95-9b4e-4d60-b8c7-0c6e72c585ba req-4c8a404d-5a39-483c-9dcc-a6a05264321f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-62c51ab6-ca9a-4c11-bea6-ab58d22e80dc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c7a83e95-9b4e-4d60-b8c7-0c6e72c585ba req-4c8a404d-5a39-483c-9dcc-a6a05264321f service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c7a83e95-9b4e-4d60-b8c7-0c6e72c585ba req-4c8a404d-5a39-483c-9dcc-a6a05264321f service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c7a83e95-9b4e-4d60-b8c7-0c6e72c585ba req-4c8a404d-5a39-483c-9dcc-a6a05264321f service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-c7a83e95-9b4e-4d60-b8c7-0c6e72c585ba req-4c8a404d-5a39-483c-9dcc-a6a05264321f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-62c51ab6-ca9a-4c11-bea6-ab58d22e80dc {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:31 user nova-compute[72849]: WARNING nova.compute.manager [req-c7a83e95-9b4e-4d60-b8c7-0c6e72c585ba req-4c8a404d-5a39-483c-9dcc-a6a05264321f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-62c51ab6-ca9a-4c11-bea6-ab58d22e80dc for instance with vm_state building and task_state spawning.
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-c7a83e95-9b4e-4d60-b8c7-0c6e72c585ba req-4c8a404d-5a39-483c-9dcc-a6a05264321f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-07063ce8-2e0a-4d84-9dcc-7b09379d313a {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c7a83e95-9b4e-4d60-b8c7-0c6e72c585ba req-4c8a404d-5a39-483c-9dcc-a6a05264321f service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c7a83e95-9b4e-4d60-b8c7-0c6e72c585ba req-4c8a404d-5a39-483c-9dcc-a6a05264321f service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c7a83e95-9b4e-4d60-b8c7-0c6e72c585ba req-4c8a404d-5a39-483c-9dcc-a6a05264321f service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-c7a83e95-9b4e-4d60-b8c7-0c6e72c585ba req-4c8a404d-5a39-483c-9dcc-a6a05264321f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-07063ce8-2e0a-4d84-9dcc-7b09379d313a {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:31 user nova-compute[72849]: WARNING nova.compute.manager [req-c7a83e95-9b4e-4d60-b8c7-0c6e72c585ba req-4c8a404d-5a39-483c-9dcc-a6a05264321f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-07063ce8-2e0a-4d84-9dcc-7b09379d313a for instance with vm_state building and task_state spawning.
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-c7a83e95-9b4e-4d60-b8c7-0c6e72c585ba req-4c8a404d-5a39-483c-9dcc-a6a05264321f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-07063ce8-2e0a-4d84-9dcc-7b09379d313a {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c7a83e95-9b4e-4d60-b8c7-0c6e72c585ba req-4c8a404d-5a39-483c-9dcc-a6a05264321f service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c7a83e95-9b4e-4d60-b8c7-0c6e72c585ba req-4c8a404d-5a39-483c-9dcc-a6a05264321f service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c7a83e95-9b4e-4d60-b8c7-0c6e72c585ba req-4c8a404d-5a39-483c-9dcc-a6a05264321f service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-c7a83e95-9b4e-4d60-b8c7-0c6e72c585ba req-4c8a404d-5a39-483c-9dcc-a6a05264321f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-07063ce8-2e0a-4d84-9dcc-7b09379d313a {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:31 user nova-compute[72849]: WARNING nova.compute.manager [req-c7a83e95-9b4e-4d60-b8c7-0c6e72c585ba req-4c8a404d-5a39-483c-9dcc-a6a05264321f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-07063ce8-2e0a-4d84-9dcc-7b09379d313a for instance with vm_state building and task_state spawning.
Aug 15 16:23:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:23:31 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Instance spawned successfully.
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:23:31 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:23:31 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:23:31 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=6899MB free_disk=25.239681243896484GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:23:32 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116611.462776, 49874ea8-8d01-4de6-a3cc-fc35af67665e => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:23:32 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] VM Started (Lifecycle Event)
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:23:32 user nova-compute[72849]: INFO nova.compute.manager [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Took 12.79 seconds to spawn the instance on the hypervisor.
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:23:32 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 052cde29-421b-4b17-9bcd-acd58456ddba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc521d87-09aa-44ba-a87c-1cd5517b3707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 46f0aa43-e313-4aff-bacc-aa5290193b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b0a869eb-9ee8-4c31-9786-5b8be7d362a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance a3221960-e5ff-4185-a5dd-09f2cd293cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 49874ea8-8d01-4de6-a3cc-fc35af67665e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 25db7eb1-fa77-4342-922c-4f82f8f27702 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:23:32 user nova-compute[72849]: INFO nova.compute.manager [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Took 68.61 seconds to build instance.
Aug 15 16:23:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-82035f0d-9644-490f-851a-3a64438b3720 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 68.927s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 56.844s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:32 user nova-compute[72849]: INFO nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 15 16:23:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:23:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.600s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:23:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:23:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:23:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:23:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:23:33 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:23:33 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:23:34 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Updating instance_info_cache with network_info: [{"id": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "address": "fa:16:3e:18:f5:fe", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88628ea8-90", "ovs_interfaceid": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:23:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:23:34 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:23:34 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:23:34 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:23:34 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:23:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:40 user nova-compute[72849]: DEBUG nova.objects.instance [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lazy-loading 'flavor' on Instance uuid 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:23:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:40 user nova-compute[72849]: INFO nova.compute.manager [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Attaching volume b9b7a683-8844-46b6-ba4a-20133c67fb9a to /dev/vdb
Aug 15 16:23:40 user nova-compute[72849]: DEBUG os_brick.utils [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:23:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:40 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfd91b3-f0f3-493e-95ea-31b7aac5bec6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa848b5-fddd-4817-aa38-fb221fe9a396]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1a56bf-67d3-49ae-a391-8f87a7a46394]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8c4535-a2ed-44d4-bf17-d38922079b9c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:23:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:23:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:23:41 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:23:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[30aebd6a-3a91-4b48-9d2a-f867c01d102e]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:23:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:23:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:23:41 user nova-compute[72849]: DEBUG os_brick.utils [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:23:41 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Updating existing volume attachment record: 4bfa2fcc-5f45-4a47-a278-51b07127e725 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:23:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQVqSONK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:23:54 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:23:54 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:23:54 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6408f0b2-1f53-4fa7-9c06-69c87ba1449b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:23:54 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6792767e-7d81-45ec-8e66-900c3d4c6169]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a] added
Aug 15 16:23:54 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5757178d-491e-4f90-845d-570b99528483]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[23602181-72b2-49c9-9a9e-e484ea663a12]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hQVqSONK {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hQVqSONK" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d8b11a-b542-431b-b606-a6770534e1b1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hQVqSONK'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccf95a3-cfdb-4d9f-bcb2-7fd1483ec15b]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e459ca-d6de-47d9-915a-c8b9afd79485]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)
Aug 15 16:23:54 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)
Aug 15 16:23:54 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[59413e4b-0a5e-494b-a152-71a554b0b0e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a, portal: 172.16.0.220,3260]
Aug 15 16:23:54 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a, portal: 172.16.0.220,3260] successful.
Aug 15 16:23:54 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6991ef-d8ee-4cd6-abc2-56337d0344d3]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[484e7f24-18e1-41a0-83af-d1a7b2215b2b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:23:54 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)
Aug 15 16:23:54 user nova-compute[72849]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:23:54 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] HCTL ('39', '-', '-', 0) found on session 23 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3ed3dd-fdfb-456e-9cac-f801cf5cef88]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:23:54 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Searching for a device in session 23 and hctl ['39', '*', '*', 0] yield: None {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:23:55 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Searching for a device in session 23 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:23:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQVqSONK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:23:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:23:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23865366565373738', 'path': '/dev/sdh'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:23:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865366565373738', 'path': '/dev/sdh'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:23:55 user nova-compute[72849]: DEBUG nova.objects.instance [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lazy-loading 'flavor' on Instance uuid 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:23:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:23:55 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:23:55 user nova-compute[72849]:   <source dev="/dev/sdh"/>
Aug 15 16:23:55 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:23:55 user nova-compute[72849]:   <serial>b9b7a683-8844-46b6-ba4a-20133c67fb9a</serial>
Aug 15 16:23:55 user nova-compute[72849]: </disk>
Aug 15 16:23:55 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:23:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:23:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:23:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] No VIF found with MAC fa:16:3e:cd:cb:17, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:23:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4de1c6bb-ce61-42d3-b29b-1fc13e21f1c8 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.196s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:56 user nova-compute[72849]: INFO nova.compute.manager [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Terminating instance
Aug 15 16:23:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-64da8c7e-7c66-44b1-b2a2-bbba22523732 req-1b5913f5-f5a1-406c-8a73-48e078d457e3 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received event network-vif-unplugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-64da8c7e-7c66-44b1-b2a2-bbba22523732 req-1b5913f5-f5a1-406c-8a73-48e078d457e3 service nova] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-64da8c7e-7c66-44b1-b2a2-bbba22523732 req-1b5913f5-f5a1-406c-8a73-48e078d457e3 service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-64da8c7e-7c66-44b1-b2a2-bbba22523732 req-1b5913f5-f5a1-406c-8a73-48e078d457e3 service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-64da8c7e-7c66-44b1-b2a2-bbba22523732 req-1b5913f5-f5a1-406c-8a73-48e078d457e3 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] No waiting events found dispatching network-vif-unplugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-64da8c7e-7c66-44b1-b2a2-bbba22523732 req-1b5913f5-f5a1-406c-8a73-48e078d457e3 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received event network-vif-unplugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:23:57 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Instance destroyed successfully.
Aug 15 16:23:57 user nova-compute[72849]: DEBUG nova.objects.instance [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lazy-loading 'resources' on Instance uuid 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-918445447',display_name='tempest-ServerStableDeviceRescueTest-server-918445447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-918445447',id=4,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlOvfVfqg+jJ0bzYqLK8rxyT7IxbPiXMZf2towszTNT8nSCk0Uoj/ulcw2jeQ97uYI95SkThbUeiHUFFMo9IWaJZbAIkib3lSXB42nBCTEgR439byBh1S5hepErtyn5ug==',key_name='tempest-keypair-676744820',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45f8316b45f4418583171fa8691dfe66',ramdisk_id='',reservation_id='r-0l0s337g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-839484866',owner_user_name='tempest-ServerStableDeviceRescueTest-839484866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:22:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0ab3fef694144f39a31c1a17c854bb2',uuid=0c3852fa-b6ac-440f-ae2d-3f482c83b3f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Converting VIF {"id": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "address": "fa:16:3e:04:ca:d5", "network": {"id": "550e2e81-51b2-436e-819b-42379e48b495", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1822369689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45f8316b45f4418583171fa8691dfe66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17db49-50", "ovs_interfaceid": "fc17db49-50e4-4186-af46-e3cbd2dd7677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:ca:d5,bridge_name='br-int',has_traffic_filtering=True,id=fc17db49-50e4-4186-af46-e3cbd2dd7677,network=Network(550e2e81-51b2-436e-819b-42379e48b495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc17db49-50') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG os_vif [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:ca:d5,bridge_name='br-int',has_traffic_filtering=True,id=fc17db49-50e4-4186-af46-e3cbd2dd7677,network=Network(550e2e81-51b2-436e-819b-42379e48b495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc17db49-50') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc17db49-50, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:57 user nova-compute[72849]: INFO os_vif [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:ca:d5,bridge_name='br-int',has_traffic_filtering=True,id=fc17db49-50e4-4186-af46-e3cbd2dd7677,network=Network(550e2e81-51b2-436e-819b-42379e48b495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc17db49-50')
Aug 15 16:23:57 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Deleting instance files /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5_del
Aug 15 16:23:57 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Deletion of /opt/stack/data/nova/instances/0c3852fa-b6ac-440f-ae2d-3f482c83b3f5_del complete
Aug 15 16:23:57 user nova-compute[72849]: INFO nova.compute.manager [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 15 16:23:57 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:23:57 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:23:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:23:59 user nova-compute[72849]: DEBUG nova.compute.manager [req-df9a232a-83f6-4db8-9f32-63610e5c49dd req-e3beafc3-fcd3-4016-806a-48977a83db22 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received event network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-df9a232a-83f6-4db8-9f32-63610e5c49dd req-e3beafc3-fcd3-4016-806a-48977a83db22 service nova] Acquiring lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-df9a232a-83f6-4db8-9f32-63610e5c49dd req-e3beafc3-fcd3-4016-806a-48977a83db22 service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:23:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-df9a232a-83f6-4db8-9f32-63610e5c49dd req-e3beafc3-fcd3-4016-806a-48977a83db22 service nova] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:23:59 user nova-compute[72849]: DEBUG nova.compute.manager [req-df9a232a-83f6-4db8-9f32-63610e5c49dd req-e3beafc3-fcd3-4016-806a-48977a83db22 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] No waiting events found dispatching network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:23:59 user nova-compute[72849]: WARNING nova.compute.manager [req-df9a232a-83f6-4db8-9f32-63610e5c49dd req-e3beafc3-fcd3-4016-806a-48977a83db22 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received unexpected event network-vif-plugged-fc17db49-50e4-4186-af46-e3cbd2dd7677 for instance with vm_state active and task_state deleting.
Aug 15 16:23:59 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:23:59 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Took 2.02 seconds to deallocate network for instance.
Aug 15 16:23:59 user nova-compute[72849]: DEBUG nova.compute.manager [req-212365ea-e377-4c21-ae58-424971f6c9ae req-9b9d2b3e-879b-43fd-abe3-1286e6c9f8b3 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Received event network-vif-deleted-fc17db49-50e4-4186-af46-e3cbd2dd7677 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:23:59 user nova-compute[72849]: INFO nova.compute.manager [req-212365ea-e377-4c21-ae58-424971f6c9ae req-9b9d2b3e-879b-43fd-abe3-1286e6c9f8b3 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Neutron deleted interface fc17db49-50e4-4186-af46-e3cbd2dd7677; detaching it from the instance and deleting it from the info cache
Aug 15 16:23:59 user nova-compute[72849]: DEBUG nova.network.neutron [req-212365ea-e377-4c21-ae58-424971f6c9ae req-9b9d2b3e-879b-43fd-abe3-1286e6c9f8b3 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:23:59 user nova-compute[72849]: DEBUG nova.compute.manager [req-212365ea-e377-4c21-ae58-424971f6c9ae req-9b9d2b3e-879b-43fd-abe3-1286e6c9f8b3 service nova] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Detach interface failed, port_id=fc17db49-50e4-4186-af46-e3cbd2dd7677, reason: Instance 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:23:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:23:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:00 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:24:00 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:24:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:00 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Deleted allocations for instance 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5
Aug 15 16:24:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65d62d81-00e9-44bf-ab81-6b9ba7df29cd tempest-ServerStableDeviceRescueTest-839484866 tempest-ServerStableDeviceRescueTest-839484866-project-member] Lock "0c3852fa-b6ac-440f-ae2d-3f482c83b3f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.614s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquiring lock "e5b383e8-a80b-432c-8239-59f102c45750" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "e5b383e8-a80b-432c-8239-59f102c45750" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:03 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:24:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:03 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:24:03 user nova-compute[72849]: INFO nova.compute.claims [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Claim successful on node user
Aug 15 16:24:04 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG nova.network.neutron [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:24:04 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:24:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG nova.policy [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0209ddf9fde4b71a069c9dfd3513e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c44524588624412a2fe9d7988490479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Acquiring lock "16a347d7-5057-4f06-bac3-98c06c0c66ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "16a347d7-5057-4f06-bac3-98c06c0c66ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:24:04 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Creating image(s)
Aug 15 16:24:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "/opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "/opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:24:04 user nova-compute[72849]: INFO nova.compute.claims [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Claim successful on node user
Aug 15 16:24:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.191s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.185s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/disk 1073741824" returned: 0 in 0.060s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG nova.network.neutron [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Successfully created port: 50094cfd-4c62-49b2-a22d-2dd47d692d57 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.201s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG nova.network.neutron [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Cannot resize image /opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lazy-loading 'migration_context' on Instance uuid e5b383e8-a80b-432c-8239-59f102c45750 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:24:05 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:24:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Ensure instance console log exists: /opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG nova.policy [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a968235f6d66405eaa2ce487ece26ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d441931c8d4d8284f645949c49e2f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:24:05 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Creating image(s)
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Acquiring lock "/opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "/opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "/opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/disk 1073741824" returned: 0 in 0.050s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.network.neutron [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Successfully updated port: 50094cfd-4c62-49b2-a22d-2dd47d692d57 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquiring lock "refresh_cache-e5b383e8-a80b-432c-8239-59f102c45750" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquired lock "refresh_cache-e5b383e8-a80b-432c-8239-59f102c45750" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.network.neutron [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.compute.manager [req-326e2425-60ac-445e-a076-abc24eb2a11b req-976aa318-34a2-43f3-be5a-693324c793c2 service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Received event network-changed-50094cfd-4c62-49b2-a22d-2dd47d692d57 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.compute.manager [req-326e2425-60ac-445e-a076-abc24eb2a11b req-976aa318-34a2-43f3-be5a-693324c793c2 service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Refreshing instance network info cache due to event network-changed-50094cfd-4c62-49b2-a22d-2dd47d692d57. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-326e2425-60ac-445e-a076-abc24eb2a11b req-976aa318-34a2-43f3-be5a-693324c793c2 service nova] Acquiring lock "refresh_cache-e5b383e8-a80b-432c-8239-59f102c45750" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.network.neutron [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.204s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.network.neutron [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Successfully created port: 89824f52-7d54-4e33-a54e-892fae59f451 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Cannot resize image /opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.objects.instance [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lazy-loading 'migration_context' on Instance uuid 16a347d7-5057-4f06-bac3-98c06c0c66ce {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Ensure instance console log exists: /opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.network.neutron [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Updating instance_info_cache with network_info: [{"id": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "address": "fa:16:3e:c5:7a:37", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50094cfd-4c", "ovs_interfaceid": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Releasing lock "refresh_cache-e5b383e8-a80b-432c-8239-59f102c45750" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Instance network_info: |[{"id": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "address": "fa:16:3e:c5:7a:37", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50094cfd-4c", "ovs_interfaceid": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-326e2425-60ac-445e-a076-abc24eb2a11b req-976aa318-34a2-43f3-be5a-693324c793c2 service nova] Acquired lock "refresh_cache-e5b383e8-a80b-432c-8239-59f102c45750" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.network.neutron [req-326e2425-60ac-445e-a076-abc24eb2a11b req-976aa318-34a2-43f3-be5a-693324c793c2 service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Refreshing network info cache for port 50094cfd-4c62-49b2-a22d-2dd47d692d57 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Start _get_guest_xml network_info=[{"id": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "address": "fa:16:3e:c5:7a:37", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50094cfd-4c", "ovs_interfaceid": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:24:06 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:24:06 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:24:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1247722994',display_name='tempest-ServersNegativeTestJSON-server-1247722994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1247722994',id=22,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c44524588624412a2fe9d7988490479',ramdisk_id='',reservation_id='r-avq802w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1396852941',owner_user_name='tempest-ServersNegativeTestJSON-1396852941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:24:05Z,user_data=None,user_id='f0209ddf9fde4b71a069c9dfd3513e7e',uuid=e5b383e8-a80b-432c-8239-59f102c45750,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "address": "fa:16:3e:c5:7a:37", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50094cfd-4c", "ovs_interfaceid": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Converting VIF {"id": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "address": "fa:16:3e:c5:7a:37", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50094cfd-4c", "ovs_interfaceid": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:7a:37,bridge_name='br-int',has_traffic_filtering=True,id=50094cfd-4c62-49b2-a22d-2dd47d692d57,network=Network(8b5ff7d7-7bfc-467c-aae2-eced27be5b87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50094cfd-4c') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lazy-loading 'pci_devices' on Instance uuid e5b383e8-a80b-432c-8239-59f102c45750 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:24:06 user nova-compute[72849]:   <uuid>e5b383e8-a80b-432c-8239-59f102c45750</uuid>
Aug 15 16:24:06 user nova-compute[72849]:   <name>instance-00000016</name>
Aug 15 16:24:06 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:24:06 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:24:06 user nova-compute[72849]:   <metadata>
Aug 15 16:24:06 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:24:06 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:24:06 user nova-compute[72849]:       <nova:name>tempest-ServersNegativeTestJSON-server-1247722994</nova:name>
Aug 15 16:24:06 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:24:06</nova:creationTime>
Aug 15 16:24:06 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:24:06 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:24:06 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:24:06 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:24:06 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:24:06 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:24:06 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:24:06 user nova-compute[72849]:       <nova:owner>
Aug 15 16:24:06 user nova-compute[72849]:         <nova:user uuid="f0209ddf9fde4b71a069c9dfd3513e7e">tempest-ServersNegativeTestJSON-1396852941-project-member</nova:user>
Aug 15 16:24:06 user nova-compute[72849]:         <nova:project uuid="9c44524588624412a2fe9d7988490479">tempest-ServersNegativeTestJSON-1396852941</nova:project>
Aug 15 16:24:06 user nova-compute[72849]:       </nova:owner>
Aug 15 16:24:06 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:24:06 user nova-compute[72849]:       <nova:ports>
Aug 15 16:24:06 user nova-compute[72849]:         <nova:port uuid="50094cfd-4c62-49b2-a22d-2dd47d692d57">
Aug 15 16:24:06 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 16:24:06 user nova-compute[72849]:         </nova:port>
Aug 15 16:24:06 user nova-compute[72849]:       </nova:ports>
Aug 15 16:24:06 user nova-compute[72849]:     </nova:instance>
Aug 15 16:24:06 user nova-compute[72849]:   </metadata>
Aug 15 16:24:06 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:24:06 user nova-compute[72849]:     <system>
Aug 15 16:24:06 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:24:06 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:24:06 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:24:06 user nova-compute[72849]:       <entry name="serial">e5b383e8-a80b-432c-8239-59f102c45750</entry>
Aug 15 16:24:06 user nova-compute[72849]:       <entry name="uuid">e5b383e8-a80b-432c-8239-59f102c45750</entry>
Aug 15 16:24:06 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:24:06 user nova-compute[72849]:     </system>
Aug 15 16:24:06 user nova-compute[72849]:   </sysinfo>
Aug 15 16:24:06 user nova-compute[72849]:   <os>
Aug 15 16:24:06 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:24:06 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:24:06 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:24:06 user nova-compute[72849]:   </os>
Aug 15 16:24:06 user nova-compute[72849]:   <features>
Aug 15 16:24:06 user nova-compute[72849]:     <acpi/>
Aug 15 16:24:06 user nova-compute[72849]:     <apic/>
Aug 15 16:24:06 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:24:06 user nova-compute[72849]:   </features>
Aug 15 16:24:06 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:24:06 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:24:06 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:24:06 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:24:06 user nova-compute[72849]:   </clock>
Aug 15 16:24:06 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:24:06 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:24:06 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:24:06 user nova-compute[72849]:   </cpu>
Aug 15 16:24:06 user nova-compute[72849]:   <devices>
Aug 15 16:24:06 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:24:06 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:24:06 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/disk"/>
Aug 15 16:24:06 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:24:06 user nova-compute[72849]:     </disk>
Aug 15 16:24:06 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:24:06 user nova-compute[72849]:       <mac address="fa:16:3e:c5:7a:37"/>
Aug 15 16:24:06 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:24:06 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:24:06 user nova-compute[72849]:       <target dev="tap50094cfd-4c"/>
Aug 15 16:24:06 user nova-compute[72849]:     </interface>
Aug 15 16:24:06 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:24:06 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/console.log" append="off"/>
Aug 15 16:24:06 user nova-compute[72849]:     </serial>
Aug 15 16:24:06 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:24:06 user nova-compute[72849]:     <video>
Aug 15 16:24:06 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:24:06 user nova-compute[72849]:     </video>
Aug 15 16:24:06 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:24:06 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:24:06 user nova-compute[72849]:     </rng>
Aug 15 16:24:06 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:24:06 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:24:06 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:24:06 user nova-compute[72849]:     </memballoon>
Aug 15 16:24:06 user nova-compute[72849]:   </devices>
Aug 15 16:24:06 user nova-compute[72849]: </domain>
Aug 15 16:24:06 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:24:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1247722994',display_name='tempest-ServersNegativeTestJSON-server-1247722994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1247722994',id=22,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c44524588624412a2fe9d7988490479',ramdisk_id='',reservation_id='r-avq802w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1396852941',owner_user_name='tempest-ServersNegativeTestJSON-1396852941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:24:05Z,user_data=None,user_id='f0209ddf9fde4b71a069c9dfd3513e7e',uuid=e5b383e8-a80b-432c-8239-59f102c45750,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "address": "fa:16:3e:c5:7a:37", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50094cfd-4c", "ovs_interfaceid": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Converting VIF {"id": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "address": "fa:16:3e:c5:7a:37", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50094cfd-4c", "ovs_interfaceid": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:7a:37,bridge_name='br-int',has_traffic_filtering=True,id=50094cfd-4c62-49b2-a22d-2dd47d692d57,network=Network(8b5ff7d7-7bfc-467c-aae2-eced27be5b87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50094cfd-4c') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG os_vif [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:7a:37,bridge_name='br-int',has_traffic_filtering=True,id=50094cfd-4c62-49b2-a22d-2dd47d692d57,network=Network(8b5ff7d7-7bfc-467c-aae2-eced27be5b87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50094cfd-4c') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50094cfd-4c, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50094cfd-4c, col_values=(('external_ids', {'iface-id': '50094cfd-4c62-49b2-a22d-2dd47d692d57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:7a:37', 'vm-uuid': 'e5b383e8-a80b-432c-8239-59f102c45750'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:06 user nova-compute[72849]: INFO os_vif [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:7a:37,bridge_name='br-int',has_traffic_filtering=True,id=50094cfd-4c62-49b2-a22d-2dd47d692d57,network=Network(8b5ff7d7-7bfc-467c-aae2-eced27be5b87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50094cfd-4c')
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:24:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] No VIF found with MAC fa:16:3e:c5:7a:37, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:24:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:07 user nova-compute[72849]: DEBUG nova.network.neutron [req-326e2425-60ac-445e-a076-abc24eb2a11b req-976aa318-34a2-43f3-be5a-693324c793c2 service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Updated VIF entry in instance network info cache for port 50094cfd-4c62-49b2-a22d-2dd47d692d57. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:24:07 user nova-compute[72849]: DEBUG nova.network.neutron [req-326e2425-60ac-445e-a076-abc24eb2a11b req-976aa318-34a2-43f3-be5a-693324c793c2 service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Updating instance_info_cache with network_info: [{"id": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "address": "fa:16:3e:c5:7a:37", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50094cfd-4c", "ovs_interfaceid": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:24:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-326e2425-60ac-445e-a076-abc24eb2a11b req-976aa318-34a2-43f3-be5a-693324c793c2 service nova] Releasing lock "refresh_cache-e5b383e8-a80b-432c-8239-59f102c45750" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:24:07 user nova-compute[72849]: DEBUG nova.network.neutron [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Successfully updated port: 89824f52-7d54-4e33-a54e-892fae59f451 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:24:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Acquiring lock "refresh_cache-16a347d7-5057-4f06-bac3-98c06c0c66ce" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:24:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Acquired lock "refresh_cache-16a347d7-5057-4f06-bac3-98c06c0c66ce" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:24:07 user nova-compute[72849]: DEBUG nova.network.neutron [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-c0d00d14-fe35-4a44-ba30-46c540ee5ace req-943e370b-9847-4c99-a057-5231e09b9e08 service nova] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Received event network-changed-89824f52-7d54-4e33-a54e-892fae59f451 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-c0d00d14-fe35-4a44-ba30-46c540ee5ace req-943e370b-9847-4c99-a057-5231e09b9e08 service nova] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Refreshing instance network info cache due to event network-changed-89824f52-7d54-4e33-a54e-892fae59f451. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c0d00d14-fe35-4a44-ba30-46c540ee5ace req-943e370b-9847-4c99-a057-5231e09b9e08 service nova] Acquiring lock "refresh_cache-16a347d7-5057-4f06-bac3-98c06c0c66ce" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.network.neutron [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-0f4ffe77-24f6-49db-8484-f8be984e8e50 req-3076cf71-dd48-4dc0-bdc4-01476de94b4f service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received event network-changed-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-0f4ffe77-24f6-49db-8484-f8be984e8e50 req-3076cf71-dd48-4dc0-bdc4-01476de94b4f service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Refreshing instance network info cache due to event network-changed-a5ec1882-941b-4bf8-94c2-dd58f74762c6. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0f4ffe77-24f6-49db-8484-f8be984e8e50 req-3076cf71-dd48-4dc0-bdc4-01476de94b4f service nova] Acquiring lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0f4ffe77-24f6-49db-8484-f8be984e8e50 req-3076cf71-dd48-4dc0-bdc4-01476de94b4f service nova] Acquired lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.network.neutron [req-0f4ffe77-24f6-49db-8484-f8be984e8e50 req-3076cf71-dd48-4dc0-bdc4-01476de94b4f service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Refreshing network info cache for port a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.network.neutron [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Updating instance_info_cache with network_info: [{"id": "89824f52-7d54-4e33-a54e-892fae59f451", "address": "fa:16:3e:3e:35:56", "network": {"id": "b65d48cb-aa05-418e-a534-2f96f2533a65", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-823464617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51d441931c8d4d8284f645949c49e2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89824f52-7d", "ovs_interfaceid": "89824f52-7d54-4e33-a54e-892fae59f451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Releasing lock "refresh_cache-16a347d7-5057-4f06-bac3-98c06c0c66ce" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Instance network_info: |[{"id": "89824f52-7d54-4e33-a54e-892fae59f451", "address": "fa:16:3e:3e:35:56", "network": {"id": "b65d48cb-aa05-418e-a534-2f96f2533a65", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-823464617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51d441931c8d4d8284f645949c49e2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89824f52-7d", "ovs_interfaceid": "89824f52-7d54-4e33-a54e-892fae59f451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c0d00d14-fe35-4a44-ba30-46c540ee5ace req-943e370b-9847-4c99-a057-5231e09b9e08 service nova] Acquired lock "refresh_cache-16a347d7-5057-4f06-bac3-98c06c0c66ce" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.network.neutron [req-c0d00d14-fe35-4a44-ba30-46c540ee5ace req-943e370b-9847-4c99-a057-5231e09b9e08 service nova] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Refreshing network info cache for port 89824f52-7d54-4e33-a54e-892fae59f451 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Start _get_guest_xml network_info=[{"id": "89824f52-7d54-4e33-a54e-892fae59f451", "address": "fa:16:3e:3e:35:56", "network": {"id": "b65d48cb-aa05-418e-a534-2f96f2533a65", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-823464617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51d441931c8d4d8284f645949c49e2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89824f52-7d", "ovs_interfaceid": "89824f52-7d54-4e33-a54e-892fae59f451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:24:08 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:24:08 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1823583196',display_name='tempest-DeleteServersTestJSON-server-1823583196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1823583196',id=23,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51d441931c8d4d8284f645949c49e2f1',ramdisk_id='',reservation_id='r-701tr7j1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-850836827',owner_user_name='tempest-DeleteServersTestJSON-850836827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:24:06Z,user_data=None,user_id='a968235f6d66405eaa2ce487ece26ae9',uuid=16a347d7-5057-4f06-bac3-98c06c0c66ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89824f52-7d54-4e33-a54e-892fae59f451", "address": "fa:16:3e:3e:35:56", "network": {"id": "b65d48cb-aa05-418e-a534-2f96f2533a65", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-823464617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51d441931c8d4d8284f645949c49e2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89824f52-7d", "ovs_interfaceid": "89824f52-7d54-4e33-a54e-892fae59f451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Converting VIF {"id": "89824f52-7d54-4e33-a54e-892fae59f451", "address": "fa:16:3e:3e:35:56", "network": {"id": "b65d48cb-aa05-418e-a534-2f96f2533a65", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-823464617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51d441931c8d4d8284f645949c49e2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89824f52-7d", "ovs_interfaceid": "89824f52-7d54-4e33-a54e-892fae59f451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:35:56,bridge_name='br-int',has_traffic_filtering=True,id=89824f52-7d54-4e33-a54e-892fae59f451,network=Network(b65d48cb-aa05-418e-a534-2f96f2533a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89824f52-7d') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.objects.instance [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lazy-loading 'pci_devices' on Instance uuid 16a347d7-5057-4f06-bac3-98c06c0c66ce {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:24:08 user nova-compute[72849]:   <uuid>16a347d7-5057-4f06-bac3-98c06c0c66ce</uuid>
Aug 15 16:24:08 user nova-compute[72849]:   <name>instance-00000017</name>
Aug 15 16:24:08 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:24:08 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:24:08 user nova-compute[72849]:   <metadata>
Aug 15 16:24:08 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:24:08 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:24:08 user nova-compute[72849]:       <nova:name>tempest-DeleteServersTestJSON-server-1823583196</nova:name>
Aug 15 16:24:08 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:24:08</nova:creationTime>
Aug 15 16:24:08 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:24:08 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:24:08 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:24:08 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:24:08 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:24:08 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:24:08 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:24:08 user nova-compute[72849]:       <nova:owner>
Aug 15 16:24:08 user nova-compute[72849]:         <nova:user uuid="a968235f6d66405eaa2ce487ece26ae9">tempest-DeleteServersTestJSON-850836827-project-member</nova:user>
Aug 15 16:24:08 user nova-compute[72849]:         <nova:project uuid="51d441931c8d4d8284f645949c49e2f1">tempest-DeleteServersTestJSON-850836827</nova:project>
Aug 15 16:24:08 user nova-compute[72849]:       </nova:owner>
Aug 15 16:24:08 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:24:08 user nova-compute[72849]:       <nova:ports>
Aug 15 16:24:08 user nova-compute[72849]:         <nova:port uuid="89824f52-7d54-4e33-a54e-892fae59f451">
Aug 15 16:24:08 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 16:24:08 user nova-compute[72849]:         </nova:port>
Aug 15 16:24:08 user nova-compute[72849]:       </nova:ports>
Aug 15 16:24:08 user nova-compute[72849]:     </nova:instance>
Aug 15 16:24:08 user nova-compute[72849]:   </metadata>
Aug 15 16:24:08 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:24:08 user nova-compute[72849]:     <system>
Aug 15 16:24:08 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:24:08 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:24:08 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:24:08 user nova-compute[72849]:       <entry name="serial">16a347d7-5057-4f06-bac3-98c06c0c66ce</entry>
Aug 15 16:24:08 user nova-compute[72849]:       <entry name="uuid">16a347d7-5057-4f06-bac3-98c06c0c66ce</entry>
Aug 15 16:24:08 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:24:08 user nova-compute[72849]:     </system>
Aug 15 16:24:08 user nova-compute[72849]:   </sysinfo>
Aug 15 16:24:08 user nova-compute[72849]:   <os>
Aug 15 16:24:08 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:24:08 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:24:08 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:24:08 user nova-compute[72849]:   </os>
Aug 15 16:24:08 user nova-compute[72849]:   <features>
Aug 15 16:24:08 user nova-compute[72849]:     <acpi/>
Aug 15 16:24:08 user nova-compute[72849]:     <apic/>
Aug 15 16:24:08 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:24:08 user nova-compute[72849]:   </features>
Aug 15 16:24:08 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:24:08 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:24:08 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:24:08 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:24:08 user nova-compute[72849]:   </clock>
Aug 15 16:24:08 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:24:08 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:24:08 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:24:08 user nova-compute[72849]:   </cpu>
Aug 15 16:24:08 user nova-compute[72849]:   <devices>
Aug 15 16:24:08 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:24:08 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:24:08 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/disk"/>
Aug 15 16:24:08 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:24:08 user nova-compute[72849]:     </disk>
Aug 15 16:24:08 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:24:08 user nova-compute[72849]:       <mac address="fa:16:3e:3e:35:56"/>
Aug 15 16:24:08 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:24:08 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:24:08 user nova-compute[72849]:       <target dev="tap89824f52-7d"/>
Aug 15 16:24:08 user nova-compute[72849]:     </interface>
Aug 15 16:24:08 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:24:08 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/console.log" append="off"/>
Aug 15 16:24:08 user nova-compute[72849]:     </serial>
Aug 15 16:24:08 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:24:08 user nova-compute[72849]:     <video>
Aug 15 16:24:08 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:24:08 user nova-compute[72849]:     </video>
Aug 15 16:24:08 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:24:08 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:24:08 user nova-compute[72849]:     </rng>
Aug 15 16:24:08 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:24:08 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:24:08 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:24:08 user nova-compute[72849]:     </memballoon>
Aug 15 16:24:08 user nova-compute[72849]:   </devices>
Aug 15 16:24:08 user nova-compute[72849]: </domain>
Aug 15 16:24:08 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1823583196',display_name='tempest-DeleteServersTestJSON-server-1823583196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1823583196',id=23,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51d441931c8d4d8284f645949c49e2f1',ramdisk_id='',reservation_id='r-701tr7j1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-850836827',owner_user_name='tempest-DeleteServersTestJSON-850836827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:24:06Z,user_data=None,user_id='a968235f6d66405eaa2ce487ece26ae9',uuid=16a347d7-5057-4f06-bac3-98c06c0c66ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89824f52-7d54-4e33-a54e-892fae59f451", "address": "fa:16:3e:3e:35:56", "network": {"id": "b65d48cb-aa05-418e-a534-2f96f2533a65", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-823464617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51d441931c8d4d8284f645949c49e2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89824f52-7d", "ovs_interfaceid": "89824f52-7d54-4e33-a54e-892fae59f451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Converting VIF {"id": "89824f52-7d54-4e33-a54e-892fae59f451", "address": "fa:16:3e:3e:35:56", "network": {"id": "b65d48cb-aa05-418e-a534-2f96f2533a65", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-823464617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51d441931c8d4d8284f645949c49e2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89824f52-7d", "ovs_interfaceid": "89824f52-7d54-4e33-a54e-892fae59f451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:35:56,bridge_name='br-int',has_traffic_filtering=True,id=89824f52-7d54-4e33-a54e-892fae59f451,network=Network(b65d48cb-aa05-418e-a534-2f96f2533a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89824f52-7d') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG os_vif [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:35:56,bridge_name='br-int',has_traffic_filtering=True,id=89824f52-7d54-4e33-a54e-892fae59f451,network=Network(b65d48cb-aa05-418e-a534-2f96f2533a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89824f52-7d') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89824f52-7d, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89824f52-7d, col_values=(('external_ids', {'iface-id': '89824f52-7d54-4e33-a54e-892fae59f451', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:35:56', 'vm-uuid': '16a347d7-5057-4f06-bac3-98c06c0c66ce'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:08 user nova-compute[72849]: INFO os_vif [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:35:56,bridge_name='br-int',has_traffic_filtering=True,id=89824f52-7d54-4e33-a54e-892fae59f451,network=Network(b65d48cb-aa05-418e-a534-2f96f2533a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89824f52-7d')
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:24:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] No VIF found with MAC fa:16:3e:3e:35:56, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:24:09 user nova-compute[72849]: DEBUG nova.network.neutron [req-0f4ffe77-24f6-49db-8484-f8be984e8e50 req-3076cf71-dd48-4dc0-bdc4-01476de94b4f service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Updated VIF entry in instance network info cache for port a5ec1882-941b-4bf8-94c2-dd58f74762c6. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:24:09 user nova-compute[72849]: DEBUG nova.network.neutron [req-0f4ffe77-24f6-49db-8484-f8be984e8e50 req-3076cf71-dd48-4dc0-bdc4-01476de94b4f service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Updating instance_info_cache with network_info: [{"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:24:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0f4ffe77-24f6-49db-8484-f8be984e8e50 req-3076cf71-dd48-4dc0-bdc4-01476de94b4f service nova] Releasing lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:24:09 user nova-compute[72849]: DEBUG nova.network.neutron [req-c0d00d14-fe35-4a44-ba30-46c540ee5ace req-943e370b-9847-4c99-a057-5231e09b9e08 service nova] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Updated VIF entry in instance network info cache for port 89824f52-7d54-4e33-a54e-892fae59f451. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:24:09 user nova-compute[72849]: DEBUG nova.network.neutron [req-c0d00d14-fe35-4a44-ba30-46c540ee5ace req-943e370b-9847-4c99-a057-5231e09b9e08 service nova] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Updating instance_info_cache with network_info: [{"id": "89824f52-7d54-4e33-a54e-892fae59f451", "address": "fa:16:3e:3e:35:56", "network": {"id": "b65d48cb-aa05-418e-a534-2f96f2533a65", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-823464617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51d441931c8d4d8284f645949c49e2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89824f52-7d", "ovs_interfaceid": "89824f52-7d54-4e33-a54e-892fae59f451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:24:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c0d00d14-fe35-4a44-ba30-46c540ee5ace req-943e370b-9847-4c99-a057-5231e09b9e08 service nova] Releasing lock "refresh_cache-16a347d7-5057-4f06-bac3-98c06c0c66ce" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:24:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-00ab7d6a-294d-4e8e-a909-e91f65005531 req-0ce16f39-0fb7-4635-85ae-ec67410ca6d8 service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Received event network-vif-plugged-50094cfd-4c62-49b2-a22d-2dd47d692d57 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:24:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-00ab7d6a-294d-4e8e-a909-e91f65005531 req-0ce16f39-0fb7-4635-85ae-ec67410ca6d8 service nova] Acquiring lock "e5b383e8-a80b-432c-8239-59f102c45750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-00ab7d6a-294d-4e8e-a909-e91f65005531 req-0ce16f39-0fb7-4635-85ae-ec67410ca6d8 service nova] Lock "e5b383e8-a80b-432c-8239-59f102c45750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-00ab7d6a-294d-4e8e-a909-e91f65005531 req-0ce16f39-0fb7-4635-85ae-ec67410ca6d8 service nova] Lock "e5b383e8-a80b-432c-8239-59f102c45750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-00ab7d6a-294d-4e8e-a909-e91f65005531 req-0ce16f39-0fb7-4635-85ae-ec67410ca6d8 service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] No waiting events found dispatching network-vif-plugged-50094cfd-4c62-49b2-a22d-2dd47d692d57 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:24:10 user nova-compute[72849]: WARNING nova.compute.manager [req-00ab7d6a-294d-4e8e-a909-e91f65005531 req-0ce16f39-0fb7-4635-85ae-ec67410ca6d8 service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Received unexpected event network-vif-plugged-50094cfd-4c62-49b2-a22d-2dd47d692d57 for instance with vm_state building and task_state spawning.
Aug 15 16:24:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-00ab7d6a-294d-4e8e-a909-e91f65005531 req-0ce16f39-0fb7-4635-85ae-ec67410ca6d8 service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Received event network-vif-plugged-50094cfd-4c62-49b2-a22d-2dd47d692d57 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:24:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-00ab7d6a-294d-4e8e-a909-e91f65005531 req-0ce16f39-0fb7-4635-85ae-ec67410ca6d8 service nova] Acquiring lock "e5b383e8-a80b-432c-8239-59f102c45750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-00ab7d6a-294d-4e8e-a909-e91f65005531 req-0ce16f39-0fb7-4635-85ae-ec67410ca6d8 service nova] Lock "e5b383e8-a80b-432c-8239-59f102c45750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-00ab7d6a-294d-4e8e-a909-e91f65005531 req-0ce16f39-0fb7-4635-85ae-ec67410ca6d8 service nova] Lock "e5b383e8-a80b-432c-8239-59f102c45750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-00ab7d6a-294d-4e8e-a909-e91f65005531 req-0ce16f39-0fb7-4635-85ae-ec67410ca6d8 service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] No waiting events found dispatching network-vif-plugged-50094cfd-4c62-49b2-a22d-2dd47d692d57 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:24:10 user nova-compute[72849]: WARNING nova.compute.manager [req-00ab7d6a-294d-4e8e-a909-e91f65005531 req-0ce16f39-0fb7-4635-85ae-ec67410ca6d8 service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Received unexpected event network-vif-plugged-50094cfd-4c62-49b2-a22d-2dd47d692d57 for instance with vm_state building and task_state spawning.
Aug 15 16:24:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-8b90690d-a87c-4641-9283-fef6294727de req-75cbde3d-1fca-4faf-bd38-5dcd6d789be0 service nova] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Received event network-vif-plugged-89824f52-7d54-4e33-a54e-892fae59f451 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:24:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8b90690d-a87c-4641-9283-fef6294727de req-75cbde3d-1fca-4faf-bd38-5dcd6d789be0 service nova] Acquiring lock "16a347d7-5057-4f06-bac3-98c06c0c66ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8b90690d-a87c-4641-9283-fef6294727de req-75cbde3d-1fca-4faf-bd38-5dcd6d789be0 service nova] Lock "16a347d7-5057-4f06-bac3-98c06c0c66ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8b90690d-a87c-4641-9283-fef6294727de req-75cbde3d-1fca-4faf-bd38-5dcd6d789be0 service nova] Lock "16a347d7-5057-4f06-bac3-98c06c0c66ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-8b90690d-a87c-4641-9283-fef6294727de req-75cbde3d-1fca-4faf-bd38-5dcd6d789be0 service nova] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] No waiting events found dispatching network-vif-plugged-89824f52-7d54-4e33-a54e-892fae59f451 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:24:10 user nova-compute[72849]: WARNING nova.compute.manager [req-8b90690d-a87c-4641-9283-fef6294727de req-75cbde3d-1fca-4faf-bd38-5dcd6d789be0 service nova] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Received unexpected event network-vif-plugged-89824f52-7d54-4e33-a54e-892fae59f451 for instance with vm_state building and task_state spawning.
Aug 15 16:24:11 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116651.0254848, e5b383e8-a80b-432c-8239-59f102c45750 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:24:11 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: e5b383e8-a80b-432c-8239-59f102c45750] VM Resumed (Lifecycle Event)
Aug 15 16:24:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:24:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:24:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:24:11 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Instance spawned successfully.
Aug 15 16:24:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:24:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:24:11 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: e5b383e8-a80b-432c-8239-59f102c45750] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:24:11 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116651.0265903, e5b383e8-a80b-432c-8239-59f102c45750 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:24:11 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: e5b383e8-a80b-432c-8239-59f102c45750] VM Started (Lifecycle Event)
Aug 15 16:24:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:24:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:24:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:24:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:24:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:24:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:24:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:24:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:24:11 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: e5b383e8-a80b-432c-8239-59f102c45750] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:24:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:11 user nova-compute[72849]: INFO nova.compute.manager [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Took 6.62 seconds to spawn the instance on the hypervisor.
Aug 15 16:24:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:24:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:11 user nova-compute[72849]: INFO nova.compute.manager [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Took 7.44 seconds to build instance.
Aug 15 16:24:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ad57dabc-bee3-4971-b5ec-d171d69d9511 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "e5b383e8-a80b-432c-8239-59f102c45750" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.551s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116637.7397141, 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:24:12 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] VM Stopped (Lifecycle Event)
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-37eb5a51-3302-4682-98f0-d378da7abdfc None None] [instance: 0c3852fa-b6ac-440f-ae2d-3f482c83b3f5] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-a47373db-8210-4577-b42a-7fddf70f49a5 req-588998ce-d7be-48db-a93c-907b5a55f19b service nova] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Received event network-vif-plugged-89824f52-7d54-4e33-a54e-892fae59f451 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a47373db-8210-4577-b42a-7fddf70f49a5 req-588998ce-d7be-48db-a93c-907b5a55f19b service nova] Acquiring lock "16a347d7-5057-4f06-bac3-98c06c0c66ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a47373db-8210-4577-b42a-7fddf70f49a5 req-588998ce-d7be-48db-a93c-907b5a55f19b service nova] Lock "16a347d7-5057-4f06-bac3-98c06c0c66ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a47373db-8210-4577-b42a-7fddf70f49a5 req-588998ce-d7be-48db-a93c-907b5a55f19b service nova] Lock "16a347d7-5057-4f06-bac3-98c06c0c66ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-a47373db-8210-4577-b42a-7fddf70f49a5 req-588998ce-d7be-48db-a93c-907b5a55f19b service nova] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] No waiting events found dispatching network-vif-plugged-89824f52-7d54-4e33-a54e-892fae59f451 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:24:12 user nova-compute[72849]: WARNING nova.compute.manager [req-a47373db-8210-4577-b42a-7fddf70f49a5 req-588998ce-d7be-48db-a93c-907b5a55f19b service nova] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Received unexpected event network-vif-plugged-89824f52-7d54-4e33-a54e-892fae59f451 for instance with vm_state building and task_state spawning.
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-a47373db-8210-4577-b42a-7fddf70f49a5 req-588998ce-d7be-48db-a93c-907b5a55f19b service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received event network-changed-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-a47373db-8210-4577-b42a-7fddf70f49a5 req-588998ce-d7be-48db-a93c-907b5a55f19b service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Refreshing instance network info cache due to event network-changed-a5ec1882-941b-4bf8-94c2-dd58f74762c6. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a47373db-8210-4577-b42a-7fddf70f49a5 req-588998ce-d7be-48db-a93c-907b5a55f19b service nova] Acquiring lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a47373db-8210-4577-b42a-7fddf70f49a5 req-588998ce-d7be-48db-a93c-907b5a55f19b service nova] Acquired lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.network.neutron [req-a47373db-8210-4577-b42a-7fddf70f49a5 req-588998ce-d7be-48db-a93c-907b5a55f19b service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Refreshing network info cache for port a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116652.939493, 16a347d7-5057-4f06-bac3-98c06c0c66ce => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:24:12 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] VM Resumed (Lifecycle Event)
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:24:12 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Instance spawned successfully.
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:24:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:24:13 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:24:13 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116652.939667, 16a347d7-5057-4f06-bac3-98c06c0c66ce => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:24:13 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] VM Started (Lifecycle Event)
Aug 15 16:24:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:24:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:24:13 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:24:13 user nova-compute[72849]: INFO nova.compute.manager [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Took 7.45 seconds to spawn the instance on the hypervisor.
Aug 15 16:24:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:24:13 user nova-compute[72849]: INFO nova.compute.manager [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Took 8.49 seconds to build instance.
Aug 15 16:24:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5be0ffa1-188c-4b1a-b44a-b756d078d8e3 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "16a347d7-5057-4f06-bac3-98c06c0c66ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.606s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:13 user nova-compute[72849]: DEBUG nova.network.neutron [req-a47373db-8210-4577-b42a-7fddf70f49a5 req-588998ce-d7be-48db-a93c-907b5a55f19b service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Updated VIF entry in instance network info cache for port a5ec1882-941b-4bf8-94c2-dd58f74762c6. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:24:13 user nova-compute[72849]: DEBUG nova.network.neutron [req-a47373db-8210-4577-b42a-7fddf70f49a5 req-588998ce-d7be-48db-a93c-907b5a55f19b service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Updating instance_info_cache with network_info: [{"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:24:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a47373db-8210-4577-b42a-7fddf70f49a5 req-588998ce-d7be-48db-a93c-907b5a55f19b service nova] Releasing lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:24:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:19 user nova-compute[72849]: INFO nova.compute.manager [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Rebooting instance
Aug 15 16:24:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:24:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquired lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:24:19 user nova-compute[72849]: DEBUG nova.network.neutron [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:24:20 user nova-compute[72849]: DEBUG nova.network.neutron [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Updating instance_info_cache with network_info: [{"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:24:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Releasing lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:24:20 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:24:20 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:24:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-68b36ed1-8ccc-467c-aee5-a14fe27a3a47 req-5ce79b44-ae2d-4dbe-8e73-2b81c5a30c0e service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received event network-vif-unplugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:24:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-68b36ed1-8ccc-467c-aee5-a14fe27a3a47 req-5ce79b44-ae2d-4dbe-8e73-2b81c5a30c0e service nova] Acquiring lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-68b36ed1-8ccc-467c-aee5-a14fe27a3a47 req-5ce79b44-ae2d-4dbe-8e73-2b81c5a30c0e service nova] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-68b36ed1-8ccc-467c-aee5-a14fe27a3a47 req-5ce79b44-ae2d-4dbe-8e73-2b81c5a30c0e service nova] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-68b36ed1-8ccc-467c-aee5-a14fe27a3a47 req-5ce79b44-ae2d-4dbe-8e73-2b81c5a30c0e service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] No waiting events found dispatching network-vif-unplugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:24:20 user nova-compute[72849]: WARNING nova.compute.manager [req-68b36ed1-8ccc-467c-aee5-a14fe27a3a47 req-5ce79b44-ae2d-4dbe-8e73-2b81c5a30c0e service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received unexpected event network-vif-unplugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 for instance with vm_state active and task_state reboot_started_hard.
Aug 15 16:24:21 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Instance destroyed successfully.
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lazy-loading 'resources' on Instance uuid 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1576542286',display_name='tempest-TestMinimumBasicScenario-server-1576542286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1576542286',id=18,image_ref='e96995a9-02fd-46b4-a493-49c55a019fb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLITvhTIKxyK1vxPra8HPdLGNslu1aZMvggvPZhZAqmN29/j8ALHmk9hr8DlNcPQ6RB8/ui+J8dT3ULem3B9LDvmcgD/X4+LLLqAj30wexD4v1PAuESvTiKNIJpS8gNsA==',key_name='tempest-TestMinimumBasicScenario-1485864520',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:21:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8512a50775b24f798c5cf345f08e0dd2',ramdisk_id='',reservation_id='r-rs5ok5tt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e96995a9-02fd-46b4-a493-49c55a019fb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2032437405',owner_user_name='tempest-TestMinimumBasicScenario-2032437405-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:24:20Z,user_data=None,user_id='d9420a64b5ea462681f3a9c6cf55986c',uuid=7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Converting VIF {"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:cb:17,bridge_name='br-int',has_traffic_filtering=True,id=a5ec1882-941b-4bf8-94c2-dd58f74762c6,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5ec1882-94') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_vif [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:cb:17,bridge_name='br-int',has_traffic_filtering=True,id=a5ec1882-941b-4bf8-94c2-dd58f74762c6,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5ec1882-94') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5ec1882-94, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:21 user nova-compute[72849]: INFO os_vif [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:cb:17,bridge_name='br-int',has_traffic_filtering=True,id=a5ec1882-941b-4bf8-94c2-dd58f74762c6,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5ec1882-94')
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQVqSONK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:24:21 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[15925972-bc03-4663-a4d1-6cd555ebb2fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8f028b-8de1-4b37-aba1-a3307b308138]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:24:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:24:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3582a2200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a'): ({'sdh'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Removing single pathed devices sdh {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52a9d2f-361f-4168-90a5-4c2302efb37c]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.031s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a198fe67-d666-4ca6-a845-ca2bda22287d]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Flushing IO for device /dev/sdh {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc271e7-3317-4ec5-b8bf-f2f0771c10d3]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.052s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea883883-f8b8-4265-b818-48e20dd39591]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] SCSI volumes sdh have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7a0bbf-eb34-4997-8847-712a95c2b650]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d598104d-e05b-44fa-beb6-db4e6e500915]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a, portal: 172.16.0.220,3260]
Aug 15 16:24:21 user nova-compute[72849]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a, portal: 172.16.0.220,3260] successful.
Aug 15 16:24:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0b995e-a17d-40ff-a80a-23707bad5ca7]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] <== disconnect_volume: return (389ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Start _get_guest_xml network_info=[{"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e96995a9-02fd-46b4-a493-49c55a019fb8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'e96995a9-02fd-46b4-a493-49c55a019fb8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQVqSONK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9b7a683-8844-46b6-ba4a-20133c67fb9a', 'serial': 'b9b7a683-8844-46b6-ba4a-20133c67fb9a'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '4bfa2fcc-5f45-4a47-a278-51b07127e725', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:24:21 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:24:21 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e96995a9-02fd-46b4-a493-49c55a019fb8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQVqSONK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:24:21 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:24:21 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:24:21 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fa7187-4176-4449-a9ba-02d60274ce56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:24:21 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ae84cd-9e71-4dfd-804a-9b4cd8790190]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a] added
Aug 15 16:24:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[283ef154-c017-47a6-a7ac-f87dec42d0dd]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[09889f01-c418-4b20-85c3-049d28ea2c17]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hQVqSONK {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hQVqSONK" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a639c9be-cab2-4404-bfe2-168fbd8460cf]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hQVqSONK'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab72511c-0271-4a07-b9e9-b720c47d01da]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d991e6f-5e99-4be5-bdac-4c1e1809e130]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)
Aug 15 16:24:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:24:21 user nova-compute[72849]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)
Aug 15 16:24:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:24:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[104517bf-009e-454d-aadc-b4a7daf5556c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a, portal: 172.16.0.220,3260]
Aug 15 16:24:22 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a, portal: 172.16.0.220,3260] successful.
Aug 15 16:24:22 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc552a99-2fd5-4122-8cf9-8bf0235a12f9]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c1c9c7-fada-4ef0-b5c7-25d9978aef7b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:24:22 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:24:22 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:24:22 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:24:22 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:24:22 user nova-compute[72849]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)
Aug 15 16:24:22 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:24:22 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:24:22 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:24:22 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:24:22 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:24:22 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:24:22 user nova-compute[72849]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)
Aug 15 16:24:22 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:24:22 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] HCTL ('39', '-', '-', 0) found on session 24 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b803ec-86c3-44af-99a3-fc8b8d1b5751]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Searching for a device in session 24 and hctl ['39', '*', '*', 0] yield: None {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-efe3211a-f4a3-4956-b3df-2555b4ecba6a req-60f2f9b3-0962-4180-8fac-ef1b77b67174 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received event network-vif-plugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-efe3211a-f4a3-4956-b3df-2555b4ecba6a req-60f2f9b3-0962-4180-8fac-ef1b77b67174 service nova] Acquiring lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-efe3211a-f4a3-4956-b3df-2555b4ecba6a req-60f2f9b3-0962-4180-8fac-ef1b77b67174 service nova] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-efe3211a-f4a3-4956-b3df-2555b4ecba6a req-60f2f9b3-0962-4180-8fac-ef1b77b67174 service nova] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-efe3211a-f4a3-4956-b3df-2555b4ecba6a req-60f2f9b3-0962-4180-8fac-ef1b77b67174 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] No waiting events found dispatching network-vif-plugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:24:22 user nova-compute[72849]: WARNING nova.compute.manager [req-efe3211a-f4a3-4956-b3df-2555b4ecba6a req-60f2f9b3-0962-4180-8fac-ef1b77b67174 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received unexpected event network-vif-plugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 for instance with vm_state active and task_state reboot_started_hard.
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Searching for a device in session 24 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQVqSONK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23865366565373738', 'path': '/dev/sdh'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865366565373738', 'path': '/dev/sdh'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1576542286',display_name='tempest-TestMinimumBasicScenario-server-1576542286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1576542286',id=18,image_ref='e96995a9-02fd-46b4-a493-49c55a019fb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLITvhTIKxyK1vxPra8HPdLGNslu1aZMvggvPZhZAqmN29/j8ALHmk9hr8DlNcPQ6RB8/ui+J8dT3ULem3B9LDvmcgD/X4+LLLqAj30wexD4v1PAuESvTiKNIJpS8gNsA==',key_name='tempest-TestMinimumBasicScenario-1485864520',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:21:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8512a50775b24f798c5cf345f08e0dd2',ramdisk_id='',reservation_id='r-rs5ok5tt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e96995a9-02fd-46b4-a493-49c55a019fb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2032437405',owner_user_name='tempest-TestMinimumBasicScenario-2032437405-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:24:20Z,user_data=None,user_id='d9420a64b5ea462681f3a9c6cf55986c',uuid=7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Converting VIF {"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:cb:17,bridge_name='br-int',has_traffic_filtering=True,id=a5ec1882-941b-4bf8-94c2-dd58f74762c6,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5ec1882-94') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:24:23 user nova-compute[72849]:   <uuid>7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff</uuid>
Aug 15 16:24:23 user nova-compute[72849]:   <name>instance-00000012</name>
Aug 15 16:24:23 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:24:23 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:24:23 user nova-compute[72849]:   <metadata>
Aug 15 16:24:23 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:24:23 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:24:23 user nova-compute[72849]:       <nova:name>tempest-TestMinimumBasicScenario-server-1576542286</nova:name>
Aug 15 16:24:23 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:24:21</nova:creationTime>
Aug 15 16:24:23 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:24:23 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:24:23 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:24:23 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:24:23 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:24:23 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:24:23 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:24:23 user nova-compute[72849]:       <nova:owner>
Aug 15 16:24:23 user nova-compute[72849]:         <nova:user uuid="d9420a64b5ea462681f3a9c6cf55986c">tempest-TestMinimumBasicScenario-2032437405-project-member</nova:user>
Aug 15 16:24:23 user nova-compute[72849]:         <nova:project uuid="8512a50775b24f798c5cf345f08e0dd2">tempest-TestMinimumBasicScenario-2032437405</nova:project>
Aug 15 16:24:23 user nova-compute[72849]:       </nova:owner>
Aug 15 16:24:23 user nova-compute[72849]:       <nova:root type="image" uuid="e96995a9-02fd-46b4-a493-49c55a019fb8"/>
Aug 15 16:24:23 user nova-compute[72849]:       <nova:ports>
Aug 15 16:24:23 user nova-compute[72849]:         <nova:port uuid="a5ec1882-941b-4bf8-94c2-dd58f74762c6">
Aug 15 16:24:23 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:24:23 user nova-compute[72849]:         </nova:port>
Aug 15 16:24:23 user nova-compute[72849]:       </nova:ports>
Aug 15 16:24:23 user nova-compute[72849]:     </nova:instance>
Aug 15 16:24:23 user nova-compute[72849]:   </metadata>
Aug 15 16:24:23 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:24:23 user nova-compute[72849]:     <system>
Aug 15 16:24:23 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:24:23 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:24:23 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:24:23 user nova-compute[72849]:       <entry name="serial">7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff</entry>
Aug 15 16:24:23 user nova-compute[72849]:       <entry name="uuid">7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff</entry>
Aug 15 16:24:23 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:24:23 user nova-compute[72849]:     </system>
Aug 15 16:24:23 user nova-compute[72849]:   </sysinfo>
Aug 15 16:24:23 user nova-compute[72849]:   <os>
Aug 15 16:24:23 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:24:23 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:24:23 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:24:23 user nova-compute[72849]:   </os>
Aug 15 16:24:23 user nova-compute[72849]:   <features>
Aug 15 16:24:23 user nova-compute[72849]:     <acpi/>
Aug 15 16:24:23 user nova-compute[72849]:     <apic/>
Aug 15 16:24:23 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:24:23 user nova-compute[72849]:   </features>
Aug 15 16:24:23 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:24:23 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:24:23 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:24:23 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:24:23 user nova-compute[72849]:   </clock>
Aug 15 16:24:23 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:24:23 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:24:23 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:24:23 user nova-compute[72849]:   </cpu>
Aug 15 16:24:23 user nova-compute[72849]:   <devices>
Aug 15 16:24:23 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:24:23 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:24:23 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk"/>
Aug 15 16:24:23 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:24:23 user nova-compute[72849]:     </disk>
Aug 15 16:24:23 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:24:23 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:24:23 user nova-compute[72849]:       <source dev="/dev/sdh"/>
Aug 15 16:24:23 user nova-compute[72849]:       <target dev="vdb" bus="virtio"/>
Aug 15 16:24:23 user nova-compute[72849]:       <serial>b9b7a683-8844-46b6-ba4a-20133c67fb9a</serial>
Aug 15 16:24:23 user nova-compute[72849]:     </disk>
Aug 15 16:24:23 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:24:23 user nova-compute[72849]:       <mac address="fa:16:3e:cd:cb:17"/>
Aug 15 16:24:23 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:24:23 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:24:23 user nova-compute[72849]:       <target dev="tapa5ec1882-94"/>
Aug 15 16:24:23 user nova-compute[72849]:     </interface>
Aug 15 16:24:23 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:24:23 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/console.log" append="off"/>
Aug 15 16:24:23 user nova-compute[72849]:     </serial>
Aug 15 16:24:23 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:24:23 user nova-compute[72849]:     <video>
Aug 15 16:24:23 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:24:23 user nova-compute[72849]:     </video>
Aug 15 16:24:23 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:24:23 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:24:23 user nova-compute[72849]:     </rng>
Aug 15 16:24:23 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:24:23 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:24:23 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:24:23 user nova-compute[72849]:     </memballoon>
Aug 15 16:24:23 user nova-compute[72849]:   </devices>
Aug 15 16:24:23 user nova-compute[72849]: </domain>
Aug 15 16:24:23 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.248s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd --force-share --output=json" returned: 0 in 0.195s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:24:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Cannot resize image /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lazy-loading 'migration_context' on Instance uuid 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1576542286',display_name='tempest-TestMinimumBasicScenario-server-1576542286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1576542286',id=18,image_ref='e96995a9-02fd-46b4-a493-49c55a019fb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLITvhTIKxyK1vxPra8HPdLGNslu1aZMvggvPZhZAqmN29/j8ALHmk9hr8DlNcPQ6RB8/ui+J8dT3ULem3B9LDvmcgD/X4+LLLqAj30wexD4v1PAuESvTiKNIJpS8gNsA==',key_name='tempest-TestMinimumBasicScenario-1485864520',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:21:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='8512a50775b24f798c5cf345f08e0dd2',ramdisk_id='',reservation_id='r-rs5ok5tt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e96995a9-02fd-46b4-a493-49c55a019fb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2032437405',owner_user_name='tempest-TestMinimumBasicScenario-2032437405-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:24:20Z,user_data=None,user_id='d9420a64b5ea462681f3a9c6cf55986c',uuid=7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Converting VIF {"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:cb:17,bridge_name='br-int',has_traffic_filtering=True,id=a5ec1882-941b-4bf8-94c2-dd58f74762c6,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5ec1882-94') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG os_vif [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:cb:17,bridge_name='br-int',has_traffic_filtering=True,id=a5ec1882-941b-4bf8-94c2-dd58f74762c6,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5ec1882-94') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5ec1882-94, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa5ec1882-94, col_values=(('external_ids', {'iface-id': 'a5ec1882-941b-4bf8-94c2-dd58f74762c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:cb:17', 'vm-uuid': '7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:24 user nova-compute[72849]: INFO os_vif [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:cb:17,bridge_name='br-int',has_traffic_filtering=True,id=a5ec1882-941b-4bf8-94c2-dd58f74762c6,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5ec1882-94')
Aug 15 16:24:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-55282809-6a08-4707-8087-b5c7ada7327d req-b6c9958f-b4ba-42a2-a8d3-1afc40716a79 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received event network-vif-plugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:24:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-55282809-6a08-4707-8087-b5c7ada7327d req-b6c9958f-b4ba-42a2-a8d3-1afc40716a79 service nova] Acquiring lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-55282809-6a08-4707-8087-b5c7ada7327d req-b6c9958f-b4ba-42a2-a8d3-1afc40716a79 service nova] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-55282809-6a08-4707-8087-b5c7ada7327d req-b6c9958f-b4ba-42a2-a8d3-1afc40716a79 service nova] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-55282809-6a08-4707-8087-b5c7ada7327d req-b6c9958f-b4ba-42a2-a8d3-1afc40716a79 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] No waiting events found dispatching network-vif-plugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:24:25 user nova-compute[72849]: WARNING nova.compute.manager [req-55282809-6a08-4707-8087-b5c7ada7327d req-b6c9958f-b4ba-42a2-a8d3-1afc40716a79 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received unexpected event network-vif-plugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 for instance with vm_state active and task_state reboot_started_hard.
Aug 15 16:24:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:24:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:24:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:24:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Removed pending event for 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff due to event {{(pid=72849) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116667.9929478, 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:24:28 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] VM Resumed (Lifecycle Event)
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.manager [req-25a52d3c-1fc8-4c38-a492-3d3c1b0f15a3 req-0d85e24c-776d-4c2c-bda7-be2453062c76 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received event network-vif-plugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-25a52d3c-1fc8-4c38-a492-3d3c1b0f15a3 req-0d85e24c-776d-4c2c-bda7-be2453062c76 service nova] Acquiring lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-25a52d3c-1fc8-4c38-a492-3d3c1b0f15a3 req-0d85e24c-776d-4c2c-bda7-be2453062c76 service nova] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-25a52d3c-1fc8-4c38-a492-3d3c1b0f15a3 req-0d85e24c-776d-4c2c-bda7-be2453062c76 service nova] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.manager [req-25a52d3c-1fc8-4c38-a492-3d3c1b0f15a3 req-0d85e24c-776d-4c2c-bda7-be2453062c76 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] No waiting events found dispatching network-vif-plugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:24:28 user nova-compute[72849]: WARNING nova.compute.manager [req-25a52d3c-1fc8-4c38-a492-3d3c1b0f15a3 req-0d85e24c-776d-4c2c-bda7-be2453062c76 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received unexpected event network-vif-plugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 for instance with vm_state active and task_state reboot_started_hard.
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:24:28 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Instance rebooted successfully.
Aug 15 16:24:28 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:24:28 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=6849MB free_disk=25.320281982421875GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:24:28 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116667.9941468, 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:24:28 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] VM Started (Lifecycle Event)
Aug 15 16:24:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7c028770-5114-4cc5-a6bb-16df0ced56a2 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.595s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 052cde29-421b-4b17-9bcd-acd58456ddba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc521d87-09aa-44ba-a87c-1cd5517b3707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 46f0aa43-e313-4aff-bacc-aa5290193b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b0a869eb-9ee8-4c31-9786-5b8be7d362a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance a3221960-e5ff-4185-a5dd-09f2cd293cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 49874ea8-8d01-4de6-a3cc-fc35af67665e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 25db7eb1-fa77-4342-922c-4f82f8f27702 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance e5b383e8-a80b-432c-8239-59f102c45750 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 16a347d7-5057-4f06-bac3-98c06c0c66ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:24:28 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:24:29 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:24:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.828s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:24:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:30 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:24:30 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:24:30 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:24:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:24:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:24:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:24:30 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:24:30 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Updating instance_info_cache with network_info: [{"id": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "address": "fa:16:3e:15:be:6e", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d74bc-a2", "ovs_interfaceid": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:24:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:24:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:24:30 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:24:30 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:24:30 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:24:30 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:24:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:24:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:24:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "d51623f1-6613-41d6-abcb-9e4e626a97af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "d51623f1-6613-41d6-abcb-9e4e626a97af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:01 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:25:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:01 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:25:01 user nova-compute[72849]: INFO nova.compute.claims [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Claim successful on node user
Aug 15 16:25:01 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG nova.network.neutron [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:25:02 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:25:02 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG nova.policy [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd6279423b7f43c4aac7956aec43efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51f800c0ca74e149a2f8ed9718b221f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:25:02 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Creating image(s)
Aug 15 16:25:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "/opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "/opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "/opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.186s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk 1073741824" returned: 0 in 0.048s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.175s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:25:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:03 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Cannot resize image /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:25:03 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'migration_context' on Instance uuid d51623f1-6613-41d6-abcb-9e4e626a97af {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:03 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:25:03 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Ensure instance console log exists: /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:25:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:03 user nova-compute[72849]: DEBUG nova.network.neutron [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Successfully created port: fbe64b8c-04d1-40d1-9b24-f3f021c282aa {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:25:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.network.neutron [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Successfully updated port: fbe64b8c-04d1-40d1-9b24-f3f021c282aa {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "refresh_cache-d51623f1-6613-41d6-abcb-9e4e626a97af" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquired lock "refresh_cache-d51623f1-6613-41d6-abcb-9e4e626a97af" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.network.neutron [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-8e9db299-a19f-4647-bc47-32d7ce9873e0 req-f60011c4-fa82-4cfd-986d-c0bcb56708ac service nova] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Received event network-changed-fbe64b8c-04d1-40d1-9b24-f3f021c282aa {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-8e9db299-a19f-4647-bc47-32d7ce9873e0 req-f60011c4-fa82-4cfd-986d-c0bcb56708ac service nova] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Refreshing instance network info cache due to event network-changed-fbe64b8c-04d1-40d1-9b24-f3f021c282aa. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8e9db299-a19f-4647-bc47-32d7ce9873e0 req-f60011c4-fa82-4cfd-986d-c0bcb56708ac service nova] Acquiring lock "refresh_cache-d51623f1-6613-41d6-abcb-9e4e626a97af" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.network.neutron [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-d042baae-eb83-4200-86d9-094c3778eda3 req-da8a9be0-45bf-44c3-aa65-5181fdf0635f service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Received event network-changed-bb502cd2-eea4-4ce2-8cd2-98fd80832595 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-d042baae-eb83-4200-86d9-094c3778eda3 req-da8a9be0-45bf-44c3-aa65-5181fdf0635f service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Refreshing instance network info cache due to event network-changed-bb502cd2-eea4-4ce2-8cd2-98fd80832595. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d042baae-eb83-4200-86d9-094c3778eda3 req-da8a9be0-45bf-44c3-aa65-5181fdf0635f service nova] Acquiring lock "refresh_cache-25db7eb1-fa77-4342-922c-4f82f8f27702" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d042baae-eb83-4200-86d9-094c3778eda3 req-da8a9be0-45bf-44c3-aa65-5181fdf0635f service nova] Acquired lock "refresh_cache-25db7eb1-fa77-4342-922c-4f82f8f27702" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.network.neutron [req-d042baae-eb83-4200-86d9-094c3778eda3 req-da8a9be0-45bf-44c3-aa65-5181fdf0635f service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Refreshing network info cache for port bb502cd2-eea4-4ce2-8cd2-98fd80832595 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.network.neutron [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Updating instance_info_cache with network_info: [{"id": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "address": "fa:16:3e:a9:be:c7", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe64b8c-04", "ovs_interfaceid": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Releasing lock "refresh_cache-d51623f1-6613-41d6-abcb-9e4e626a97af" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Instance network_info: |[{"id": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "address": "fa:16:3e:a9:be:c7", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe64b8c-04", "ovs_interfaceid": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8e9db299-a19f-4647-bc47-32d7ce9873e0 req-f60011c4-fa82-4cfd-986d-c0bcb56708ac service nova] Acquired lock "refresh_cache-d51623f1-6613-41d6-abcb-9e4e626a97af" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.network.neutron [req-8e9db299-a19f-4647-bc47-32d7ce9873e0 req-f60011c4-fa82-4cfd-986d-c0bcb56708ac service nova] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Refreshing network info cache for port fbe64b8c-04d1-40d1-9b24-f3f021c282aa {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Start _get_guest_xml network_info=[{"id": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "address": "fa:16:3e:a9:be:c7", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe64b8c-04", "ovs_interfaceid": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "25db7eb1-fa77-4342-922c-4f82f8f27702" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.objects.instance [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lazy-loading 'flavor' on Instance uuid 25db7eb1-fa77-4342-922c-4f82f8f27702 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:05 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:25:05 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1019432305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1019432305',id=24,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f51f800c0ca74e149a2f8ed9718b221f',ramdisk_id='',reservation_id='r-m9ldc7ly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:25:02Z,user_data=None,user_id='cd6279423b7f43c4aac7956aec43efdd',uuid=d51623f1-6613-41d6-abcb-9e4e626a97af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "address": "fa:16:3e:a9:be:c7", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe64b8c-04", "ovs_interfaceid": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converting VIF {"id": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "address": "fa:16:3e:a9:be:c7", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe64b8c-04", "ovs_interfaceid": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:be:c7,bridge_name='br-int',has_traffic_filtering=True,id=fbe64b8c-04d1-40d1-9b24-f3f021c282aa,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe64b8c-04') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'pci_devices' on Instance uuid d51623f1-6613-41d6-abcb-9e4e626a97af {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:05 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Ignoring supplied device name: /dev/vdb
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:25:05 user nova-compute[72849]:   <uuid>d51623f1-6613-41d6-abcb-9e4e626a97af</uuid>
Aug 15 16:25:05 user nova-compute[72849]:   <name>instance-00000018</name>
Aug 15 16:25:05 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:25:05 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:25:05 user nova-compute[72849]:   <metadata>
Aug 15 16:25:05 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:25:05 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:25:05 user nova-compute[72849]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1019432305</nova:name>
Aug 15 16:25:05 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:25:05</nova:creationTime>
Aug 15 16:25:05 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:25:05 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:25:05 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:25:05 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:25:05 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:25:05 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:25:05 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:25:05 user nova-compute[72849]:       <nova:owner>
Aug 15 16:25:05 user nova-compute[72849]:         <nova:user uuid="cd6279423b7f43c4aac7956aec43efdd">tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member</nova:user>
Aug 15 16:25:05 user nova-compute[72849]:         <nova:project uuid="f51f800c0ca74e149a2f8ed9718b221f">tempest-ServerBootFromVolumeStableRescueTest-1207284584</nova:project>
Aug 15 16:25:05 user nova-compute[72849]:       </nova:owner>
Aug 15 16:25:05 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:25:05 user nova-compute[72849]:       <nova:ports>
Aug 15 16:25:05 user nova-compute[72849]:         <nova:port uuid="fbe64b8c-04d1-40d1-9b24-f3f021c282aa">
Aug 15 16:25:05 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 16:25:05 user nova-compute[72849]:         </nova:port>
Aug 15 16:25:05 user nova-compute[72849]:       </nova:ports>
Aug 15 16:25:05 user nova-compute[72849]:     </nova:instance>
Aug 15 16:25:05 user nova-compute[72849]:   </metadata>
Aug 15 16:25:05 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:25:05 user nova-compute[72849]:     <system>
Aug 15 16:25:05 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:25:05 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:25:05 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:25:05 user nova-compute[72849]:       <entry name="serial">d51623f1-6613-41d6-abcb-9e4e626a97af</entry>
Aug 15 16:25:05 user nova-compute[72849]:       <entry name="uuid">d51623f1-6613-41d6-abcb-9e4e626a97af</entry>
Aug 15 16:25:05 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:25:05 user nova-compute[72849]:     </system>
Aug 15 16:25:05 user nova-compute[72849]:   </sysinfo>
Aug 15 16:25:05 user nova-compute[72849]:   <os>
Aug 15 16:25:05 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:25:05 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:25:05 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:25:05 user nova-compute[72849]:   </os>
Aug 15 16:25:05 user nova-compute[72849]:   <features>
Aug 15 16:25:05 user nova-compute[72849]:     <acpi/>
Aug 15 16:25:05 user nova-compute[72849]:     <apic/>
Aug 15 16:25:05 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:25:05 user nova-compute[72849]:   </features>
Aug 15 16:25:05 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:25:05 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:25:05 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:25:05 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:25:05 user nova-compute[72849]:   </clock>
Aug 15 16:25:05 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:25:05 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:25:05 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:25:05 user nova-compute[72849]:   </cpu>
Aug 15 16:25:05 user nova-compute[72849]:   <devices>
Aug 15 16:25:05 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:25:05 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:25:05 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk"/>
Aug 15 16:25:05 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:25:05 user nova-compute[72849]:     </disk>
Aug 15 16:25:05 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:25:05 user nova-compute[72849]:       <mac address="fa:16:3e:a9:be:c7"/>
Aug 15 16:25:05 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:25:05 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:25:05 user nova-compute[72849]:       <target dev="tapfbe64b8c-04"/>
Aug 15 16:25:05 user nova-compute[72849]:     </interface>
Aug 15 16:25:05 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:25:05 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/console.log" append="off"/>
Aug 15 16:25:05 user nova-compute[72849]:     </serial>
Aug 15 16:25:05 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:25:05 user nova-compute[72849]:     <video>
Aug 15 16:25:05 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:25:05 user nova-compute[72849]:     </video>
Aug 15 16:25:05 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:25:05 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:25:05 user nova-compute[72849]:     </rng>
Aug 15 16:25:05 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:25:05 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:25:05 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:25:05 user nova-compute[72849]:     </memballoon>
Aug 15 16:25:05 user nova-compute[72849]:   </devices>
Aug 15 16:25:05 user nova-compute[72849]: </domain>
Aug 15 16:25:05 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1019432305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1019432305',id=24,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f51f800c0ca74e149a2f8ed9718b221f',ramdisk_id='',reservation_id='r-m9ldc7ly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:25:02Z,user_data=None,user_id='cd6279423b7f43c4aac7956aec43efdd',uuid=d51623f1-6613-41d6-abcb-9e4e626a97af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "address": "fa:16:3e:a9:be:c7", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe64b8c-04", "ovs_interfaceid": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converting VIF {"id": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "address": "fa:16:3e:a9:be:c7", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe64b8c-04", "ovs_interfaceid": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:be:c7,bridge_name='br-int',has_traffic_filtering=True,id=fbe64b8c-04d1-40d1-9b24-f3f021c282aa,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe64b8c-04') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG os_vif [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:be:c7,bridge_name='br-int',has_traffic_filtering=True,id=fbe64b8c-04d1-40d1-9b24-f3f021c282aa,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe64b8c-04') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbe64b8c-04, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfbe64b8c-04, col_values=(('external_ids', {'iface-id': 'fbe64b8c-04d1-40d1-9b24-f3f021c282aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:be:c7', 'vm-uuid': 'd51623f1-6613-41d6-abcb-9e4e626a97af'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:25:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:05 user nova-compute[72849]: INFO os_vif [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:be:c7,bridge_name='br-int',has_traffic_filtering=True,id=fbe64b8c-04d1-40d1-9b24-f3f021c282aa,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe64b8c-04')
Aug 15 16:25:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] No VIF found with MAC fa:16:3e:a9:be:c7, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "25db7eb1-fa77-4342-922c-4f82f8f27702" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:06 user nova-compute[72849]: INFO nova.compute.manager [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Attaching volume fe4bed5d-d574-405f-bad4-26a6df0509d4 to /dev/vdb
Aug 15 16:25:06 user nova-compute[72849]: DEBUG os_brick.utils [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb362fce-6f28-4a27-bb81-11587001182e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e1e125-f424-4365-add3-0f1538ce0440]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5792a1f0-f8ad-48f9-bc19-e3f29f9008ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[53229f4b-87df-437f-a877-d38a4f08158a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:25:06 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:25:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb12811b-66fb-48a9-b73e-a6d99de424c0]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG os_brick.utils [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Updating existing volume attachment record: abcdf260-7cc7-48a1-af0f-287248f4a349 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG nova.network.neutron [req-8e9db299-a19f-4647-bc47-32d7ce9873e0 req-f60011c4-fa82-4cfd-986d-c0bcb56708ac service nova] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Updated VIF entry in instance network info cache for port fbe64b8c-04d1-40d1-9b24-f3f021c282aa. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG nova.network.neutron [req-8e9db299-a19f-4647-bc47-32d7ce9873e0 req-f60011c4-fa82-4cfd-986d-c0bcb56708ac service nova] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Updating instance_info_cache with network_info: [{"id": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "address": "fa:16:3e:a9:be:c7", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe64b8c-04", "ovs_interfaceid": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:25:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8e9db299-a19f-4647-bc47-32d7ce9873e0 req-f60011c4-fa82-4cfd-986d-c0bcb56708ac service nova] Releasing lock "refresh_cache-d51623f1-6613-41d6-abcb-9e4e626a97af" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:25:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-1dd1cb7e-693d-4d65-8caa-08d87d228854 req-87594edc-790a-47fe-9f6e-893b50193180 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-changed-ba545c48-7768-4efb-ac4d-d4221464afaf {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-1dd1cb7e-693d-4d65-8caa-08d87d228854 req-87594edc-790a-47fe-9f6e-893b50193180 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Refreshing instance network info cache due to event network-changed-ba545c48-7768-4efb-ac4d-d4221464afaf. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:25:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1dd1cb7e-693d-4d65-8caa-08d87d228854 req-87594edc-790a-47fe-9f6e-893b50193180 service nova] Acquiring lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:25:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1dd1cb7e-693d-4d65-8caa-08d87d228854 req-87594edc-790a-47fe-9f6e-893b50193180 service nova] Acquired lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:25:07 user nova-compute[72849]: DEBUG nova.network.neutron [req-1dd1cb7e-693d-4d65-8caa-08d87d228854 req-87594edc-790a-47fe-9f6e-893b50193180 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Refreshing network info cache for port ba545c48-7768-4efb-ac4d-d4221464afaf {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:25:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:07 user nova-compute[72849]: DEBUG nova.network.neutron [req-d042baae-eb83-4200-86d9-094c3778eda3 req-da8a9be0-45bf-44c3-aa65-5181fdf0635f service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Updated VIF entry in instance network info cache for port bb502cd2-eea4-4ce2-8cd2-98fd80832595. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:25:07 user nova-compute[72849]: DEBUG nova.network.neutron [req-d042baae-eb83-4200-86d9-094c3778eda3 req-da8a9be0-45bf-44c3-aa65-5181fdf0635f service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Updating instance_info_cache with network_info: [{"id": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "address": "fa:16:3e:85:7c:de", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb502cd2-ee", "ovs_interfaceid": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:25:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d042baae-eb83-4200-86d9-094c3778eda3 req-da8a9be0-45bf-44c3-aa65-5181fdf0635f service nova] Releasing lock "refresh_cache-25db7eb1-fa77-4342-922c-4f82f8f27702" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:25:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-6c5e0789-21f4-4375-9daf-f54846a1b8b5 req-5ac48c33-e53c-49ba-8460-644edf76260b service nova] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Received event network-vif-plugged-fbe64b8c-04d1-40d1-9b24-f3f021c282aa {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6c5e0789-21f4-4375-9daf-f54846a1b8b5 req-5ac48c33-e53c-49ba-8460-644edf76260b service nova] Acquiring lock "d51623f1-6613-41d6-abcb-9e4e626a97af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6c5e0789-21f4-4375-9daf-f54846a1b8b5 req-5ac48c33-e53c-49ba-8460-644edf76260b service nova] Lock "d51623f1-6613-41d6-abcb-9e4e626a97af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6c5e0789-21f4-4375-9daf-f54846a1b8b5 req-5ac48c33-e53c-49ba-8460-644edf76260b service nova] Lock "d51623f1-6613-41d6-abcb-9e4e626a97af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-6c5e0789-21f4-4375-9daf-f54846a1b8b5 req-5ac48c33-e53c-49ba-8460-644edf76260b service nova] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] No waiting events found dispatching network-vif-plugged-fbe64b8c-04d1-40d1-9b24-f3f021c282aa {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:08 user nova-compute[72849]: WARNING nova.compute.manager [req-6c5e0789-21f4-4375-9daf-f54846a1b8b5 req-5ac48c33-e53c-49ba-8460-644edf76260b service nova] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Received unexpected event network-vif-plugged-fbe64b8c-04d1-40d1-9b24-f3f021c282aa for instance with vm_state building and task_state spawning.
Aug 15 16:25:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:08 user nova-compute[72849]: DEBUG nova.network.neutron [req-1dd1cb7e-693d-4d65-8caa-08d87d228854 req-87594edc-790a-47fe-9f6e-893b50193180 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updated VIF entry in instance network info cache for port ba545c48-7768-4efb-ac4d-d4221464afaf. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:25:08 user nova-compute[72849]: DEBUG nova.network.neutron [req-1dd1cb7e-693d-4d65-8caa-08d87d228854 req-87594edc-790a-47fe-9f6e-893b50193180 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updating instance_info_cache with network_info: [{"id": "ba545c48-7768-4efb-ac4d-d4221464afaf", "address": "fa:16:3e:35:31:31", "network": {"id": "921f34cb-0177-4df4-8312-859dbdb9f7e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1824696117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba545c48-77", "ovs_interfaceid": "ba545c48-7768-4efb-ac4d-d4221464afaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "address": "fa:16:3e:68:5d:6b", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7d6a4-fc", "ovs_interfaceid": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "address": "fa:16:3e:cd:c5:53", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd0250b-e4", "ovs_interfaceid": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eeb5ba8-9589-4373-afaf-e90135c84256", "address": "fa:16:3e:0d:73:3f", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb5ba8-95", "ovs_interfaceid": "2eeb5ba8-9589-4373-afaf-e90135c84256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97188a57-9dc6-485a-9362-b44dbe9f2669", "address": "fa:16:3e:42:2f:1e", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97188a57-9d", "ovs_interfaceid": "97188a57-9dc6-485a-9362-b44dbe9f2669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "address": "fa:16:3e:e5:50:d8", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c51ab6-ca", "ovs_interfaceid": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "address": "fa:16:3e:16:8e:16", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07063ce8-2e", "ovs_interfaceid": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:25:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1dd1cb7e-693d-4d65-8caa-08d87d228854 req-87594edc-790a-47fe-9f6e-893b50193180 service nova] Releasing lock "refresh_cache-49874ea8-8d01-4de6-a3cc-fc35af67665e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:25:09 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116709.938156, d51623f1-6613-41d6-abcb-9e4e626a97af => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:25:09 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] VM Resumed (Lifecycle Event)
Aug 15 16:25:09 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:25:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:25:09 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Instance spawned successfully.
Aug 15 16:25:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:25:09 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:25:09 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:25:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:25:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:25:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:25:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:25:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:25:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:25:10 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:25:10 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116709.9439578, d51623f1-6613-41d6-abcb-9e4e626a97af => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:25:10 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] VM Started (Lifecycle Event)
Aug 15 16:25:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:25:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:25:10 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:25:10 user nova-compute[72849]: INFO nova.compute.manager [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Took 7.93 seconds to spawn the instance on the hypervisor.
Aug 15 16:25:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:25:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-50cf3e57-54de-49da-b4f8-7fb8abf77347 req-32a9b16a-be7d-48b2-80dd-4c51bf560a7a service nova] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Received event network-vif-plugged-fbe64b8c-04d1-40d1-9b24-f3f021c282aa {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-50cf3e57-54de-49da-b4f8-7fb8abf77347 req-32a9b16a-be7d-48b2-80dd-4c51bf560a7a service nova] Acquiring lock "d51623f1-6613-41d6-abcb-9e4e626a97af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-50cf3e57-54de-49da-b4f8-7fb8abf77347 req-32a9b16a-be7d-48b2-80dd-4c51bf560a7a service nova] Lock "d51623f1-6613-41d6-abcb-9e4e626a97af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-50cf3e57-54de-49da-b4f8-7fb8abf77347 req-32a9b16a-be7d-48b2-80dd-4c51bf560a7a service nova] Lock "d51623f1-6613-41d6-abcb-9e4e626a97af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-50cf3e57-54de-49da-b4f8-7fb8abf77347 req-32a9b16a-be7d-48b2-80dd-4c51bf560a7a service nova] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] No waiting events found dispatching network-vif-plugged-fbe64b8c-04d1-40d1-9b24-f3f021c282aa {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:10 user nova-compute[72849]: WARNING nova.compute.manager [req-50cf3e57-54de-49da-b4f8-7fb8abf77347 req-32a9b16a-be7d-48b2-80dd-4c51bf560a7a service nova] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Received unexpected event network-vif-plugged-fbe64b8c-04d1-40d1-9b24-f3f021c282aa for instance with vm_state building and task_state spawning.
Aug 15 16:25:10 user nova-compute[72849]: INFO nova.compute.manager [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Took 8.91 seconds to build instance.
Aug 15 16:25:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b6e26b9-cdb5-4325-bdc7-7bacafe5b9f1 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "d51623f1-6613-41d6-abcb-9e4e626a97af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.027s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:11 user nova-compute[72849]: INFO nova.compute.manager [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Terminating instance
Aug 15 16:25:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-862c2b7f-7e48-4550-839b-dfbe1519461e req-e038ae64-c147-4458-a105-974df72db92b service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-unplugged-ba545c48-7768-4efb-ac4d-d4221464afaf {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-862c2b7f-7e48-4550-839b-dfbe1519461e req-e038ae64-c147-4458-a105-974df72db92b service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-862c2b7f-7e48-4550-839b-dfbe1519461e req-e038ae64-c147-4458-a105-974df72db92b service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-862c2b7f-7e48-4550-839b-dfbe1519461e req-e038ae64-c147-4458-a105-974df72db92b service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-862c2b7f-7e48-4550-839b-dfbe1519461e req-e038ae64-c147-4458-a105-974df72db92b service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-unplugged-ba545c48-7768-4efb-ac4d-d4221464afaf {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-862c2b7f-7e48-4550-839b-dfbe1519461e req-e038ae64-c147-4458-a105-974df72db92b service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-unplugged-ba545c48-7768-4efb-ac4d-d4221464afaf for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-3f4eb184-a69c-4aac-95c0-ccdc19d015c4 req-5c48646a-25e7-45ab-ad36-6f1af3de1a47 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-unplugged-97188a57-9dc6-485a-9362-b44dbe9f2669 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3f4eb184-a69c-4aac-95c0-ccdc19d015c4 req-5c48646a-25e7-45ab-ad36-6f1af3de1a47 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3f4eb184-a69c-4aac-95c0-ccdc19d015c4 req-5c48646a-25e7-45ab-ad36-6f1af3de1a47 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3f4eb184-a69c-4aac-95c0-ccdc19d015c4 req-5c48646a-25e7-45ab-ad36-6f1af3de1a47 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-3f4eb184-a69c-4aac-95c0-ccdc19d015c4 req-5c48646a-25e7-45ab-ad36-6f1af3de1a47 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-unplugged-97188a57-9dc6-485a-9362-b44dbe9f2669 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-3f4eb184-a69c-4aac-95c0-ccdc19d015c4 req-5c48646a-25e7-45ab-ad36-6f1af3de1a47 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-unplugged-97188a57-9dc6-485a-9362-b44dbe9f2669 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:25:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-99ee180e-0e59-44d7-8ae9-ba00ff5162d8 req-41e6b395-d8b9-4d84-84ce-2475a8bea70d service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-unplugged-2eeb5ba8-9589-4373-afaf-e90135c84256 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-99ee180e-0e59-44d7-8ae9-ba00ff5162d8 req-41e6b395-d8b9-4d84-84ce-2475a8bea70d service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-99ee180e-0e59-44d7-8ae9-ba00ff5162d8 req-41e6b395-d8b9-4d84-84ce-2475a8bea70d service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-99ee180e-0e59-44d7-8ae9-ba00ff5162d8 req-41e6b395-d8b9-4d84-84ce-2475a8bea70d service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-99ee180e-0e59-44d7-8ae9-ba00ff5162d8 req-41e6b395-d8b9-4d84-84ce-2475a8bea70d service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-unplugged-2eeb5ba8-9589-4373-afaf-e90135c84256 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-99ee180e-0e59-44d7-8ae9-ba00ff5162d8 req-41e6b395-d8b9-4d84-84ce-2475a8bea70d service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-unplugged-2eeb5ba8-9589-4373-afaf-e90135c84256 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:25:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Instance destroyed successfully.
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.objects.instance [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lazy-loading 'resources' on Instance uuid 49874ea8-8d01-4de6-a3cc-fc35af67665e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba545c48-7768-4efb-ac4d-d4221464afaf", "address": "fa:16:3e:35:31:31", "network": {"id": "921f34cb-0177-4df4-8312-859dbdb9f7e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1824696117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba545c48-77", "ovs_interfaceid": "ba545c48-7768-4efb-ac4d-d4221464afaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "ba545c48-7768-4efb-ac4d-d4221464afaf", "address": "fa:16:3e:35:31:31", "network": {"id": "921f34cb-0177-4df4-8312-859dbdb9f7e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1824696117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba545c48-77", "ovs_interfaceid": "ba545c48-7768-4efb-ac4d-d4221464afaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:31:31,bridge_name='br-int',has_traffic_filtering=True,id=ba545c48-7768-4efb-ac4d-d4221464afaf,network=Network(921f34cb-0177-4df4-8312-859dbdb9f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba545c48-77') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:31:31,bridge_name='br-int',has_traffic_filtering=True,id=ba545c48-7768-4efb-ac4d-d4221464afaf,network=Network(921f34cb-0177-4df4-8312-859dbdb9f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba545c48-77') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba545c48-77, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: INFO os_vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:31:31,bridge_name='br-int',has_traffic_filtering=True,id=ba545c48-7768-4efb-ac4d-d4221464afaf,network=Network(921f34cb-0177-4df4-8312-859dbdb9f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba545c48-77')
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "address": "fa:16:3e:68:5d:6b", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7d6a4-fc", "ovs_interfaceid": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "address": "fa:16:3e:68:5d:6b", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7d6a4-fc", "ovs_interfaceid": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=2bf7d6a4-fc72-48df-b1af-c208baebcf8a,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2bf7d6a4-fc') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=2bf7d6a4-fc72-48df-b1af-c208baebcf8a,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2bf7d6a4-fc') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bf7d6a4-fc, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: INFO os_vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=2bf7d6a4-fc72-48df-b1af-c208baebcf8a,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2bf7d6a4-fc')
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "address": "fa:16:3e:cd:c5:53", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd0250b-e4", "ovs_interfaceid": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "address": "fa:16:3e:cd:c5:53", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd0250b-e4", "ovs_interfaceid": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c5:53,bridge_name='br-int',has_traffic_filtering=True,id=2dd0250b-e417-49b0-b438-c4b8500bf84d,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dd0250b-e4') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c5:53,bridge_name='br-int',has_traffic_filtering=True,id=2dd0250b-e417-49b0-b438-c4b8500bf84d,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dd0250b-e4') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dd0250b-e4, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: INFO os_vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c5:53,bridge_name='br-int',has_traffic_filtering=True,id=2dd0250b-e417-49b0-b438-c4b8500bf84d,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dd0250b-e4')
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eeb5ba8-9589-4373-afaf-e90135c84256", "address": "fa:16:3e:0d:73:3f", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb5ba8-95", "ovs_interfaceid": "2eeb5ba8-9589-4373-afaf-e90135c84256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "2eeb5ba8-9589-4373-afaf-e90135c84256", "address": "fa:16:3e:0d:73:3f", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb5ba8-95", "ovs_interfaceid": "2eeb5ba8-9589-4373-afaf-e90135c84256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:73:3f,bridge_name='br-int',has_traffic_filtering=True,id=2eeb5ba8-9589-4373-afaf-e90135c84256,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb5ba8-95') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:73:3f,bridge_name='br-int',has_traffic_filtering=True,id=2eeb5ba8-9589-4373-afaf-e90135c84256,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb5ba8-95') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eeb5ba8-95, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: INFO os_vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:73:3f,bridge_name='br-int',has_traffic_filtering=True,id=2eeb5ba8-9589-4373-afaf-e90135c84256,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb5ba8-95')
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97188a57-9dc6-485a-9362-b44dbe9f2669", "address": "fa:16:3e:42:2f:1e", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97188a57-9d", "ovs_interfaceid": "97188a57-9dc6-485a-9362-b44dbe9f2669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "97188a57-9dc6-485a-9362-b44dbe9f2669", "address": "fa:16:3e:42:2f:1e", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97188a57-9d", "ovs_interfaceid": "97188a57-9dc6-485a-9362-b44dbe9f2669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:2f:1e,bridge_name='br-int',has_traffic_filtering=True,id=97188a57-9dc6-485a-9362-b44dbe9f2669,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97188a57-9d') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:2f:1e,bridge_name='br-int',has_traffic_filtering=True,id=97188a57-9dc6-485a-9362-b44dbe9f2669,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97188a57-9d') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97188a57-9d, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: INFO os_vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:2f:1e,bridge_name='br-int',has_traffic_filtering=True,id=97188a57-9dc6-485a-9362-b44dbe9f2669,network=Network(7e679255-6c4b-404e-a1fd-ce3312b1adf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97188a57-9d')
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "address": "fa:16:3e:e5:50:d8", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c51ab6-ca", "ovs_interfaceid": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "address": "fa:16:3e:e5:50:d8", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c51ab6-ca", "ovs_interfaceid": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:50:d8,bridge_name='br-int',has_traffic_filtering=True,id=62c51ab6-ca9a-4c11-bea6-ab58d22e80dc,network=Network(3c093662-951c-4b22-b6fe-68ef0c7cff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62c51ab6-ca') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:50:d8,bridge_name='br-int',has_traffic_filtering=True,id=62c51ab6-ca9a-4c11-bea6-ab58d22e80dc,network=Network(3c093662-951c-4b22-b6fe-68ef0c7cff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62c51ab6-ca') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62c51ab6-ca, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-ba545c48-7768-4efb-ac4d-d4221464afaf {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-ba545c48-7768-4efb-ac4d-d4221464afaf {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:13 user nova-compute[72849]: WARNING nova.compute.manager [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-ba545c48-7768-4efb-ac4d-d4221464afaf for instance with vm_state active and task_state deleting.
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-unplugged-2bf7d6a4-fc72-48df-b1af-c208baebcf8a {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-unplugged-2bf7d6a4-fc72-48df-b1af-c208baebcf8a {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-unplugged-2bf7d6a4-fc72-48df-b1af-c208baebcf8a for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-2bf7d6a4-fc72-48df-b1af-c208baebcf8a {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-2bf7d6a4-fc72-48df-b1af-c208baebcf8a {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:13 user nova-compute[72849]: WARNING nova.compute.manager [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-2bf7d6a4-fc72-48df-b1af-c208baebcf8a for instance with vm_state active and task_state deleting.
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-unplugged-2dd0250b-e417-49b0-b438-c4b8500bf84d {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-unplugged-2dd0250b-e417-49b0-b438-c4b8500bf84d {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-unplugged-2dd0250b-e417-49b0-b438-c4b8500bf84d for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-2dd0250b-e417-49b0-b438-c4b8500bf84d {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-2dd0250b-e417-49b0-b438-c4b8500bf84d {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:13 user nova-compute[72849]: WARNING nova.compute.manager [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-2dd0250b-e417-49b0-b438-c4b8500bf84d for instance with vm_state active and task_state deleting.
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-unplugged-62c51ab6-ca9a-4c11-bea6-ab58d22e80dc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-unplugged-62c51ab6-ca9a-4c11-bea6-ab58d22e80dc {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-74852eb1-90ef-4e30-96b2-081f53a6edea req-1537198f-8a3e-4146-9a76-b25b474f75d7 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-unplugged-62c51ab6-ca9a-4c11-bea6-ab58d22e80dc for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: INFO os_vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:50:d8,bridge_name='br-int',has_traffic_filtering=True,id=62c51ab6-ca9a-4c11-bea6-ab58d22e80dc,network=Network(3c093662-951c-4b22-b6fe-68ef0c7cff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62c51ab6-ca')
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T16:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582159344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582159344',id=20,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85brt3mA+baIn+Uh9bDfoSm+mRij8Wk/7CgsDk1CRKSjIO3yT0WCvm0QEOvKQQWUg/6pqUEvwi6UdsTlEvG+Hunxnh08+MUTRrpYahQwTzQ2ovWD0PMTZpFDDyjWD/qQ==',key_name='tempest-keypair-1781519008',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7485d9d649d4d6e8d0eef09cc1b28d7',ramdisk_id='',reservation_id='r-7xt7fbgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2042209791',owner_user_name='tempest-TaggedBootDevicesTest_v242-2042209791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b969d9f150524650bdb3f0535270ecd4',uuid=49874ea8-8d01-4de6-a3cc-fc35af67665e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "address": "fa:16:3e:16:8e:16", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07063ce8-2e", "ovs_interfaceid": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converting VIF {"id": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "address": "fa:16:3e:16:8e:16", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07063ce8-2e", "ovs_interfaceid": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=07063ce8-2e0a-4d84-9dcc-7b09379d313a,network=Network(3c093662-951c-4b22-b6fe-68ef0c7cff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07063ce8-2e') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=07063ce8-2e0a-4d84-9dcc-7b09379d313a,network=Network(3c093662-951c-4b22-b6fe-68ef0c7cff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07063ce8-2e') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07063ce8-2e, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:13 user nova-compute[72849]: INFO os_vif [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=07063ce8-2e0a-4d84-9dcc-7b09379d313a,network=Network(3c093662-951c-4b22-b6fe-68ef0c7cff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07063ce8-2e')
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNopVOwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:25:13 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7ed3d7-7b43-4ad3-90f0-09c849f07967]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b18e0fa-1652-4d43-a735-32ee6787746a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:25:13 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:25:13 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:25:13 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:25:13 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:25:13 user nova-compute[72849]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)
Aug 15 16:25:13 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:25:13 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:25:13 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:25:13 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:25:13 user nova-compute[72849]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 (non-flash)
Aug 15 16:25:13 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:25:13 user nova-compute[72849]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)
Aug 15 16:25:13 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:25:13 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3582a08b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70'): ({'sdc'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Removing single pathed devices sdc {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f18583-f04e-45f7-a317-c3cdd71dd4f5]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eaaf7b-2d65-4525-a78a-d3d75492d0b4]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Flushing IO for device /dev/sdc {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bce3dfe-b6ec-4c95-b9fa-17803c6a95ba]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.074s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[84294741-3a1c-4e17-b8f5-5990139be9fb]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[82567d60-e7e8-4352-acf0-aac201bee3a0]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cd1c11-c184-4462-b9b2-b3ad6ef9daa4]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70, portal: 172.16.0.220,3260]
Aug 15 16:25:13 user nova-compute[72849]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70, portal: 172.16.0.220,3260] successful.
Aug 15 16:25:13 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3534d2-37c8-4827-9b01-6f0c7cac0c70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a47c564-186b-4650-9ad2-4212c1e2fca2]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] <== disconnect_volume: return (381ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHwTmcfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:25:13 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:25:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5fc3d8-c1bd-4a55-b346-8963298a12bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bc7aab-2f03-43f6-82ec-4565f38ef4a0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:25:14 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:25:14 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:25:14 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:25:14 user nova-compute[72849]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)
Aug 15 16:25:14 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:25:14 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:25:14 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:25:14 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:25:14 user nova-compute[72849]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d (non-flash)
Aug 15 16:25:14 user nova-compute[72849]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)
Aug 15 16:25:14 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:25:14 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3582a0040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d'): ({'sde'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Removing single pathed devices sde {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[451d4ef7-3195-41e8-aef7-e4a157a70c94]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5819cde6-14fa-44d6-a318-fbb8e79774ad]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Flushing IO for device /dev/sde {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8182ef-cac0-470c-ad80-436439580ad0]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[146baff9-176b-4f8d-ab4b-7e04e859ac19]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] SCSI volumes sde have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c93a360-44ea-4b9d-ab79-23d7c7027a55]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG nova.compute.manager [req-4917ee86-72d0-481e-ad4d-39f8c7a023b1 req-95433e7f-7a67-4f92-ac8b-dd68917bbb80 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-97188a57-9dc6-485a-9362-b44dbe9f2669 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4917ee86-72d0-481e-ad4d-39f8c7a023b1 req-95433e7f-7a67-4f92-ac8b-dd68917bbb80 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4917ee86-72d0-481e-ad4d-39f8c7a023b1 req-95433e7f-7a67-4f92-ac8b-dd68917bbb80 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4917ee86-72d0-481e-ad4d-39f8c7a023b1 req-95433e7f-7a67-4f92-ac8b-dd68917bbb80 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG nova.compute.manager [req-4917ee86-72d0-481e-ad4d-39f8c7a023b1 req-95433e7f-7a67-4f92-ac8b-dd68917bbb80 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-97188a57-9dc6-485a-9362-b44dbe9f2669 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:14 user nova-compute[72849]: WARNING nova.compute.manager [req-4917ee86-72d0-481e-ad4d-39f8c7a023b1 req-95433e7f-7a67-4f92-ac8b-dd68917bbb80 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-97188a57-9dc6-485a-9362-b44dbe9f2669 for instance with vm_state active and task_state deleting.
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3797c64f-825c-42b7-b072-b5b3de480ab5]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d, portal: 172.16.0.220,3260]
Aug 15 16:25:14 user nova-compute[72849]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d, portal: 172.16.0.220,3260] successful.
Aug 15 16:25:14 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2708688-451b-4230-aab4-87eee35b2e7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2007a2e0-7d22-451a-b444-8bae6040f3f0]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] <== disconnect_volume: return (352ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xATusrDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:25:14 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG nova.compute.manager [req-d5d364ef-a5cb-4133-a56d-247872cda439 req-060a7dc1-cd6e-4604-9846-d66174b2aff6 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-2eeb5ba8-9589-4373-afaf-e90135c84256 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d5d364ef-a5cb-4133-a56d-247872cda439 req-060a7dc1-cd6e-4604-9846-d66174b2aff6 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d5d364ef-a5cb-4133-a56d-247872cda439 req-060a7dc1-cd6e-4604-9846-d66174b2aff6 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d5d364ef-a5cb-4133-a56d-247872cda439 req-060a7dc1-cd6e-4604-9846-d66174b2aff6 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG nova.compute.manager [req-d5d364ef-a5cb-4133-a56d-247872cda439 req-060a7dc1-cd6e-4604-9846-d66174b2aff6 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-2eeb5ba8-9589-4373-afaf-e90135c84256 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:14 user nova-compute[72849]: WARNING nova.compute.manager [req-d5d364ef-a5cb-4133-a56d-247872cda439 req-060a7dc1-cd6e-4604-9846-d66174b2aff6 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-2eeb5ba8-9589-4373-afaf-e90135c84256 for instance with vm_state active and task_state deleting.
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0912d199-7104-4b79-b344-e75449da6fb1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bedf241-f13b-48fa-b54a-c763b15d48ad]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:25:14 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:25:14 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:25:14 user nova-compute[72849]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)
Aug 15 16:25:14 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:25:14 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:25:14 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:25:14 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:25:14 user nova-compute[72849]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 (non-flash)
Aug 15 16:25:14 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:25:14 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3781b9510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78'): ({'sdg'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Removing single pathed devices sdg {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2a7746-5ec0-4ec3-8f9a-3db091b3713d]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[339f07e7-7bd9-48de-9144-ebf9dfc4ccb9]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Flushing IO for device /dev/sdg {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9835e2e6-a7d2-4d13-a1ff-f42b2cc40198]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.062s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cd5c60-ac87-4942-aeb1-3a0812b20ce1]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] SCSI volumes sdg have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df2f0c4-1e8f-4bf3-b35a-7f3a1ba44428]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c17c621-0de7-4823-8b25-32ea7a219359]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78, portal: 172.16.0.220,3260]
Aug 15 16:25:14 user nova-compute[72849]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78, portal: 172.16.0.220,3260] successful.
Aug 15 16:25:14 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82364061-e57a-498f-be94-6b55efdfdc78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce19afa-60ee-4fc2-bae1-b09f7f4dddbf]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] <== disconnect_volume: return (376ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:25:14 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Deleting instance files /opt/stack/data/nova/instances/49874ea8-8d01-4de6-a3cc-fc35af67665e_del
Aug 15 16:25:14 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Deletion of /opt/stack/data/nova/instances/49874ea8-8d01-4de6-a3cc-fc35af67665e_del complete
Aug 15 16:25:14 user nova-compute[72849]: INFO nova.compute.manager [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Took 3.75 seconds to destroy the instance on the hypervisor.
Aug 15 16:25:14 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:25:14 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:25:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-6bc6f58c-b363-4fab-b442-cf97826b97ed req-04c0c5c9-c8b3-46a8-ad4c-6fd5504bfe41 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-62c51ab6-ca9a-4c11-bea6-ab58d22e80dc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6bc6f58c-b363-4fab-b442-cf97826b97ed req-04c0c5c9-c8b3-46a8-ad4c-6fd5504bfe41 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6bc6f58c-b363-4fab-b442-cf97826b97ed req-04c0c5c9-c8b3-46a8-ad4c-6fd5504bfe41 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6bc6f58c-b363-4fab-b442-cf97826b97ed req-04c0c5c9-c8b3-46a8-ad4c-6fd5504bfe41 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-6bc6f58c-b363-4fab-b442-cf97826b97ed req-04c0c5c9-c8b3-46a8-ad4c-6fd5504bfe41 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-62c51ab6-ca9a-4c11-bea6-ab58d22e80dc {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:15 user nova-compute[72849]: WARNING nova.compute.manager [req-6bc6f58c-b363-4fab-b442-cf97826b97ed req-04c0c5c9-c8b3-46a8-ad4c-6fd5504bfe41 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-62c51ab6-ca9a-4c11-bea6-ab58d22e80dc for instance with vm_state active and task_state deleting.
Aug 15 16:25:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-6bc6f58c-b363-4fab-b442-cf97826b97ed req-04c0c5c9-c8b3-46a8-ad4c-6fd5504bfe41 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-unplugged-07063ce8-2e0a-4d84-9dcc-7b09379d313a {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6bc6f58c-b363-4fab-b442-cf97826b97ed req-04c0c5c9-c8b3-46a8-ad4c-6fd5504bfe41 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6bc6f58c-b363-4fab-b442-cf97826b97ed req-04c0c5c9-c8b3-46a8-ad4c-6fd5504bfe41 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6bc6f58c-b363-4fab-b442-cf97826b97ed req-04c0c5c9-c8b3-46a8-ad4c-6fd5504bfe41 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-6bc6f58c-b363-4fab-b442-cf97826b97ed req-04c0c5c9-c8b3-46a8-ad4c-6fd5504bfe41 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-unplugged-07063ce8-2e0a-4d84-9dcc-7b09379d313a {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-6bc6f58c-b363-4fab-b442-cf97826b97ed req-04c0c5c9-c8b3-46a8-ad4c-6fd5504bfe41 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-unplugged-07063ce8-2e0a-4d84-9dcc-7b09379d313a for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:25:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-6bc6f58c-b363-4fab-b442-cf97826b97ed req-04c0c5c9-c8b3-46a8-ad4c-6fd5504bfe41 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-plugged-07063ce8-2e0a-4d84-9dcc-7b09379d313a {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6bc6f58c-b363-4fab-b442-cf97826b97ed req-04c0c5c9-c8b3-46a8-ad4c-6fd5504bfe41 service nova] Acquiring lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6bc6f58c-b363-4fab-b442-cf97826b97ed req-04c0c5c9-c8b3-46a8-ad4c-6fd5504bfe41 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6bc6f58c-b363-4fab-b442-cf97826b97ed req-04c0c5c9-c8b3-46a8-ad4c-6fd5504bfe41 service nova] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-6bc6f58c-b363-4fab-b442-cf97826b97ed req-04c0c5c9-c8b3-46a8-ad4c-6fd5504bfe41 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] No waiting events found dispatching network-vif-plugged-07063ce8-2e0a-4d84-9dcc-7b09379d313a {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:15 user nova-compute[72849]: WARNING nova.compute.manager [req-6bc6f58c-b363-4fab-b442-cf97826b97ed req-04c0c5c9-c8b3-46a8-ad4c-6fd5504bfe41 service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received unexpected event network-vif-plugged-07063ce8-2e0a-4d84-9dcc-7b09379d313a for instance with vm_state active and task_state deleting.
Aug 15 16:25:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "052cde29-421b-4b17-9bcd-acd58456ddba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "052cde29-421b-4b17-9bcd-acd58456ddba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:16 user nova-compute[72849]: INFO nova.compute.manager [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Detaching volume 760cfa28-9427-4744-8d35-84d61d641d6e
Aug 15 16:25:16 user nova-compute[72849]: INFO nova.virt.block_device [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Attempting to driver detach volume 760cfa28-9427-4744-8d35-84d61d641d6e from mountpoint /dev/vdb
Aug 15 16:25:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Attempting to detach device vdb from instance 052cde29-421b-4b17-9bcd-acd58456ddba from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:25:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:25:16 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:25:16 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:25:16 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:25:16 user nova-compute[72849]:   <serial>760cfa28-9427-4744-8d35-84d61d641d6e</serial>
Aug 15 16:25:16 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 16:25:16 user nova-compute[72849]: </disk>
Aug 15 16:25:16 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:25:16 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Successfully detached device vdb from instance 052cde29-421b-4b17-9bcd-acd58456ddba from the persistent domain config.
Aug 15 16:25:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 052cde29-421b-4b17-9bcd-acd58456ddba from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:25:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:25:16 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:25:16 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:25:16 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:25:16 user nova-compute[72849]:   <serial>760cfa28-9427-4744-8d35-84d61d641d6e</serial>
Aug 15 16:25:16 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 16:25:16 user nova-compute[72849]: </disk>
Aug 15 16:25:16 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-5555e1b7-4738-4743-9491-ee23178734f4 req-af8f8cb8-2418-47cd-9053-e4b1716e352e service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-deleted-97188a57-9dc6-485a-9362-b44dbe9f2669 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:17 user nova-compute[72849]: INFO nova.compute.manager [req-5555e1b7-4738-4743-9491-ee23178734f4 req-af8f8cb8-2418-47cd-9053-e4b1716e352e service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Neutron deleted interface 97188a57-9dc6-485a-9362-b44dbe9f2669; detaching it from the instance and deleting it from the info cache
Aug 15 16:25:17 user nova-compute[72849]: DEBUG nova.network.neutron [req-5555e1b7-4738-4743-9491-ee23178734f4 req-af8f8cb8-2418-47cd-9053-e4b1716e352e service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updating instance_info_cache with network_info: [{"id": "ba545c48-7768-4efb-ac4d-d4221464afaf", "address": "fa:16:3e:35:31:31", "network": {"id": "921f34cb-0177-4df4-8312-859dbdb9f7e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1824696117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba545c48-77", "ovs_interfaceid": "ba545c48-7768-4efb-ac4d-d4221464afaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "address": "fa:16:3e:68:5d:6b", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7d6a4-fc", "ovs_interfaceid": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "address": "fa:16:3e:cd:c5:53", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd0250b-e4", "ovs_interfaceid": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eeb5ba8-9589-4373-afaf-e90135c84256", "address": "fa:16:3e:0d:73:3f", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb5ba8-95", "ovs_interfaceid": "2eeb5ba8-9589-4373-afaf-e90135c84256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "address": "fa:16:3e:e5:50:d8", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c51ab6-ca", "ovs_interfaceid": "62c51ab6-ca9a-4c11-bea6-ab58d22e80dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "address": "fa:16:3e:16:8e:16", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07063ce8-2e", "ovs_interfaceid": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-5555e1b7-4738-4743-9491-ee23178734f4 req-af8f8cb8-2418-47cd-9053-e4b1716e352e service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Detach interface failed, port_id=97188a57-9dc6-485a-9362-b44dbe9f2669, reason: Instance 49874ea8-8d01-4de6-a3cc-fc35af67665e could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692116717.4860535, 052cde29-421b-4b17-9bcd-acd58456ddba => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 052cde29-421b-4b17-9bcd-acd58456ddba {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:25:17 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Successfully detached device vdb from instance 052cde29-421b-4b17-9bcd-acd58456ddba from the live domain config.
Aug 15 16:25:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhjeSioA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:25:17 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:25:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[767600d3-8dfe-42c9-ad10-ecca37a34015]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[947d74fa-e885-4add-b7aa-7289990ad318]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:25:17 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:25:17 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:25:17 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:25:17 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:25:17 user nova-compute[72849]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e (non-flash)
Aug 15 16:25:17 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:25:17 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:25:17 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3582ca7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b528472-d6d3-49de-8cbe-2d8a53e7bb1b]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba28eab5-4f98-41cb-9478-eea577386986]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ab34d1-4653-4b78-9aaa-abe2d7e4b1c1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8b3b10-4995-49b2-a0e6-a72485c361b6]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:25:17 user nova-compute[72849]: INFO nova.compute.claims [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Claim successful on node user
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67a804d-d0c9-47a8-82bd-742040bd5a8a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[512ca022-630c-4402-be46-b6758228d9af]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e, portal: 172.16.0.220,3260]
Aug 15 16:25:17 user nova-compute[72849]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e, portal: 172.16.0.220,3260] successful.
Aug 15 16:25:17 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760cfa28-9427-4744-8d35-84d61d641d6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e27aa6b-966e-4fa2-a840-304c1b5b250a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] <== disconnect_volume: return (398ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:25:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nvLijXsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:25:18 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:25:18 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:25:18 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e00406a-86a3-4710-9db8-5b78cd01f8c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:25:18 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f034f1-5db0-42c4-874a-d1c93288459f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4] added
Aug 15 16:25:18 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5da62b-c71b-41a8-8434-6aa9df3f3a31]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b20a64-67db-4ab5-a0b7-76b2cfc5c808]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nvLijXsm {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nvLijXsm" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ebdfc8-c292-44ff-b67f-bf395683987f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nvLijXsm'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fd325d-ee89-474a-917c-9529ac997169]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e03ef28-f702-4ccd-bb18-48e5cb57fd69]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:25:18 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:25:18 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:25:18 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:25:18 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:25:18 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:25:18 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c7a7de-e99e-4fdc-806b-7ee71b405017]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4, portal: 172.16.0.220,3260]
Aug 15 16:25:18 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4, portal: 172.16.0.220,3260] successful.
Aug 15 16:25:18 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.761s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b52c4f3-5118-4f82-937f-1c16014b611c]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ed61b1-d2a2-4c34-a838-4c17c6c2e8d6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:25:18 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:25:18 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:25:18 user nova-compute[72849]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 (non-flash)
Aug 15 16:25:18 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:25:18 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:25:18 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:25:18 user nova-compute[72849]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 (non-flash)
Aug 15 16:25:18 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.423s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[859c7d1f-8248-4956-8de2-9f2192feeda8]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nvLijXsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG nova.network.neutron [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:25:18 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:25:18 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:25:18 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Creating image(s)
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "/opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "/opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG nova.policy [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abdcfedce2124d86a0df67571fdfcde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607d6d3506de49549888f16d06829c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:25:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.207s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.238s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk 1073741824" returned: 0 in 0.060s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-bd423ee3-a594-49f1-b9a0-9a5923d2b8a9 req-eeabc5ed-4902-4509-a265-73b36c112a5f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-deleted-62c51ab6-ca9a-4c11-bea6-ab58d22e80dc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:19 user nova-compute[72849]: INFO nova.compute.manager [req-bd423ee3-a594-49f1-b9a0-9a5923d2b8a9 req-eeabc5ed-4902-4509-a265-73b36c112a5f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Neutron deleted interface 62c51ab6-ca9a-4c11-bea6-ab58d22e80dc; detaching it from the instance and deleting it from the info cache
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.network.neutron [req-bd423ee3-a594-49f1-b9a0-9a5923d2b8a9 req-eeabc5ed-4902-4509-a265-73b36c112a5f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updating instance_info_cache with network_info: [{"id": "ba545c48-7768-4efb-ac4d-d4221464afaf", "address": "fa:16:3e:35:31:31", "network": {"id": "921f34cb-0177-4df4-8312-859dbdb9f7e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1824696117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba545c48-77", "ovs_interfaceid": "ba545c48-7768-4efb-ac4d-d4221464afaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "address": "fa:16:3e:68:5d:6b", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7d6a4-fc", "ovs_interfaceid": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "address": "fa:16:3e:cd:c5:53", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd0250b-e4", "ovs_interfaceid": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eeb5ba8-9589-4373-afaf-e90135c84256", "address": "fa:16:3e:0d:73:3f", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb5ba8-95", "ovs_interfaceid": "2eeb5ba8-9589-4373-afaf-e90135c84256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "address": "fa:16:3e:16:8e:16", "network": {"id": "3c093662-951c-4b22-b6fe-68ef0c7cff59", "bridge": "br-int", "label": "tempest-device-tagging-net2-1333783144", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07063ce8-2e", "ovs_interfaceid": "07063ce8-2e0a-4d84-9dcc-7b09379d313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-bd423ee3-a594-49f1-b9a0-9a5923d2b8a9 req-eeabc5ed-4902-4509-a265-73b36c112a5f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Detach interface failed, port_id=62c51ab6-ca9a-4c11-bea6-ab58d22e80dc, reason: Instance 49874ea8-8d01-4de6-a3cc-fc35af67665e could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-bd423ee3-a594-49f1-b9a0-9a5923d2b8a9 req-eeabc5ed-4902-4509-a265-73b36c112a5f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-deleted-07063ce8-2e0a-4d84-9dcc-7b09379d313a {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:19 user nova-compute[72849]: INFO nova.compute.manager [req-bd423ee3-a594-49f1-b9a0-9a5923d2b8a9 req-eeabc5ed-4902-4509-a265-73b36c112a5f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Neutron deleted interface 07063ce8-2e0a-4d84-9dcc-7b09379d313a; detaching it from the instance and deleting it from the info cache
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.network.neutron [req-bd423ee3-a594-49f1-b9a0-9a5923d2b8a9 req-eeabc5ed-4902-4509-a265-73b36c112a5f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updating instance_info_cache with network_info: [{"id": "ba545c48-7768-4efb-ac4d-d4221464afaf", "address": "fa:16:3e:35:31:31", "network": {"id": "921f34cb-0177-4df4-8312-859dbdb9f7e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1824696117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba545c48-77", "ovs_interfaceid": "ba545c48-7768-4efb-ac4d-d4221464afaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "address": "fa:16:3e:68:5d:6b", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7d6a4-fc", "ovs_interfaceid": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "address": "fa:16:3e:cd:c5:53", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd0250b-e4", "ovs_interfaceid": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eeb5ba8-9589-4373-afaf-e90135c84256", "address": "fa:16:3e:0d:73:3f", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb5ba8-95", "ovs_interfaceid": "2eeb5ba8-9589-4373-afaf-e90135c84256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.206s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-bd423ee3-a594-49f1-b9a0-9a5923d2b8a9 req-eeabc5ed-4902-4509-a265-73b36c112a5f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Detach interface failed, port_id=07063ce8-2e0a-4d84-9dcc-7b09379d313a, reason: Instance 49874ea8-8d01-4de6-a3cc-fc35af67665e could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-bd423ee3-a594-49f1-b9a0-9a5923d2b8a9 req-eeabc5ed-4902-4509-a265-73b36c112a5f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-deleted-ba545c48-7768-4efb-ac4d-d4221464afaf {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:19 user nova-compute[72849]: INFO nova.compute.manager [req-bd423ee3-a594-49f1-b9a0-9a5923d2b8a9 req-eeabc5ed-4902-4509-a265-73b36c112a5f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Neutron deleted interface ba545c48-7768-4efb-ac4d-d4221464afaf; detaching it from the instance and deleting it from the info cache
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.network.neutron [req-bd423ee3-a594-49f1-b9a0-9a5923d2b8a9 req-eeabc5ed-4902-4509-a265-73b36c112a5f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updating instance_info_cache with network_info: [{"id": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "address": "fa:16:3e:68:5d:6b", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7d6a4-fc", "ovs_interfaceid": "2bf7d6a4-fc72-48df-b1af-c208baebcf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "address": "fa:16:3e:cd:c5:53", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd0250b-e4", "ovs_interfaceid": "2dd0250b-e417-49b0-b438-c4b8500bf84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eeb5ba8-9589-4373-afaf-e90135c84256", "address": "fa:16:3e:0d:73:3f", "network": {"id": "7e679255-6c4b-404e-a1fd-ce3312b1adf6", "bridge": "br-int", "label": "tempest-device-tagging-net1-238045330", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a7485d9d649d4d6e8d0eef09cc1b28d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb5ba8-95", "ovs_interfaceid": "2eeb5ba8-9589-4373-afaf-e90135c84256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.468s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] <== connect_volume: return (1470ms) {'type': 'block', 'scsi_wwn': '23238396465626135', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238396465626135', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-bd423ee3-a594-49f1-b9a0-9a5923d2b8a9 req-eeabc5ed-4902-4509-a265-73b36c112a5f service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Detach interface failed, port_id=ba545c48-7768-4efb-ac4d-d4221464afaf, reason: Instance 49874ea8-8d01-4de6-a3cc-fc35af67665e could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.objects.instance [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lazy-loading 'flavor' on Instance uuid 25db7eb1-fa77-4342-922c-4f82f8f27702 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:25:19 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:25:19 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:25:19 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:25:19 user nova-compute[72849]:   <serial>fe4bed5d-d574-405f-bad4-26a6df0509d4</serial>
Aug 15 16:25:19 user nova-compute[72849]: </disk>
Aug 15 16:25:19 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:19 user nova-compute[72849]: INFO nova.compute.manager [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Terminating instance
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Cannot resize image /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.objects.instance [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'migration_context' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:25:19 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Took 5.02 seconds to deallocate network for instance.
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Ensure instance console log exists: /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] No VIF found with MAC fa:16:3e:85:7c:de, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG nova.network.neutron [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Successfully created port: 71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-0222b0c2-ffb2-4f53-b428-9a89f7ea05e6 req-a25af210-609a-4d84-b72d-e84889597077 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received event network-vif-unplugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0222b0c2-ffb2-4f53-b428-9a89f7ea05e6 req-a25af210-609a-4d84-b72d-e84889597077 service nova] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0222b0c2-ffb2-4f53-b428-9a89f7ea05e6 req-a25af210-609a-4d84-b72d-e84889597077 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0222b0c2-ffb2-4f53-b428-9a89f7ea05e6 req-a25af210-609a-4d84-b72d-e84889597077 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-0222b0c2-ffb2-4f53-b428-9a89f7ea05e6 req-a25af210-609a-4d84-b72d-e84889597077 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] No waiting events found dispatching network-vif-unplugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-0222b0c2-ffb2-4f53-b428-9a89f7ea05e6 req-a25af210-609a-4d84-b72d-e84889597077 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received event network-vif-unplugged-25a67315-9859-4077-8f36-23635b760770 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1f6e43f2-e85b-49d7-9d82-a9e5bb824498 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.309s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:20 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Instance destroyed successfully.
Aug 15 16:25:20 user nova-compute[72849]: DEBUG nova.objects.instance [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lazy-loading 'resources' on Instance uuid b0a869eb-9ee8-4c31-9786-5b8be7d362a9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1690114442',display_name='tempest-ServerActionsTestOtherB-server-1690114442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1690114442',id=3,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+hh3mOCKtCImu1/lg7z7Mltoc1di1aJCPq0550JQzfICBVP48YFxiWhHNSQqhuSWVzxUKF+hNAtXneGjvrY/qA0OutpYd9sLJegliqP2OTf5sqdDZP815XUZAuWEPAcQ==',key_name='tempest-keypair-493994408',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:22:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b16b734f348e4d9ca7faba1f84f188a8',ramdisk_id='',reservation_id='r-43bap4gi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1970367935',owner_user_name='tempest-ServerActionsTestOtherB-1970367935-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90af38c3a2a64683a12871bb2a5e0a0f',uuid=b0a869eb-9ee8-4c31-9786-5b8be7d362a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Converting VIF {"id": "25a67315-9859-4077-8f36-23635b760770", "address": "fa:16:3e:32:86:b5", "network": {"id": "abc9a42d-77fd-4d44-9d00-c46b8403a4a0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1585365231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16b734f348e4d9ca7faba1f84f188a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a67315-98", "ovs_interfaceid": "25a67315-9859-4077-8f36-23635b760770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG os_vif [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25a67315-98, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:25:20 user nova-compute[72849]: INFO os_vif [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:b5,bridge_name='br-int',has_traffic_filtering=True,id=25a67315-9859-4077-8f36-23635b760770,network=Network(abc9a42d-77fd-4d44-9d00-c46b8403a4a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a67315-98')
Aug 15 16:25:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVdiagcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:25:20 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:25:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[acef6135-bad6-419c-bdb6-538aaa990f24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4283803-2ce0-4371-8b6b-d111d60c23e3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:25:20 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:25:20 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:25:20 user nova-compute[72849]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 (non-flash)
Aug 15 16:25:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:25:20 user nova-compute[72849]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 (non-flash)
Aug 15 16:25:20 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:25:20 user nova-compute[72849]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 (non-flash)
Aug 15 16:25:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc37832f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5'): ({'sdd'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Removing single pathed devices sdd {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4699847b-a837-4ea1-a466-d1a42b440086]: (4, ('path checker states:\nup                  2\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fec085-fafa-4569-a785-d2cf7a28ccd3]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Flushing IO for device /dev/sdd {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13f7fb2-6e4f-4ff6-af6e-b877afb36859]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb8bb69-f0c1-4ce7-8b9c-65f596aef5f3]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] SCSI volumes sdd have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b32979-70d7-4f17-95c0-1f6ccc8a8a44]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[681a1c5b-aaf7-45d9-a473-f3e7381deb68]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260]
Aug 15 16:25:21 user nova-compute[72849]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5, portal: 172.16.0.220,3260] successful.
Aug 15 16:25:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f25b0b3-328d-4f59-9947-1023da21eef5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34f5854-f868-4e82-8312-02bce3e81ade]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] <== disconnect_volume: return (354ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:25:21 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Deleting instance files /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9_del
Aug 15 16:25:21 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Deletion of /opt/stack/data/nova/instances/b0a869eb-9ee8-4c31-9786-5b8be7d362a9_del complete
Aug 15 16:25:21 user nova-compute[72849]: INFO nova.compute.manager [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Took 1.49 seconds to destroy the instance on the hypervisor.
Aug 15 16:25:21 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.network.neutron [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Successfully updated port: 71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "refresh_cache-f1da55ae-5150-476c-a229-f26ddfee7e9e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquired lock "refresh_cache-f1da55ae-5150-476c-a229-f26ddfee7e9e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.network.neutron [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-e87132f8-ec1a-4ea0-8bb7-b742d5055100 req-01d1d3ee-d234-4a07-a9d8-a4159b8e6dfe service nova] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Received event network-vif-deleted-2eeb5ba8-9589-4373-afaf-e90135c84256 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.network.neutron [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.network.neutron [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Updating instance_info_cache with network_info: [{"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Releasing lock "refresh_cache-f1da55ae-5150-476c-a229-f26ddfee7e9e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Instance network_info: |[{"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Start _get_guest_xml network_info=[{"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:25:21 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:25:21 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:25:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1450170250',display_name='tempest-AttachVolumeTestJSON-server-1450170250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1450170250',id=25,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbHBCrfJdjyvvfHVCDAyVY3pxTMcpwjUaUui51i7UWK+4o1OUXo/LN4XWDmXW8h8aEFw/JKcC9Dwq6+Cbh0MQQ2dswuJTGFHVpH2lAWXJOXrjs0Yd41UjVwgxvzDZT+WQ==',key_name='tempest-keypair-1527966259',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='607d6d3506de49549888f16d06829c89',ramdisk_id='',reservation_id='r-vfgrreq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1114163063',owner_user_name='tempest-AttachVolumeTestJSON-1114163063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abdcfedce2124d86a0df67571fdfcde9',uuid=f1da55ae-5150-476c-a229-f26ddfee7e9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converting VIF {"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.objects.instance [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'pci_devices' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:25:21 user nova-compute[72849]:   <uuid>f1da55ae-5150-476c-a229-f26ddfee7e9e</uuid>
Aug 15 16:25:21 user nova-compute[72849]:   <name>instance-00000019</name>
Aug 15 16:25:21 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:25:21 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:25:21 user nova-compute[72849]:   <metadata>
Aug 15 16:25:21 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:25:21 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:25:21 user nova-compute[72849]:       <nova:name>tempest-AttachVolumeTestJSON-server-1450170250</nova:name>
Aug 15 16:25:21 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:25:21</nova:creationTime>
Aug 15 16:25:21 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:25:21 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:25:21 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:25:21 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:25:21 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:25:21 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:25:21 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:25:21 user nova-compute[72849]:       <nova:owner>
Aug 15 16:25:21 user nova-compute[72849]:         <nova:user uuid="abdcfedce2124d86a0df67571fdfcde9">tempest-AttachVolumeTestJSON-1114163063-project-member</nova:user>
Aug 15 16:25:21 user nova-compute[72849]:         <nova:project uuid="607d6d3506de49549888f16d06829c89">tempest-AttachVolumeTestJSON-1114163063</nova:project>
Aug 15 16:25:21 user nova-compute[72849]:       </nova:owner>
Aug 15 16:25:21 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:25:21 user nova-compute[72849]:       <nova:ports>
Aug 15 16:25:21 user nova-compute[72849]:         <nova:port uuid="71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba">
Aug 15 16:25:21 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 16:25:21 user nova-compute[72849]:         </nova:port>
Aug 15 16:25:21 user nova-compute[72849]:       </nova:ports>
Aug 15 16:25:21 user nova-compute[72849]:     </nova:instance>
Aug 15 16:25:21 user nova-compute[72849]:   </metadata>
Aug 15 16:25:21 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:25:21 user nova-compute[72849]:     <system>
Aug 15 16:25:21 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:25:21 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:25:21 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:25:21 user nova-compute[72849]:       <entry name="serial">f1da55ae-5150-476c-a229-f26ddfee7e9e</entry>
Aug 15 16:25:21 user nova-compute[72849]:       <entry name="uuid">f1da55ae-5150-476c-a229-f26ddfee7e9e</entry>
Aug 15 16:25:21 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:25:21 user nova-compute[72849]:     </system>
Aug 15 16:25:21 user nova-compute[72849]:   </sysinfo>
Aug 15 16:25:21 user nova-compute[72849]:   <os>
Aug 15 16:25:21 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:25:21 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:25:21 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:25:21 user nova-compute[72849]:   </os>
Aug 15 16:25:21 user nova-compute[72849]:   <features>
Aug 15 16:25:21 user nova-compute[72849]:     <acpi/>
Aug 15 16:25:21 user nova-compute[72849]:     <apic/>
Aug 15 16:25:21 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:25:21 user nova-compute[72849]:   </features>
Aug 15 16:25:21 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:25:21 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:25:21 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:25:21 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:25:21 user nova-compute[72849]:   </clock>
Aug 15 16:25:21 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:25:21 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:25:21 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:25:21 user nova-compute[72849]:   </cpu>
Aug 15 16:25:21 user nova-compute[72849]:   <devices>
Aug 15 16:25:21 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:25:21 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:25:21 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk"/>
Aug 15 16:25:21 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:25:21 user nova-compute[72849]:     </disk>
Aug 15 16:25:21 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:25:21 user nova-compute[72849]:       <mac address="fa:16:3e:62:d6:3e"/>
Aug 15 16:25:21 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:25:21 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:25:21 user nova-compute[72849]:       <target dev="tap71bc55dc-c0"/>
Aug 15 16:25:21 user nova-compute[72849]:     </interface>
Aug 15 16:25:21 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:25:21 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/console.log" append="off"/>
Aug 15 16:25:21 user nova-compute[72849]:     </serial>
Aug 15 16:25:21 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:25:21 user nova-compute[72849]:     <video>
Aug 15 16:25:21 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:25:21 user nova-compute[72849]:     </video>
Aug 15 16:25:21 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:25:21 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:25:21 user nova-compute[72849]:     </rng>
Aug 15 16:25:21 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:25:21 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:25:21 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:25:21 user nova-compute[72849]:     </memballoon>
Aug 15 16:25:21 user nova-compute[72849]:   </devices>
Aug 15 16:25:21 user nova-compute[72849]: </domain>
Aug 15 16:25:21 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:25:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1450170250',display_name='tempest-AttachVolumeTestJSON-server-1450170250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1450170250',id=25,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbHBCrfJdjyvvfHVCDAyVY3pxTMcpwjUaUui51i7UWK+4o1OUXo/LN4XWDmXW8h8aEFw/JKcC9Dwq6+Cbh0MQQ2dswuJTGFHVpH2lAWXJOXrjs0Yd41UjVwgxvzDZT+WQ==',key_name='tempest-keypair-1527966259',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='607d6d3506de49549888f16d06829c89',ramdisk_id='',reservation_id='r-vfgrreq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1114163063',owner_user_name='tempest-AttachVolumeTestJSON-1114163063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abdcfedce2124d86a0df67571fdfcde9',uuid=f1da55ae-5150-476c-a229-f26ddfee7e9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converting VIF {"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG os_vif [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71bc55dc-c0, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71bc55dc-c0, col_values=(('external_ids', {'iface-id': '71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:d6:3e', 'vm-uuid': 'f1da55ae-5150-476c-a229-f26ddfee7e9e'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:22 user nova-compute[72849]: INFO os_vif [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0')
Aug 15 16:25:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] No VIF found with MAC fa:16:3e:62:d6:3e, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:25:22 user nova-compute[72849]: INFO nova.compute.manager [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Rescuing
Aug 15 16:25:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquired lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-61bfbd3a-f408-43c4-ac68-953a929c23a8 req-9df2ebf8-99a4-4850-9a9a-6b0512f5bbd7 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received event network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-61bfbd3a-f408-43c4-ac68-953a929c23a8 req-9df2ebf8-99a4-4850-9a9a-6b0512f5bbd7 service nova] Acquiring lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-61bfbd3a-f408-43c4-ac68-953a929c23a8 req-9df2ebf8-99a4-4850-9a9a-6b0512f5bbd7 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-61bfbd3a-f408-43c4-ac68-953a929c23a8 req-9df2ebf8-99a4-4850-9a9a-6b0512f5bbd7 service nova] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-61bfbd3a-f408-43c4-ac68-953a929c23a8 req-9df2ebf8-99a4-4850-9a9a-6b0512f5bbd7 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] No waiting events found dispatching network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:22 user nova-compute[72849]: WARNING nova.compute.manager [req-61bfbd3a-f408-43c4-ac68-953a929c23a8 req-9df2ebf8-99a4-4850-9a9a-6b0512f5bbd7 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received unexpected event network-vif-plugged-25a67315-9859-4077-8f36-23635b760770 for instance with vm_state active and task_state deleting.
Aug 15 16:25:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-61bfbd3a-f408-43c4-ac68-953a929c23a8 req-9df2ebf8-99a4-4850-9a9a-6b0512f5bbd7 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received event network-changed-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-61bfbd3a-f408-43c4-ac68-953a929c23a8 req-9df2ebf8-99a4-4850-9a9a-6b0512f5bbd7 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Refreshing instance network info cache due to event network-changed-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-61bfbd3a-f408-43c4-ac68-953a929c23a8 req-9df2ebf8-99a4-4850-9a9a-6b0512f5bbd7 service nova] Acquiring lock "refresh_cache-f1da55ae-5150-476c-a229-f26ddfee7e9e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-61bfbd3a-f408-43c4-ac68-953a929c23a8 req-9df2ebf8-99a4-4850-9a9a-6b0512f5bbd7 service nova] Acquired lock "refresh_cache-f1da55ae-5150-476c-a229-f26ddfee7e9e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG nova.network.neutron [req-61bfbd3a-f408-43c4-ac68-953a929c23a8 req-9df2ebf8-99a4-4850-9a9a-6b0512f5bbd7 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Refreshing network info cache for port 71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:25:22 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Took 1.23 seconds to deallocate network for instance.
Aug 15 16:25:22 user nova-compute[72849]: INFO nova.compute.manager [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Took 2.85 seconds to detach 3 volumes for instance.
Aug 15 16:25:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:23 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Updating instance_info_cache with network_info: [{"id": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "address": "fa:16:3e:ca:d6:ea", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010fd638-d6", "ovs_interfaceid": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:25:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:23 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:25:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Releasing lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:25:23 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:25:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.576s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:23 user nova-compute[72849]: DEBUG nova.network.neutron [req-61bfbd3a-f408-43c4-ac68-953a929c23a8 req-9df2ebf8-99a4-4850-9a9a-6b0512f5bbd7 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Updated VIF entry in instance network info cache for port 71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:25:23 user nova-compute[72849]: DEBUG nova.network.neutron [req-61bfbd3a-f408-43c4-ac68-953a929c23a8 req-9df2ebf8-99a4-4850-9a9a-6b0512f5bbd7 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Updating instance_info_cache with network_info: [{"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:25:23 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Deleted allocations for instance 49874ea8-8d01-4de6-a3cc-fc35af67665e
Aug 15 16:25:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-61bfbd3a-f408-43c4-ac68-953a929c23a8 req-9df2ebf8-99a4-4850-9a9a-6b0512f5bbd7 service nova] Releasing lock "refresh_cache-f1da55ae-5150-476c-a229-f26ddfee7e9e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:25:23 user nova-compute[72849]: INFO nova.compute.manager [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Took 0.96 seconds to detach 1 volumes for instance.
Aug 15 16:25:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-98e5b767-f23b-492e-b321-bbf14aa07468 tempest-TaggedBootDevicesTest_v242-2042209791 tempest-TaggedBootDevicesTest_v242-2042209791-project-member] Lock "49874ea8-8d01-4de6-a3cc-fc35af67665e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.509s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:23 user nova-compute[72849]: DEBUG nova.compute.manager [req-df36bd7b-a5bd-4a81-811c-f6bd82943adc req-02836938-f9c9-4ea7-9ddb-2d9fc34fe4f1 service nova] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Received event network-vif-deleted-25a67315-9859-4077-8f36-23635b760770 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.663s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:25:24 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Deleted allocations for instance b0a869eb-9ee8-4c31-9786-5b8be7d362a9
Aug 15 16:25:24 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Instance destroyed successfully.
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:25:24 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Attempting rescue
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72849) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Instance directory exists: not creating {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 16:25:24 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Creating image(s)
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "/opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "/opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'trusted_certs' on Instance uuid cc521d87-09aa-44ba-a87c-1cd5517b3707 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-f5ad6a5e-deda-4aee-b32b-9bbc19d3e5db req-1067297f-b412-46c8-9385-b21c7e15405f service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received event network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f5ad6a5e-deda-4aee-b32b-9bbc19d3e5db req-1067297f-b412-46c8-9385-b21c7e15405f service nova] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f5ad6a5e-deda-4aee-b32b-9bbc19d3e5db req-1067297f-b412-46c8-9385-b21c7e15405f service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f5ad6a5e-deda-4aee-b32b-9bbc19d3e5db req-1067297f-b412-46c8-9385-b21c7e15405f service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-f5ad6a5e-deda-4aee-b32b-9bbc19d3e5db req-1067297f-b412-46c8-9385-b21c7e15405f service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] No waiting events found dispatching network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:24 user nova-compute[72849]: WARNING nova.compute.manager [req-f5ad6a5e-deda-4aee-b32b-9bbc19d3e5db req-1067297f-b412-46c8-9385-b21c7e15405f service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received unexpected event network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba for instance with vm_state building and task_state spawning.
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-f5ad6a5e-deda-4aee-b32b-9bbc19d3e5db req-1067297f-b412-46c8-9385-b21c7e15405f service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received event network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f5ad6a5e-deda-4aee-b32b-9bbc19d3e5db req-1067297f-b412-46c8-9385-b21c7e15405f service nova] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f5ad6a5e-deda-4aee-b32b-9bbc19d3e5db req-1067297f-b412-46c8-9385-b21c7e15405f service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f5ad6a5e-deda-4aee-b32b-9bbc19d3e5db req-1067297f-b412-46c8-9385-b21c7e15405f service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-f5ad6a5e-deda-4aee-b32b-9bbc19d3e5db req-1067297f-b412-46c8-9385-b21c7e15405f service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] No waiting events found dispatching network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:24 user nova-compute[72849]: WARNING nova.compute.manager [req-f5ad6a5e-deda-4aee-b32b-9bbc19d3e5db req-1067297f-b412-46c8-9385-b21c7e15405f service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received unexpected event network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba for instance with vm_state building and task_state spawning.
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-71cd397f-a3b2-4a55-a5be-8387d33793bb tempest-ServerActionsTestOtherB-1970367935 tempest-ServerActionsTestOtherB-1970367935-project-member] Lock "b0a869eb-9ee8-4c31-9786-5b8be7d362a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.771s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.264s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk.rescue {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk.rescue" returned: 0 in 0.124s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.395s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'migration_context' on Instance uuid cc521d87-09aa-44ba-a87c-1cd5517b3707 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Start _get_guest_xml network_info=[{"id": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "address": "fa:16:3e:ca:d6:ea", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "vif_mac": "fa:16:3e:ca:d6:ea"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010fd638-d6", "ovs_interfaceid": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'resources' on Instance uuid cc521d87-09aa-44ba-a87c-1cd5517b3707 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'numa_topology' on Instance uuid cc521d87-09aa-44ba-a87c-1cd5517b3707 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:24 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:25:24 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:25:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:25:24 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'vcpu_model' on Instance uuid cc521d87-09aa-44ba-a87c-1cd5517b3707 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:20:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1632196122',display_name='tempest-ServerRescueNegativeTestJSON-server-1632196122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1632196122',id=16,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63fff6abd55f4552b56b7f80f3b19990',ramdisk_id='',reservation_id='r-3orjfdvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-817230683',owner_user_name='tempest-ServerRescueNegativeTestJSON-817230683-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:20:47Z,user_data=None,user_id='a6bc0fd1358a42debf05e9bc43b8e329',uuid=cc521d87-09aa-44ba-a87c-1cd5517b3707,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "address": "fa:16:3e:ca:d6:ea", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "vif_mac": "fa:16:3e:ca:d6:ea"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010fd638-d6", "ovs_interfaceid": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converting VIF {"id": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "address": "fa:16:3e:ca:d6:ea", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "vif_mac": "fa:16:3e:ca:d6:ea"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010fd638-d6", "ovs_interfaceid": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:d6:ea,bridge_name='br-int',has_traffic_filtering=True,id=010fd638-d6f5-40be-b322-8d3f7b1d29de,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010fd638-d6') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'pci_devices' on Instance uuid cc521d87-09aa-44ba-a87c-1cd5517b3707 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:25:25 user nova-compute[72849]:   <uuid>cc521d87-09aa-44ba-a87c-1cd5517b3707</uuid>
Aug 15 16:25:25 user nova-compute[72849]:   <name>instance-00000010</name>
Aug 15 16:25:25 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:25:25 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:25:25 user nova-compute[72849]:   <metadata>
Aug 15 16:25:25 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:25:25 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:25:25 user nova-compute[72849]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1632196122</nova:name>
Aug 15 16:25:25 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:25:24</nova:creationTime>
Aug 15 16:25:25 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:25:25 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:25:25 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:25:25 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:25:25 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:25:25 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:25:25 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:25:25 user nova-compute[72849]:       <nova:owner>
Aug 15 16:25:25 user nova-compute[72849]:         <nova:user uuid="a6bc0fd1358a42debf05e9bc43b8e329">tempest-ServerRescueNegativeTestJSON-817230683-project-member</nova:user>
Aug 15 16:25:25 user nova-compute[72849]:         <nova:project uuid="63fff6abd55f4552b56b7f80f3b19990">tempest-ServerRescueNegativeTestJSON-817230683</nova:project>
Aug 15 16:25:25 user nova-compute[72849]:       </nova:owner>
Aug 15 16:25:25 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:25:25 user nova-compute[72849]:       <nova:ports>
Aug 15 16:25:25 user nova-compute[72849]:         <nova:port uuid="010fd638-d6f5-40be-b322-8d3f7b1d29de">
Aug 15 16:25:25 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 16:25:25 user nova-compute[72849]:         </nova:port>
Aug 15 16:25:25 user nova-compute[72849]:       </nova:ports>
Aug 15 16:25:25 user nova-compute[72849]:     </nova:instance>
Aug 15 16:25:25 user nova-compute[72849]:   </metadata>
Aug 15 16:25:25 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:25:25 user nova-compute[72849]:     <system>
Aug 15 16:25:25 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:25:25 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:25:25 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:25:25 user nova-compute[72849]:       <entry name="serial">cc521d87-09aa-44ba-a87c-1cd5517b3707</entry>
Aug 15 16:25:25 user nova-compute[72849]:       <entry name="uuid">cc521d87-09aa-44ba-a87c-1cd5517b3707</entry>
Aug 15 16:25:25 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:25:25 user nova-compute[72849]:     </system>
Aug 15 16:25:25 user nova-compute[72849]:   </sysinfo>
Aug 15 16:25:25 user nova-compute[72849]:   <os>
Aug 15 16:25:25 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:25:25 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:25:25 user nova-compute[72849]:   </os>
Aug 15 16:25:25 user nova-compute[72849]:   <features>
Aug 15 16:25:25 user nova-compute[72849]:     <acpi/>
Aug 15 16:25:25 user nova-compute[72849]:     <apic/>
Aug 15 16:25:25 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:25:25 user nova-compute[72849]:   </features>
Aug 15 16:25:25 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:25:25 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:25:25 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:25:25 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:25:25 user nova-compute[72849]:   </clock>
Aug 15 16:25:25 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:25:25 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:25:25 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:25:25 user nova-compute[72849]:   </cpu>
Aug 15 16:25:25 user nova-compute[72849]:   <devices>
Aug 15 16:25:25 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:25:25 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:25:25 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk.rescue"/>
Aug 15 16:25:25 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:25:25 user nova-compute[72849]:     </disk>
Aug 15 16:25:25 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:25:25 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:25:25 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk"/>
Aug 15 16:25:25 user nova-compute[72849]:       <target dev="vdb" bus="virtio"/>
Aug 15 16:25:25 user nova-compute[72849]:     </disk>
Aug 15 16:25:25 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:25:25 user nova-compute[72849]:       <mac address="fa:16:3e:ca:d6:ea"/>
Aug 15 16:25:25 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:25:25 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:25:25 user nova-compute[72849]:       <target dev="tap010fd638-d6"/>
Aug 15 16:25:25 user nova-compute[72849]:     </interface>
Aug 15 16:25:25 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:25:25 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/console.log" append="off"/>
Aug 15 16:25:25 user nova-compute[72849]:     </serial>
Aug 15 16:25:25 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:25:25 user nova-compute[72849]:     <video>
Aug 15 16:25:25 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:25:25 user nova-compute[72849]:     </video>
Aug 15 16:25:25 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:25:25 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:25:25 user nova-compute[72849]:     </rng>
Aug 15 16:25:25 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:25:25 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:25:25 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:25:25 user nova-compute[72849]:     </memballoon>
Aug 15 16:25:25 user nova-compute[72849]:   </devices>
Aug 15 16:25:25 user nova-compute[72849]: </domain>
Aug 15 16:25:25 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-b0a869eb-9ee8-4c31-9786-5b8be7d362a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:25:25 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Instance destroyed successfully.
Aug 15 16:25:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] No VIF found with MAC fa:16:3e:ca:d6:ea, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-ca903a92-10d2-49d2-b039-d44085f994cb req-f8b4384b-dfbd-44e4-a323-4af1ec884efe service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received event network-vif-unplugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ca903a92-10d2-49d2-b039-d44085f994cb req-f8b4384b-dfbd-44e4-a323-4af1ec884efe service nova] Acquiring lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ca903a92-10d2-49d2-b039-d44085f994cb req-f8b4384b-dfbd-44e4-a323-4af1ec884efe service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ca903a92-10d2-49d2-b039-d44085f994cb req-f8b4384b-dfbd-44e4-a323-4af1ec884efe service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-ca903a92-10d2-49d2-b039-d44085f994cb req-f8b4384b-dfbd-44e4-a323-4af1ec884efe service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] No waiting events found dispatching network-vif-unplugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:25 user nova-compute[72849]: WARNING nova.compute.manager [req-ca903a92-10d2-49d2-b039-d44085f994cb req-f8b4384b-dfbd-44e4-a323-4af1ec884efe service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received unexpected event network-vif-unplugged-010fd638-d6f5-40be-b322-8d3f7b1d29de for instance with vm_state active and task_state rescuing.
Aug 15 16:25:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-ca903a92-10d2-49d2-b039-d44085f994cb req-f8b4384b-dfbd-44e4-a323-4af1ec884efe service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received event network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ca903a92-10d2-49d2-b039-d44085f994cb req-f8b4384b-dfbd-44e4-a323-4af1ec884efe service nova] Acquiring lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ca903a92-10d2-49d2-b039-d44085f994cb req-f8b4384b-dfbd-44e4-a323-4af1ec884efe service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ca903a92-10d2-49d2-b039-d44085f994cb req-f8b4384b-dfbd-44e4-a323-4af1ec884efe service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-ca903a92-10d2-49d2-b039-d44085f994cb req-f8b4384b-dfbd-44e4-a323-4af1ec884efe service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] No waiting events found dispatching network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:25 user nova-compute[72849]: WARNING nova.compute.manager [req-ca903a92-10d2-49d2-b039-d44085f994cb req-f8b4384b-dfbd-44e4-a323-4af1ec884efe service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received unexpected event network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de for instance with vm_state active and task_state rescuing.
Aug 15 16:25:26 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116726.4047952, f1da55ae-5150-476c-a229-f26ddfee7e9e => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:25:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] VM Resumed (Lifecycle Event)
Aug 15 16:25:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:25:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:25:26 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Instance spawned successfully.
Aug 15 16:25:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:25:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:25:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:25:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:25:26 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116726.4079728, f1da55ae-5150-476c-a229-f26ddfee7e9e => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:25:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] VM Started (Lifecycle Event)
Aug 15 16:25:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:25:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:25:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:25:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:25:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:25:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:25:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:25:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:25:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:25:26 user nova-compute[72849]: INFO nova.compute.manager [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Took 7.77 seconds to spawn the instance on the hypervisor.
Aug 15 16:25:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:25:26 user nova-compute[72849]: INFO nova.compute.manager [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Took 8.93 seconds to build instance.
Aug 15 16:25:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5ed34884-77a6-4052-b770-e332befbc345 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.104s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'flavor' on Instance uuid 052cde29-421b-4b17-9bcd-acd58456ddba {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7675860e-3f22-4f82-82c9-d65bfaf835c0 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "052cde29-421b-4b17-9bcd-acd58456ddba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 10.672s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-355ef236-26c0-4f1d-b3b1-6de1e6bea1dc req-720c22dd-10aa-4cfe-86a8-61c3e0518283 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received event network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-355ef236-26c0-4f1d-b3b1-6de1e6bea1dc req-720c22dd-10aa-4cfe-86a8-61c3e0518283 service nova] Acquiring lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-355ef236-26c0-4f1d-b3b1-6de1e6bea1dc req-720c22dd-10aa-4cfe-86a8-61c3e0518283 service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-355ef236-26c0-4f1d-b3b1-6de1e6bea1dc req-720c22dd-10aa-4cfe-86a8-61c3e0518283 service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-355ef236-26c0-4f1d-b3b1-6de1e6bea1dc req-720c22dd-10aa-4cfe-86a8-61c3e0518283 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] No waiting events found dispatching network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:27 user nova-compute[72849]: WARNING nova.compute.manager [req-355ef236-26c0-4f1d-b3b1-6de1e6bea1dc req-720c22dd-10aa-4cfe-86a8-61c3e0518283 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received unexpected event network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de for instance with vm_state active and task_state rescuing.
Aug 15 16:25:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-355ef236-26c0-4f1d-b3b1-6de1e6bea1dc req-720c22dd-10aa-4cfe-86a8-61c3e0518283 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received event network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-355ef236-26c0-4f1d-b3b1-6de1e6bea1dc req-720c22dd-10aa-4cfe-86a8-61c3e0518283 service nova] Acquiring lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-355ef236-26c0-4f1d-b3b1-6de1e6bea1dc req-720c22dd-10aa-4cfe-86a8-61c3e0518283 service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-355ef236-26c0-4f1d-b3b1-6de1e6bea1dc req-720c22dd-10aa-4cfe-86a8-61c3e0518283 service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-355ef236-26c0-4f1d-b3b1-6de1e6bea1dc req-720c22dd-10aa-4cfe-86a8-61c3e0518283 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] No waiting events found dispatching network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:27 user nova-compute[72849]: WARNING nova.compute.manager [req-355ef236-26c0-4f1d-b3b1-6de1e6bea1dc req-720c22dd-10aa-4cfe-86a8-61c3e0518283 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received unexpected event network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de for instance with vm_state active and task_state rescuing.
Aug 15 16:25:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:28 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116713.1047275, 49874ea8-8d01-4de6-a3cc-fc35af67665e => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:25:28 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] VM Stopped (Lifecycle Event)
Aug 15 16:25:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-63df5043-9e48-4afb-aba1-6f3d0af0c31a None None] [instance: 49874ea8-8d01-4de6-a3cc-fc35af67665e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:25:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Removed pending event for cc521d87-09aa-44ba-a87c-1cd5517b3707 due to event {{(pid=72849) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 16:25:28 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116728.8999612, cc521d87-09aa-44ba-a87c-1cd5517b3707 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:25:28 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] VM Resumed (Lifecycle Event)
Aug 15 16:25:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9f2c6917-4f07-4682-b272-8105f464047b tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:25:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:25:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:25:29 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 16:25:29 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116728.900843, cc521d87-09aa-44ba-a87c-1cd5517b3707 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:25:29 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] VM Started (Lifecycle Event)
Aug 15 16:25:29 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:25:29 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:25:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:29 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 16:25:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:29 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:25:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:25:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:33 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:25:33 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:25:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=6913MB free_disk=25.25101089477539GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:25:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:25:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:25:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:25:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 052cde29-421b-4b17-9bcd-acd58456ddba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:25:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc521d87-09aa-44ba-a87c-1cd5517b3707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:25:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 46f0aa43-e313-4aff-bacc-aa5290193b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:25:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:25:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance a3221960-e5ff-4185-a5dd-09f2cd293cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:25:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 25db7eb1-fa77-4342-922c-4f82f8f27702 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:25:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance e5b383e8-a80b-432c-8239-59f102c45750 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:25:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 16a347d7-5057-4f06-bac3-98c06c0c66ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:25:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance d51623f1-6613-41d6-abcb-9e4e626a97af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:25:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f1da55ae-5150-476c-a229-f26ddfee7e9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:25:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:25:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:25:34 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:25:34 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:25:34 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:25:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.687s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:35 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:25:35 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:25:35 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:25:35 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:25:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:25:35 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116720.6930053, b0a869eb-9ee8-4c31-9786-5b8be7d362a9 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:25:35 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] VM Stopped (Lifecycle Event)
Aug 15 16:25:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4d73edf4-efcd-420d-904e-368bc1895c1e None None] [instance: b0a869eb-9ee8-4c31-9786-5b8be7d362a9] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:25:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "25db7eb1-fa77-4342-922c-4f82f8f27702" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:53 user nova-compute[72849]: INFO nova.compute.manager [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Detaching volume fe4bed5d-d574-405f-bad4-26a6df0509d4
Aug 15 16:25:53 user nova-compute[72849]: INFO nova.virt.block_device [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Attempting to driver detach volume fe4bed5d-d574-405f-bad4-26a6df0509d4 from mountpoint /dev/vdb
Aug 15 16:25:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Attempting to detach device vdb from instance 25db7eb1-fa77-4342-922c-4f82f8f27702 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:25:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:25:53 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:25:53 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:25:53 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:25:53 user nova-compute[72849]:   <serial>fe4bed5d-d574-405f-bad4-26a6df0509d4</serial>
Aug 15 16:25:53 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:25:53 user nova-compute[72849]: </disk>
Aug 15 16:25:53 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:25:53 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Successfully detached device vdb from instance 25db7eb1-fa77-4342-922c-4f82f8f27702 from the persistent domain config.
Aug 15 16:25:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25db7eb1-fa77-4342-922c-4f82f8f27702 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:25:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:25:53 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:25:53 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:25:53 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:25:53 user nova-compute[72849]:   <serial>fe4bed5d-d574-405f-bad4-26a6df0509d4</serial>
Aug 15 16:25:53 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:25:53 user nova-compute[72849]: </disk>
Aug 15 16:25:53 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:25:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "25db7eb1-fa77-4342-922c-4f82f8f27702" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquiring lock "e5b383e8-a80b-432c-8239-59f102c45750" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "e5b383e8-a80b-432c-8239-59f102c45750" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquiring lock "e5b383e8-a80b-432c-8239-59f102c45750-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "e5b383e8-a80b-432c-8239-59f102c45750-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "e5b383e8-a80b-432c-8239-59f102c45750-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:53 user nova-compute[72849]: INFO nova.compute.manager [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Terminating instance
Aug 15 16:25:53 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:25:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692116754.0918496, 25db7eb1-fa77-4342-922c-4f82f8f27702 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25db7eb1-fa77-4342-922c-4f82f8f27702 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:25:54 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Successfully detached device vdb from instance 25db7eb1-fa77-4342-922c-4f82f8f27702 from the live domain config.
Aug 15 16:25:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nvLijXsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:25:54 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[897d9ac6-f36e-49e7-958a-82a7d663d043]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d06f027-f060-46db-925e-da4e9c1c80e8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:25:54 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:25:54 user nova-compute[72849]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 (non-flash)
Aug 15 16:25:54 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:25:54 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:25:54 user nova-compute[72849]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 (non-flash)
Aug 15 16:25:54 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3780bb6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[83088c12-6478-46e1-a97d-502ad1340e3a]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b405bffb-90db-404e-b275-798ebea52764]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ffc091-c0c3-404e-bd78-8c84e4cb0519]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-74a5f882-bd84-41aa-b0ee-dd100e96b188 req-c73c5c7c-4bea-4cc1-94e9-afab55c1d3e5 service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Received event network-vif-unplugged-50094cfd-4c62-49b2-a22d-2dd47d692d57 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74a5f882-bd84-41aa-b0ee-dd100e96b188 req-c73c5c7c-4bea-4cc1-94e9-afab55c1d3e5 service nova] Acquiring lock "e5b383e8-a80b-432c-8239-59f102c45750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74a5f882-bd84-41aa-b0ee-dd100e96b188 req-c73c5c7c-4bea-4cc1-94e9-afab55c1d3e5 service nova] Lock "e5b383e8-a80b-432c-8239-59f102c45750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-74a5f882-bd84-41aa-b0ee-dd100e96b188 req-c73c5c7c-4bea-4cc1-94e9-afab55c1d3e5 service nova] Lock "e5b383e8-a80b-432c-8239-59f102c45750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-74a5f882-bd84-41aa-b0ee-dd100e96b188 req-c73c5c7c-4bea-4cc1-94e9-afab55c1d3e5 service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] No waiting events found dispatching network-vif-unplugged-50094cfd-4c62-49b2-a22d-2dd47d692d57 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-74a5f882-bd84-41aa-b0ee-dd100e96b188 req-c73c5c7c-4bea-4cc1-94e9-afab55c1d3e5 service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Received event network-vif-unplugged-50094cfd-4c62-49b2-a22d-2dd47d692d57 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6befa4da-ac38-45ac-abe2-b9f5626f6164]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4cf544-9ce9-40d9-969d-bc8ff7555a83]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7391e210-c29e-4a05-b9a8-7b1a9b54ef35]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4, portal: 172.16.0.220,3260]
Aug 15 16:25:54 user nova-compute[72849]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4, portal: 172.16.0.220,3260] successful.
Aug 15 16:25:54 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[319cb268-a631-4091-9996-98f750dbd9b5]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] <== disconnect_volume: return (318ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:25:54 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Instance destroyed successfully.
Aug 15 16:25:54 user nova-compute[72849]: DEBUG nova.objects.instance [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lazy-loading 'resources' on Instance uuid e5b383e8-a80b-432c-8239-59f102c45750 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:24:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1247722994',display_name='tempest-ServersNegativeTestJSON-server-1247722994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1247722994',id=22,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:24:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c44524588624412a2fe9d7988490479',ramdisk_id='',reservation_id='r-avq802w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1396852941',owner_user_name='tempest-ServersNegativeTestJSON-1396852941-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:24:11Z,user_data=None,user_id='f0209ddf9fde4b71a069c9dfd3513e7e',uuid=e5b383e8-a80b-432c-8239-59f102c45750,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "address": "fa:16:3e:c5:7a:37", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50094cfd-4c", "ovs_interfaceid": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Converting VIF {"id": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "address": "fa:16:3e:c5:7a:37", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50094cfd-4c", "ovs_interfaceid": "50094cfd-4c62-49b2-a22d-2dd47d692d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:7a:37,bridge_name='br-int',has_traffic_filtering=True,id=50094cfd-4c62-49b2-a22d-2dd47d692d57,network=Network(8b5ff7d7-7bfc-467c-aae2-eced27be5b87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50094cfd-4c') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG os_vif [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:7a:37,bridge_name='br-int',has_traffic_filtering=True,id=50094cfd-4c62-49b2-a22d-2dd47d692d57,network=Network(8b5ff7d7-7bfc-467c-aae2-eced27be5b87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50094cfd-4c') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50094cfd-4c, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:25:54 user nova-compute[72849]: INFO os_vif [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:7a:37,bridge_name='br-int',has_traffic_filtering=True,id=50094cfd-4c62-49b2-a22d-2dd47d692d57,network=Network(8b5ff7d7-7bfc-467c-aae2-eced27be5b87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50094cfd-4c')
Aug 15 16:25:54 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Deleting instance files /opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750_del
Aug 15 16:25:54 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Deletion of /opt/stack/data/nova/instances/e5b383e8-a80b-432c-8239-59f102c45750_del complete
Aug 15 16:25:54 user nova-compute[72849]: INFO nova.compute.manager [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 15 16:25:54 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:25:54 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: e5b383e8-a80b-432c-8239-59f102c45750] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:25:55 user nova-compute[72849]: DEBUG nova.objects.instance [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lazy-loading 'flavor' on Instance uuid 25db7eb1-fa77-4342-922c-4f82f8f27702 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:55 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:25:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-905d5058-9b83-4969-99da-ccde3a31aba9 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.834s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.684s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "25db7eb1-fa77-4342-922c-4f82f8f27702-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:55 user nova-compute[72849]: INFO nova.compute.manager [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Terminating instance
Aug 15 16:25:55 user nova-compute[72849]: DEBUG nova.compute.manager [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:25:55 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Took 0.71 seconds to deallocate network for instance.
Aug 15 16:25:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-ff6e8af1-0538-4ab4-b557-aec3d6072f6b req-329e60a7-beab-4f30-85b6-711ba72ddad1 service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Received event network-vif-deleted-50094cfd-4c62-49b2-a22d-2dd47d692d57 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:55 user nova-compute[72849]: INFO nova.compute.manager [req-ff6e8af1-0538-4ab4-b557-aec3d6072f6b req-329e60a7-beab-4f30-85b6-711ba72ddad1 service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Neutron deleted interface 50094cfd-4c62-49b2-a22d-2dd47d692d57; detaching it from the instance and deleting it from the info cache
Aug 15 16:25:55 user nova-compute[72849]: DEBUG nova.network.neutron [req-ff6e8af1-0538-4ab4-b557-aec3d6072f6b req-329e60a7-beab-4f30-85b6-711ba72ddad1 service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:25:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-ff6e8af1-0538-4ab4-b557-aec3d6072f6b req-329e60a7-beab-4f30-85b6-711ba72ddad1 service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Detach interface failed, port_id=50094cfd-4c62-49b2-a22d-2dd47d692d57, reason: Instance e5b383e8-a80b-432c-8239-59f102c45750 could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:25:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:55 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:25:55 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:25:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:55 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Deleted allocations for instance e5b383e8-a80b-432c-8239-59f102c45750
Aug 15 16:25:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ba7ec62-ba75-4db0-a08e-b199c0679899 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "e5b383e8-a80b-432c-8239-59f102c45750" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.150s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:56 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Instance destroyed successfully.
Aug 15 16:25:56 user nova-compute[72849]: DEBUG nova.objects.instance [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lazy-loading 'resources' on Instance uuid 25db7eb1-fa77-4342-922c-4f82f8f27702 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:23:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-358556613',display_name='tempest-VolumesSnapshotTestJSON-instance-358556613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-358556613',id=21,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGv5s9QZs5pS5hVziUQTZuawXqnwvd8zWxFI0r907PaXvIDlOGdEX50IMebvlb6CiaEctT2UmLitjVxNDSnPjrh70a0vrIpQhINU7Ty3grTCenfExKvDB+DRtfET41CWXQ==',key_name='tempest-keypair-1205732152',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:23:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='065226f254df40baaf230ccd5f13f62a',ramdisk_id='',reservation_id='r-j9npdjww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1243118890',owner_user_name='tempest-VolumesSnapshotTestJSON-1243118890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2471145e3ea84645bcfa51f4fcf4cbbc',uuid=25db7eb1-fa77-4342-922c-4f82f8f27702,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "address": "fa:16:3e:85:7c:de", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb502cd2-ee", "ovs_interfaceid": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Converting VIF {"id": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "address": "fa:16:3e:85:7c:de", "network": {"id": "ea172a57-fdfb-45f3-b3df-e6f4751eb20b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1304212121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065226f254df40baaf230ccd5f13f62a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb502cd2-ee", "ovs_interfaceid": "bb502cd2-eea4-4ce2-8cd2-98fd80832595", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:7c:de,bridge_name='br-int',has_traffic_filtering=True,id=bb502cd2-eea4-4ce2-8cd2-98fd80832595,network=Network(ea172a57-fdfb-45f3-b3df-e6f4751eb20b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb502cd2-ee') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG os_vif [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:7c:de,bridge_name='br-int',has_traffic_filtering=True,id=bb502cd2-eea4-4ce2-8cd2-98fd80832595,network=Network(ea172a57-fdfb-45f3-b3df-e6f4751eb20b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb502cd2-ee') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb502cd2-ee, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:25:56 user nova-compute[72849]: INFO os_vif [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:7c:de,bridge_name='br-int',has_traffic_filtering=True,id=bb502cd2-eea4-4ce2-8cd2-98fd80832595,network=Network(ea172a57-fdfb-45f3-b3df-e6f4751eb20b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb502cd2-ee')
Aug 15 16:25:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nvLijXsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:25:56 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:25:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe4bed5d-d574-405f-bad4-26a6df0509d4', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b75d48-38cd-4cd6-aeff-20e10ebb6d78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d34cc7-7363-4ef7-a7fc-cc10999c3a4a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:25:56 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:25:56 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:25:56 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:25:56 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc358278af0>, {}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Disconnecting from: [] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.046s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] <== disconnect_volume: return (48ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:25:56 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Deleting instance files /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702_del
Aug 15 16:25:56 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Deletion of /opt/stack/data/nova/instances/25db7eb1-fa77-4342-922c-4f82f8f27702_del complete
Aug 15 16:25:56 user nova-compute[72849]: DEBUG nova.compute.manager [req-3d5e9c5e-641d-4f58-8cad-1cd148835820 req-820946ef-6edf-4a84-b9c8-ed1bbe0d0a5e service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Received event network-vif-plugged-50094cfd-4c62-49b2-a22d-2dd47d692d57 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3d5e9c5e-641d-4f58-8cad-1cd148835820 req-820946ef-6edf-4a84-b9c8-ed1bbe0d0a5e service nova] Acquiring lock "e5b383e8-a80b-432c-8239-59f102c45750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3d5e9c5e-641d-4f58-8cad-1cd148835820 req-820946ef-6edf-4a84-b9c8-ed1bbe0d0a5e service nova] Lock "e5b383e8-a80b-432c-8239-59f102c45750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3d5e9c5e-641d-4f58-8cad-1cd148835820 req-820946ef-6edf-4a84-b9c8-ed1bbe0d0a5e service nova] Lock "e5b383e8-a80b-432c-8239-59f102c45750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG nova.compute.manager [req-3d5e9c5e-641d-4f58-8cad-1cd148835820 req-820946ef-6edf-4a84-b9c8-ed1bbe0d0a5e service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] No waiting events found dispatching network-vif-plugged-50094cfd-4c62-49b2-a22d-2dd47d692d57 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:56 user nova-compute[72849]: WARNING nova.compute.manager [req-3d5e9c5e-641d-4f58-8cad-1cd148835820 req-820946ef-6edf-4a84-b9c8-ed1bbe0d0a5e service nova] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Received unexpected event network-vif-plugged-50094cfd-4c62-49b2-a22d-2dd47d692d57 for instance with vm_state deleted and task_state None.
Aug 15 16:25:56 user nova-compute[72849]: INFO nova.compute.manager [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 15 16:25:56 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:25:56 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:25:57 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:25:57 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Took 0.91 seconds to deallocate network for instance.
Aug 15 16:25:57 user nova-compute[72849]: WARNING nova.volume.cinder [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Attachment abcdf260-7cc7-48a1-af0f-287248f4a349 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = abcdf260-7cc7-48a1-af0f-287248f4a349. (HTTP 404) (Request-ID: req-b8ffd999-1d76-457c-aa2e-0b28d026ace1)
Aug 15 16:25:57 user nova-compute[72849]: INFO nova.compute.manager [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Took 0.03 seconds to detach 1 volumes for instance.
Aug 15 16:25:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-50e62c0e-3d98-43fd-b835-5613f9100e51 req-8e52b762-9693-420b-bfb9-e72f7705004a service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Received event network-vif-unplugged-bb502cd2-eea4-4ce2-8cd2-98fd80832595 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-50e62c0e-3d98-43fd-b835-5613f9100e51 req-8e52b762-9693-420b-bfb9-e72f7705004a service nova] Acquiring lock "25db7eb1-fa77-4342-922c-4f82f8f27702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-50e62c0e-3d98-43fd-b835-5613f9100e51 req-8e52b762-9693-420b-bfb9-e72f7705004a service nova] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-50e62c0e-3d98-43fd-b835-5613f9100e51 req-8e52b762-9693-420b-bfb9-e72f7705004a service nova] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-50e62c0e-3d98-43fd-b835-5613f9100e51 req-8e52b762-9693-420b-bfb9-e72f7705004a service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] No waiting events found dispatching network-vif-unplugged-bb502cd2-eea4-4ce2-8cd2-98fd80832595 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:57 user nova-compute[72849]: WARNING nova.compute.manager [req-50e62c0e-3d98-43fd-b835-5613f9100e51 req-8e52b762-9693-420b-bfb9-e72f7705004a service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Received unexpected event network-vif-unplugged-bb502cd2-eea4-4ce2-8cd2-98fd80832595 for instance with vm_state deleted and task_state None.
Aug 15 16:25:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-50e62c0e-3d98-43fd-b835-5613f9100e51 req-8e52b762-9693-420b-bfb9-e72f7705004a service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Received event network-vif-plugged-bb502cd2-eea4-4ce2-8cd2-98fd80832595 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-50e62c0e-3d98-43fd-b835-5613f9100e51 req-8e52b762-9693-420b-bfb9-e72f7705004a service nova] Acquiring lock "25db7eb1-fa77-4342-922c-4f82f8f27702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-50e62c0e-3d98-43fd-b835-5613f9100e51 req-8e52b762-9693-420b-bfb9-e72f7705004a service nova] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-50e62c0e-3d98-43fd-b835-5613f9100e51 req-8e52b762-9693-420b-bfb9-e72f7705004a service nova] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-50e62c0e-3d98-43fd-b835-5613f9100e51 req-8e52b762-9693-420b-bfb9-e72f7705004a service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] No waiting events found dispatching network-vif-plugged-bb502cd2-eea4-4ce2-8cd2-98fd80832595 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:25:57 user nova-compute[72849]: WARNING nova.compute.manager [req-50e62c0e-3d98-43fd-b835-5613f9100e51 req-8e52b762-9693-420b-bfb9-e72f7705004a service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Received unexpected event network-vif-plugged-bb502cd2-eea4-4ce2-8cd2-98fd80832595 for instance with vm_state deleted and task_state None.
Aug 15 16:25:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-50e62c0e-3d98-43fd-b835-5613f9100e51 req-8e52b762-9693-420b-bfb9-e72f7705004a service nova] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Received event network-vif-deleted-bb502cd2-eea4-4ce2-8cd2-98fd80832595 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:25:57 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:25:57 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:25:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:57 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Deleted allocations for instance 25db7eb1-fa77-4342-922c-4f82f8f27702
Aug 15 16:25:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-47db13c6-52a7-49b3-9fcf-e4b3a411aac7 tempest-VolumesSnapshotTestJSON-1243118890 tempest-VolumesSnapshotTestJSON-1243118890-project-member] Lock "25db7eb1-fa77-4342-922c-4f82f8f27702" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.616s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Acquiring lock "16a347d7-5057-4f06-bac3-98c06c0c66ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "16a347d7-5057-4f06-bac3-98c06c0c66ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG nova.objects.instance [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lazy-loading 'flavor' on Instance uuid 16a347d7-5057-4f06-bac3-98c06c0c66ce {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "16a347d7-5057-4f06-bac3-98c06c0c66ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Acquiring lock "16a347d7-5057-4f06-bac3-98c06c0c66ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "16a347d7-5057-4f06-bac3-98c06c0c66ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:25:58 user nova-compute[72849]: INFO nova.compute.manager [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Attaching volume 1f549eea-8b05-4196-9ffb-bb333b7de9cd to /dev/vdb
Aug 15 16:25:58 user nova-compute[72849]: DEBUG os_brick.utils [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5694a7-a146-4bc7-889f-71f0fecfb95b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84d6e2d-fe59-49b1-8d50-cb2ec2ce8662]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65f13d6-66a5-4823-b07a-82bd255e52b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef9d0a7-94d5-434d-a96d-9884e5a94f08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:25:58 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:25:58 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2276e39e-ee12-46f3-ad47-7e91da557905]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG os_brick.utils [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:25:58 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Updating existing volume attachment record: 79bb0599-573e-4c35-8fa9-3e42f32086c9 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:26:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "052cde29-421b-4b17-9bcd-acd58456ddba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "052cde29-421b-4b17-9bcd-acd58456ddba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:07 user nova-compute[72849]: INFO nova.compute.manager [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Terminating instance
Aug 15 16:26:07 user nova-compute[72849]: DEBUG nova.compute.manager [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-b5bf8c95-5aa6-4ec4-bc5c-e872ad4ca47e req-99553d0c-22d3-4373-870e-5aff9a85ec0d service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received event network-vif-unplugged-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b5bf8c95-5aa6-4ec4-bc5c-e872ad4ca47e req-99553d0c-22d3-4373-870e-5aff9a85ec0d service nova] Acquiring lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b5bf8c95-5aa6-4ec4-bc5c-e872ad4ca47e req-99553d0c-22d3-4373-870e-5aff9a85ec0d service nova] Lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b5bf8c95-5aa6-4ec4-bc5c-e872ad4ca47e req-99553d0c-22d3-4373-870e-5aff9a85ec0d service nova] Lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-b5bf8c95-5aa6-4ec4-bc5c-e872ad4ca47e req-99553d0c-22d3-4373-870e-5aff9a85ec0d service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] No waiting events found dispatching network-vif-unplugged-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-b5bf8c95-5aa6-4ec4-bc5c-e872ad4ca47e req-99553d0c-22d3-4373-870e-5aff9a85ec0d service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received event network-vif-unplugged-a9418a97-870c-46fc-97bc-a65348a97f18 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGZiPqQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:26:07 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:26:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:26:07 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:26:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:26:07 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:26:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f32d61-de0a-4cb1-9e27-cc17987e7028]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:26:07 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[744ff8c2-e5fa-408e-bd76-62d6ec68a135]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd] added
Aug 15 16:26:07 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:26:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e2153a-460e-4d46-bdd9-07b972b619f3]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:08 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Instance destroyed successfully.
Aug 15 16:26:08 user nova-compute[72849]: DEBUG nova.objects.instance [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'resources' on Instance uuid 052cde29-421b-4b17-9bcd-acd58456ddba {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T16:20:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1165172925',display_name='tempest-ServerActionsTestOtherA-server-2077178336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1165172925',id=15,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWBknFznF3Br/e4erZ96RmBYDGn9QHpqMDloNSpP2DJ4x6ZpnS6SI2xoXmzVDqEscehLRvnBUFKCcKRhuMKezXg92SXubTl6wUnndM1gWudDEMYfZ38YquQQ+VVBgQblw==',key_name='tempest-keypair-1330851775',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:22:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33a3a3412c95451db4dd0edc27f361cc',ramdisk_id='',reservation_id='r-8l740hjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-514064593',owner_user_name='tempest-ServerActionsTestOtherA-514064593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:22:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60cbe30799ad4438b84251a254691b70',uuid=052cde29-421b-4b17-9bcd-acd58456ddba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9418a97-870c-46fc-97bc-a65348a97f18", "address": "fa:16:3e:20:6f:8a", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9418a97-87", "ovs_interfaceid": "a9418a97-870c-46fc-97bc-a65348a97f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converting VIF {"id": "a9418a97-870c-46fc-97bc-a65348a97f18", "address": "fa:16:3e:20:6f:8a", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9418a97-87", "ovs_interfaceid": "a9418a97-870c-46fc-97bc-a65348a97f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:6f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a9418a97-870c-46fc-97bc-a65348a97f18,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9418a97-87') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG os_vif [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:6f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a9418a97-870c-46fc-97bc-a65348a97f18,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9418a97-87') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc42787-f872-4146-aa03-36725359f939]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9418a97-87, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rGZiPqQY {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:26:08 user nova-compute[72849]: INFO os_vif [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:6f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a9418a97-870c-46fc-97bc-a65348a97f18,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9418a97-87')
Aug 15 16:26:08 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Deleting instance files /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba_del
Aug 15 16:26:08 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Deletion of /opt/stack/data/nova/instances/052cde29-421b-4b17-9bcd-acd58456ddba_del complete
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rGZiPqQY" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff486948-8065-4666-b069-183a085cd50e]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rGZiPqQY'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3ab67b-0043-4f30-a348-6c3124788d78]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f38a708-4925-4ecd-a718-3982e176fd36]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:26:08 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:26:08 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:26:08 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:26:08 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:26:08 user nova-compute[72849]: INFO nova.compute.manager [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c66f8ca-2452-4c45-b778-bc761aaa268c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd, portal: 172.16.0.220,3260]
Aug 15 16:26:08 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd, portal: 172.16.0.220,3260] successful.
Aug 15 16:26:08 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ce36ba-ea54-410b-a181-632142fef701]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ea039b-3ce2-4858-92a9-759857653585]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:26:08 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:26:08 user nova-compute[72849]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd (non-flash)
Aug 15 16:26:08 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:26:08 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:26:08 user nova-compute[72849]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd (non-flash)
Aug 15 16:26:08 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcea82f6-1001-4998-b870-e26dd4978caa]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:26:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGZiPqQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23462626235363039', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462626235363039', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG nova.objects.instance [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lazy-loading 'flavor' on Instance uuid 16a347d7-5057-4f06-bac3-98c06c0c66ce {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:26:09 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:26:09 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:26:09 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:26:09 user nova-compute[72849]:   <serial>1f549eea-8b05-4196-9ffb-bb333b7de9cd</serial>
Aug 15 16:26:09 user nova-compute[72849]: </disk>
Aug 15 16:26:09 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:26:09 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Took 1.27 seconds to deallocate network for instance.
Aug 15 16:26:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-b1ff3eeb-be45-4665-91fd-69ea81f54935 req-73e63948-4384-43ee-a6d4-0676b1053945 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received event network-vif-deleted-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:26:09 user nova-compute[72849]: INFO nova.compute.manager [req-b1ff3eeb-be45-4665-91fd-69ea81f54935 req-73e63948-4384-43ee-a6d4-0676b1053945 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Neutron deleted interface a9418a97-870c-46fc-97bc-a65348a97f18; detaching it from the instance and deleting it from the info cache
Aug 15 16:26:09 user nova-compute[72849]: DEBUG nova.network.neutron [req-b1ff3eeb-be45-4665-91fd-69ea81f54935 req-73e63948-4384-43ee-a6d4-0676b1053945 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-b1ff3eeb-be45-4665-91fd-69ea81f54935 req-73e63948-4384-43ee-a6d4-0676b1053945 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Detach interface failed, port_id=a9418a97-870c-46fc-97bc-a65348a97f18, reason: Instance 052cde29-421b-4b17-9bcd-acd58456ddba could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116754.4905205, e5b383e8-a80b-432c-8239-59f102c45750 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:26:09 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: e5b383e8-a80b-432c-8239-59f102c45750] VM Stopped (Lifecycle Event)
Aug 15 16:26:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG nova.compute.manager [None req-d0dab232-9996-4377-b8f2-d22d35eeb786 None None] [instance: e5b383e8-a80b-432c-8239-59f102c45750] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-3087456e-3f95-40c8-9f49-789d6d7ce11c req-ee25e9d6-5293-4d4c-b49f-25de894572f2 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received event network-vif-plugged-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3087456e-3f95-40c8-9f49-789d6d7ce11c req-ee25e9d6-5293-4d4c-b49f-25de894572f2 service nova] Acquiring lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3087456e-3f95-40c8-9f49-789d6d7ce11c req-ee25e9d6-5293-4d4c-b49f-25de894572f2 service nova] Lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3087456e-3f95-40c8-9f49-789d6d7ce11c req-ee25e9d6-5293-4d4c-b49f-25de894572f2 service nova] Lock "052cde29-421b-4b17-9bcd-acd58456ddba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-3087456e-3f95-40c8-9f49-789d6d7ce11c req-ee25e9d6-5293-4d4c-b49f-25de894572f2 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] No waiting events found dispatching network-vif-plugged-a9418a97-870c-46fc-97bc-a65348a97f18 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:26:09 user nova-compute[72849]: WARNING nova.compute.manager [req-3087456e-3f95-40c8-9f49-789d6d7ce11c req-ee25e9d6-5293-4d4c-b49f-25de894572f2 service nova] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Received unexpected event network-vif-plugged-a9418a97-870c-46fc-97bc-a65348a97f18 for instance with vm_state deleted and task_state None.
Aug 15 16:26:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] No VIF found with MAC fa:16:3e:3e:35:56, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:26:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:10 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Deleted allocations for instance 052cde29-421b-4b17-9bcd-acd58456ddba
Aug 15 16:26:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ef80783-f6d0-4f4d-84db-7667d6e4691d tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "16a347d7-5057-4f06-bac3-98c06c0c66ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.442s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-75d3273a-de0f-424e-ab97-daf0f816bdc8 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "052cde29-421b-4b17-9bcd-acd58456ddba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.954s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Acquiring lock "16a347d7-5057-4f06-bac3-98c06c0c66ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "16a347d7-5057-4f06-bac3-98c06c0c66ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Acquiring lock "16a347d7-5057-4f06-bac3-98c06c0c66ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "16a347d7-5057-4f06-bac3-98c06c0c66ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "16a347d7-5057-4f06-bac3-98c06c0c66ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:10 user nova-compute[72849]: INFO nova.compute.manager [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Terminating instance
Aug 15 16:26:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:26:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116756.1560178, 25db7eb1-fa77-4342-922c-4f82f8f27702 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:26:11 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] VM Stopped (Lifecycle Event)
Aug 15 16:26:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-55395a06-d78d-484b-80b9-84d83b044c3d None None] [instance: 25db7eb1-fa77-4342-922c-4f82f8f27702] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-d90de4d4-97e1-4595-b17b-9d6414ff7bef req-0aebb82a-9c0a-4ab5-901b-dff4ca6332fe service nova] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Received event network-vif-unplugged-89824f52-7d54-4e33-a54e-892fae59f451 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d90de4d4-97e1-4595-b17b-9d6414ff7bef req-0aebb82a-9c0a-4ab5-901b-dff4ca6332fe service nova] Acquiring lock "16a347d7-5057-4f06-bac3-98c06c0c66ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d90de4d4-97e1-4595-b17b-9d6414ff7bef req-0aebb82a-9c0a-4ab5-901b-dff4ca6332fe service nova] Lock "16a347d7-5057-4f06-bac3-98c06c0c66ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d90de4d4-97e1-4595-b17b-9d6414ff7bef req-0aebb82a-9c0a-4ab5-901b-dff4ca6332fe service nova] Lock "16a347d7-5057-4f06-bac3-98c06c0c66ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-d90de4d4-97e1-4595-b17b-9d6414ff7bef req-0aebb82a-9c0a-4ab5-901b-dff4ca6332fe service nova] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] No waiting events found dispatching network-vif-unplugged-89824f52-7d54-4e33-a54e-892fae59f451 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-d90de4d4-97e1-4595-b17b-9d6414ff7bef req-0aebb82a-9c0a-4ab5-901b-dff4ca6332fe service nova] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Received event network-vif-unplugged-89824f52-7d54-4e33-a54e-892fae59f451 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-d90de4d4-97e1-4595-b17b-9d6414ff7bef req-0aebb82a-9c0a-4ab5-901b-dff4ca6332fe service nova] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Received event network-vif-plugged-89824f52-7d54-4e33-a54e-892fae59f451 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d90de4d4-97e1-4595-b17b-9d6414ff7bef req-0aebb82a-9c0a-4ab5-901b-dff4ca6332fe service nova] Acquiring lock "16a347d7-5057-4f06-bac3-98c06c0c66ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d90de4d4-97e1-4595-b17b-9d6414ff7bef req-0aebb82a-9c0a-4ab5-901b-dff4ca6332fe service nova] Lock "16a347d7-5057-4f06-bac3-98c06c0c66ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d90de4d4-97e1-4595-b17b-9d6414ff7bef req-0aebb82a-9c0a-4ab5-901b-dff4ca6332fe service nova] Lock "16a347d7-5057-4f06-bac3-98c06c0c66ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-d90de4d4-97e1-4595-b17b-9d6414ff7bef req-0aebb82a-9c0a-4ab5-901b-dff4ca6332fe service nova] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] No waiting events found dispatching network-vif-plugged-89824f52-7d54-4e33-a54e-892fae59f451 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:26:11 user nova-compute[72849]: WARNING nova.compute.manager [req-d90de4d4-97e1-4595-b17b-9d6414ff7bef req-0aebb82a-9c0a-4ab5-901b-dff4ca6332fe service nova] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Received unexpected event network-vif-plugged-89824f52-7d54-4e33-a54e-892fae59f451 for instance with vm_state active and task_state deleting.
Aug 15 16:26:11 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Instance destroyed successfully.
Aug 15 16:26:11 user nova-compute[72849]: DEBUG nova.objects.instance [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lazy-loading 'resources' on Instance uuid 16a347d7-5057-4f06-bac3-98c06c0c66ce {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1823583196',display_name='tempest-DeleteServersTestJSON-server-1823583196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1823583196',id=23,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:24:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51d441931c8d4d8284f645949c49e2f1',ramdisk_id='',reservation_id='r-701tr7j1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-850836827',owner_user_name='tempest-DeleteServersTestJSON-850836827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:24:13Z,user_data=None,user_id='a968235f6d66405eaa2ce487ece26ae9',uuid=16a347d7-5057-4f06-bac3-98c06c0c66ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89824f52-7d54-4e33-a54e-892fae59f451", "address": "fa:16:3e:3e:35:56", "network": {"id": "b65d48cb-aa05-418e-a534-2f96f2533a65", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-823464617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51d441931c8d4d8284f645949c49e2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89824f52-7d", "ovs_interfaceid": "89824f52-7d54-4e33-a54e-892fae59f451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Converting VIF {"id": "89824f52-7d54-4e33-a54e-892fae59f451", "address": "fa:16:3e:3e:35:56", "network": {"id": "b65d48cb-aa05-418e-a534-2f96f2533a65", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-823464617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51d441931c8d4d8284f645949c49e2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89824f52-7d", "ovs_interfaceid": "89824f52-7d54-4e33-a54e-892fae59f451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:35:56,bridge_name='br-int',has_traffic_filtering=True,id=89824f52-7d54-4e33-a54e-892fae59f451,network=Network(b65d48cb-aa05-418e-a534-2f96f2533a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89824f52-7d') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_vif [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:35:56,bridge_name='br-int',has_traffic_filtering=True,id=89824f52-7d54-4e33-a54e-892fae59f451,network=Network(b65d48cb-aa05-418e-a534-2f96f2533a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89824f52-7d') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89824f52-7d, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:26:11 user nova-compute[72849]: INFO os_vif [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:35:56,bridge_name='br-int',has_traffic_filtering=True,id=89824f52-7d54-4e33-a54e-892fae59f451,network=Network(b65d48cb-aa05-418e-a534-2f96f2533a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89824f52-7d')
Aug 15 16:26:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGZiPqQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:26:11 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4f080e-4717-40f9-84e3-664d6a7308ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e65ea19-4763-4285-82e7-d9f20b333edf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:26:11 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:26:11 user nova-compute[72849]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd (non-flash)
Aug 15 16:26:11 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:26:11 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:26:11 user nova-compute[72849]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd (non-flash)
Aug 15 16:26:11 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3387356c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7567ed4c-f363-48b9-92a2-78bc8452f11b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7671635d-5336-4e70-b3ce-4ed1271549eb]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b759013f-a5aa-4056-8b23-6c70161e5ea7]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5862d5-38e8-4559-99b6-e8640128d486]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed0b399-1c92-4c67-b90c-4e6974fef64d]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b5d99b-f3ae-46f5-9b64-ef3eba9871b0]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd, portal: 172.16.0.220,3260]
Aug 15 16:26:11 user nova-compute[72849]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd, portal: 172.16.0.220,3260] successful.
Aug 15 16:26:11 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f549eea-8b05-4196-9ffb-bb333b7de9cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0132de50-8ea7-4dd6-b202-3d13e23ee8c8]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] <== disconnect_volume: return (282ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:26:11 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Deleting instance files /opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce_del
Aug 15 16:26:11 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Deletion of /opt/stack/data/nova/instances/16a347d7-5057-4f06-bac3-98c06c0c66ce_del complete
Aug 15 16:26:11 user nova-compute[72849]: INFO nova.compute.manager [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 15 16:26:11 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:26:11 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:26:12 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:26:12 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Took 0.82 seconds to deallocate network for instance.
Aug 15 16:26:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-363eafdb-eedf-4e00-af01-635587538515 req-833cdfea-b1d9-4b6d-8ef8-a05f823546d1 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received event network-changed-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:26:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-363eafdb-eedf-4e00-af01-635587538515 req-833cdfea-b1d9-4b6d-8ef8-a05f823546d1 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Refreshing instance network info cache due to event network-changed-a5ec1882-941b-4bf8-94c2-dd58f74762c6. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:26:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-363eafdb-eedf-4e00-af01-635587538515 req-833cdfea-b1d9-4b6d-8ef8-a05f823546d1 service nova] Acquiring lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:26:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-363eafdb-eedf-4e00-af01-635587538515 req-833cdfea-b1d9-4b6d-8ef8-a05f823546d1 service nova] Acquired lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:26:13 user nova-compute[72849]: DEBUG nova.network.neutron [req-363eafdb-eedf-4e00-af01-635587538515 req-833cdfea-b1d9-4b6d-8ef8-a05f823546d1 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Refreshing network info cache for port a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:26:13 user nova-compute[72849]: INFO nova.compute.manager [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Took 0.86 seconds to detach 1 volumes for instance.
Aug 15 16:26:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-9798772f-72bf-464b-8db2-4c57041dee2f req-edc58781-6ed8-43af-99b0-a744598b0078 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received event network-changed-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:26:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-9798772f-72bf-464b-8db2-4c57041dee2f req-edc58781-6ed8-43af-99b0-a744598b0078 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Refreshing instance network info cache due to event network-changed-a5ec1882-941b-4bf8-94c2-dd58f74762c6. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:26:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9798772f-72bf-464b-8db2-4c57041dee2f req-edc58781-6ed8-43af-99b0-a744598b0078 service nova] Acquiring lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:26:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:13 user nova-compute[72849]: INFO nova.compute.manager [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Detaching volume b9b7a683-8844-46b6-ba4a-20133c67fb9a
Aug 15 16:26:13 user nova-compute[72849]: INFO nova.virt.block_device [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Attempting to driver detach volume b9b7a683-8844-46b6-ba4a-20133c67fb9a from mountpoint /dev/vdb
Aug 15 16:26:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Attempting to detach device vdb from instance 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:26:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:26:13 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:26:13 user nova-compute[72849]:   <source dev="/dev/sdh"/>
Aug 15 16:26:13 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:26:13 user nova-compute[72849]:   <serial>b9b7a683-8844-46b6-ba4a-20133c67fb9a</serial>
Aug 15 16:26:13 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 16:26:13 user nova-compute[72849]: </disk>
Aug 15 16:26:13 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:26:13 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Successfully detached device vdb from instance 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff from the persistent domain config.
Aug 15 16:26:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:26:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:26:13 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:26:13 user nova-compute[72849]:   <source dev="/dev/sdh"/>
Aug 15 16:26:13 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:26:13 user nova-compute[72849]:   <serial>b9b7a683-8844-46b6-ba4a-20133c67fb9a</serial>
Aug 15 16:26:13 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 16:26:13 user nova-compute[72849]: </disk>
Aug 15 16:26:13 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:26:13 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:14 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Deleted allocations for instance 16a347d7-5057-4f06-bac3-98c06c0c66ce
Aug 15 16:26:14 user nova-compute[72849]: DEBUG nova.network.neutron [req-363eafdb-eedf-4e00-af01-635587538515 req-833cdfea-b1d9-4b6d-8ef8-a05f823546d1 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Updated VIF entry in instance network info cache for port a5ec1882-941b-4bf8-94c2-dd58f74762c6. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG nova.network.neutron [req-363eafdb-eedf-4e00-af01-635587538515 req-833cdfea-b1d9-4b6d-8ef8-a05f823546d1 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Updating instance_info_cache with network_info: [{"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-363eafdb-eedf-4e00-af01-635587538515 req-833cdfea-b1d9-4b6d-8ef8-a05f823546d1 service nova] Releasing lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG nova.compute.manager [req-363eafdb-eedf-4e00-af01-635587538515 req-833cdfea-b1d9-4b6d-8ef8-a05f823546d1 service nova] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Received event network-vif-deleted-89824f52-7d54-4e33-a54e-892fae59f451 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9798772f-72bf-464b-8db2-4c57041dee2f req-edc58781-6ed8-43af-99b0-a744598b0078 service nova] Acquired lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG nova.network.neutron [req-9798772f-72bf-464b-8db2-4c57041dee2f req-edc58781-6ed8-43af-99b0-a744598b0078 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Refreshing network info cache for port a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25fd0f91-f3d0-48de-b3c6-4f9343c2b953 tempest-DeleteServersTestJSON-850836827 tempest-DeleteServersTestJSON-850836827-project-member] Lock "16a347d7-5057-4f06-bac3-98c06c0c66ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.494s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692116774.3445659, 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:26:14 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Successfully detached device vdb from instance 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff from the live domain config.
Aug 15 16:26:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQVqSONK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:26:14 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:26:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[28904176-d058-4d0b-97e0-adc35e68e7b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[235bc794-1fde-4606-96ea-9cc77d231983]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:26:14 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:26:14 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:26:14 user nova-compute[72849]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a (non-flash)
Aug 15 16:26:14 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3582829e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a'): ({'sdh'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Removing single pathed devices sdh {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d5d395-6813-486a-8b24-92ddb021ce6f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff969b4a-b4dc-4375-af57-1b482c0bb342]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Flushing IO for device /dev/sdh {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5dd354-9763-434b-84fc-433abdaa6666]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.051s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8557b7-b272-4378-89f5-f5ece0394703]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] SCSI volumes sdh have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb36c0f-0413-42be-ad56-fb9a0f42fa65]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9ecf3c-543a-42bc-bc27-439827247ae5]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a, portal: 172.16.0.220,3260]
Aug 15 16:26:14 user nova-compute[72849]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a, portal: 172.16.0.220,3260] successful.
Aug 15 16:26:14 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9b7a683-8844-46b6-ba4a-20133c67fb9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fd0b37-8081-4c8c-870c-3c2814474faf]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] <== disconnect_volume: return (389ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG nova.network.neutron [req-9798772f-72bf-464b-8db2-4c57041dee2f req-edc58781-6ed8-43af-99b0-a744598b0078 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Updated VIF entry in instance network info cache for port a5ec1882-941b-4bf8-94c2-dd58f74762c6. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG nova.network.neutron [req-9798772f-72bf-464b-8db2-4c57041dee2f req-edc58781-6ed8-43af-99b0-a744598b0078 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Updating instance_info_cache with network_info: [{"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:26:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9798772f-72bf-464b-8db2-4c57041dee2f req-edc58781-6ed8-43af-99b0-a744598b0078 service nova] Releasing lock "refresh_cache-7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:26:15 user nova-compute[72849]: DEBUG nova.objects.instance [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lazy-loading 'flavor' on Instance uuid 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:26:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-976c1e4e-b1a5-4a7b-9a4d-a0b719570c15 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.808s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:21 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:26:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:23 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116768.007986, 052cde29-421b-4b17-9bcd-acd58456ddba => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:26:23 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] VM Stopped (Lifecycle Event)
Aug 15 16:26:23 user nova-compute[72849]: DEBUG nova.compute.manager [None req-028c8a26-5bb4-45d0-893f-9819e622d558 None None] [instance: 052cde29-421b-4b17-9bcd-acd58456ddba] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:26:23 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:26:24 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:26:26 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:26:26 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:26:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:26:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:26:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:26:26 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:26:26 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116771.4731038, 16a347d7-5057-4f06-bac3-98c06c0c66ce => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:26:26 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] VM Stopped (Lifecycle Event)
Aug 15 16:26:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-dc59e7da-5f2c-4241-9f67-d7059de1ca29 None None] [instance: 16a347d7-5057-4f06-bac3-98c06c0c66ce] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:26:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:27 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Updating instance_info_cache with network_info: [{"id": "993c798d-2a87-4ee5-80ea-484b8848ca54", "address": "fa:16:3e:e2:8e:fc", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993c798d-2a", "ovs_interfaceid": "993c798d-2a87-4ee5-80ea-484b8848ca54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:26:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:26:27 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:26:27 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:26:27 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:26:27 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:26:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:27 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:26:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:31 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:26:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:31 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:26:31 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:26:31 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=7399MB free_disk=25.320335388183594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:26:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:26:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:26:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:26:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc521d87-09aa-44ba-a87c-1cd5517b3707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:26:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 46f0aa43-e313-4aff-bacc-aa5290193b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:26:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:26:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance a3221960-e5ff-4185-a5dd-09f2cd293cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:26:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance d51623f1-6613-41d6-abcb-9e4e626a97af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:26:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f1da55ae-5150-476c-a229-f26ddfee7e9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:26:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:26:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:26:32 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:26:32 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:26:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:26:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:26:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:26:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:26:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "15aa3de5-baee-4d40-8610-1bd08249c837" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "15aa3de5-baee-4d40-8610-1bd08249c837" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:26:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:26:35 user nova-compute[72849]: INFO nova.compute.claims [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Claim successful on node user
Aug 15 16:26:36 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:26:36 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:26:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:26:36 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Creating image(s)
Aug 15 16:26:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "/opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "/opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "/opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG nova.policy [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e99eefba54014b9ea83f1611b02efaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ddd223976e4b13a3b6a5638846f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.172s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.170s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk 1073741824" returned: 0 in 0.047s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.169s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:37 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:26:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:37 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Cannot resize image /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:26:37 user nova-compute[72849]: DEBUG nova.objects.instance [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'migration_context' on Instance uuid 15aa3de5-baee-4d40-8610-1bd08249c837 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:26:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:26:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Ensure instance console log exists: /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:26:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:37 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Successfully created port: f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:26:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:38 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Successfully updated port: f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:26:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "refresh_cache-15aa3de5-baee-4d40-8610-1bd08249c837" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:26:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquired lock "refresh_cache-15aa3de5-baee-4d40-8610-1bd08249c837" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:26:38 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:26:38 user nova-compute[72849]: DEBUG nova.compute.manager [req-b3b21cd2-de1f-452b-9eeb-f13066ed3d26 req-138a7933-e57b-45e9-83d9-6e98ad48a788 service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Received event network-changed-f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:26:38 user nova-compute[72849]: DEBUG nova.compute.manager [req-b3b21cd2-de1f-452b-9eeb-f13066ed3d26 req-138a7933-e57b-45e9-83d9-6e98ad48a788 service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Refreshing instance network info cache due to event network-changed-f4f4dc6a-e6b1-4777-b99b-c240cdbc8587. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:26:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b3b21cd2-de1f-452b-9eeb-f13066ed3d26 req-138a7933-e57b-45e9-83d9-6e98ad48a788 service nova] Acquiring lock "refresh_cache-15aa3de5-baee-4d40-8610-1bd08249c837" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:26:38 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:26:38 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Updating instance_info_cache with network_info: [{"id": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "address": "fa:16:3e:e3:8c:d7", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f4dc6a-e6", "ovs_interfaceid": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Releasing lock "refresh_cache-15aa3de5-baee-4d40-8610-1bd08249c837" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Instance network_info: |[{"id": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "address": "fa:16:3e:e3:8c:d7", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f4dc6a-e6", "ovs_interfaceid": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b3b21cd2-de1f-452b-9eeb-f13066ed3d26 req-138a7933-e57b-45e9-83d9-6e98ad48a788 service nova] Acquired lock "refresh_cache-15aa3de5-baee-4d40-8610-1bd08249c837" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-b3b21cd2-de1f-452b-9eeb-f13066ed3d26 req-138a7933-e57b-45e9-83d9-6e98ad48a788 service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Refreshing network info cache for port f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Start _get_guest_xml network_info=[{"id": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "address": "fa:16:3e:e3:8c:d7", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f4dc6a-e6", "ovs_interfaceid": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:26:39 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:26:39 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:26:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1547849743',display_name='tempest-AttachVolumeNegativeTest-server-1547849743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1547849743',id=26,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw47CHyB3PkFVkTAeF16KwePrqj25hUBKXEHVU+LaQn+xs6YcCej6MnsV6xB8I/4RiJMRqo7S1Y7VagB2YKuovDg0jc1tZ/6DaPQd2Tr8/xLrjdRJjz8q+G1Q+F2LkbQA==',key_name='tempest-keypair-1368480049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0ddd223976e4b13a3b6a5638846f83a',ramdisk_id='',reservation_id='r-zgnqwo5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-693282259',owner_user_name='tempest-AttachVolumeNegativeTest-693282259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:26:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e99eefba54014b9ea83f1611b02efaad',uuid=15aa3de5-baee-4d40-8610-1bd08249c837,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "address": "fa:16:3e:e3:8c:d7", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f4dc6a-e6", "ovs_interfaceid": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converting VIF {"id": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "address": "fa:16:3e:e3:8c:d7", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f4dc6a-e6", "ovs_interfaceid": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=f4f4dc6a-e6b1-4777-b99b-c240cdbc8587,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f4dc6a-e6') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.objects.instance [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'pci_devices' on Instance uuid 15aa3de5-baee-4d40-8610-1bd08249c837 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:26:39 user nova-compute[72849]:   <uuid>15aa3de5-baee-4d40-8610-1bd08249c837</uuid>
Aug 15 16:26:39 user nova-compute[72849]:   <name>instance-0000001a</name>
Aug 15 16:26:39 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:26:39 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:26:39 user nova-compute[72849]:   <metadata>
Aug 15 16:26:39 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:26:39 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:26:39 user nova-compute[72849]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1547849743</nova:name>
Aug 15 16:26:39 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:26:39</nova:creationTime>
Aug 15 16:26:39 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:26:39 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:26:39 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:26:39 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:26:39 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:26:39 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:26:39 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:26:39 user nova-compute[72849]:       <nova:owner>
Aug 15 16:26:39 user nova-compute[72849]:         <nova:user uuid="e99eefba54014b9ea83f1611b02efaad">tempest-AttachVolumeNegativeTest-693282259-project-member</nova:user>
Aug 15 16:26:39 user nova-compute[72849]:         <nova:project uuid="d0ddd223976e4b13a3b6a5638846f83a">tempest-AttachVolumeNegativeTest-693282259</nova:project>
Aug 15 16:26:39 user nova-compute[72849]:       </nova:owner>
Aug 15 16:26:39 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:26:39 user nova-compute[72849]:       <nova:ports>
Aug 15 16:26:39 user nova-compute[72849]:         <nova:port uuid="f4f4dc6a-e6b1-4777-b99b-c240cdbc8587">
Aug 15 16:26:39 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 16:26:39 user nova-compute[72849]:         </nova:port>
Aug 15 16:26:39 user nova-compute[72849]:       </nova:ports>
Aug 15 16:26:39 user nova-compute[72849]:     </nova:instance>
Aug 15 16:26:39 user nova-compute[72849]:   </metadata>
Aug 15 16:26:39 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:26:39 user nova-compute[72849]:     <system>
Aug 15 16:26:39 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:26:39 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:26:39 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:26:39 user nova-compute[72849]:       <entry name="serial">15aa3de5-baee-4d40-8610-1bd08249c837</entry>
Aug 15 16:26:39 user nova-compute[72849]:       <entry name="uuid">15aa3de5-baee-4d40-8610-1bd08249c837</entry>
Aug 15 16:26:39 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:26:39 user nova-compute[72849]:     </system>
Aug 15 16:26:39 user nova-compute[72849]:   </sysinfo>
Aug 15 16:26:39 user nova-compute[72849]:   <os>
Aug 15 16:26:39 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:26:39 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:26:39 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:26:39 user nova-compute[72849]:   </os>
Aug 15 16:26:39 user nova-compute[72849]:   <features>
Aug 15 16:26:39 user nova-compute[72849]:     <acpi/>
Aug 15 16:26:39 user nova-compute[72849]:     <apic/>
Aug 15 16:26:39 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:26:39 user nova-compute[72849]:   </features>
Aug 15 16:26:39 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:26:39 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:26:39 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:26:39 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:26:39 user nova-compute[72849]:   </clock>
Aug 15 16:26:39 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:26:39 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:26:39 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:26:39 user nova-compute[72849]:   </cpu>
Aug 15 16:26:39 user nova-compute[72849]:   <devices>
Aug 15 16:26:39 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:26:39 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:26:39 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk"/>
Aug 15 16:26:39 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:26:39 user nova-compute[72849]:     </disk>
Aug 15 16:26:39 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:26:39 user nova-compute[72849]:       <mac address="fa:16:3e:e3:8c:d7"/>
Aug 15 16:26:39 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:26:39 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:26:39 user nova-compute[72849]:       <target dev="tapf4f4dc6a-e6"/>
Aug 15 16:26:39 user nova-compute[72849]:     </interface>
Aug 15 16:26:39 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:26:39 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/console.log" append="off"/>
Aug 15 16:26:39 user nova-compute[72849]:     </serial>
Aug 15 16:26:39 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:26:39 user nova-compute[72849]:     <video>
Aug 15 16:26:39 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:26:39 user nova-compute[72849]:     </video>
Aug 15 16:26:39 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:26:39 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:26:39 user nova-compute[72849]:     </rng>
Aug 15 16:26:39 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:26:39 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:26:39 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:26:39 user nova-compute[72849]:     </memballoon>
Aug 15 16:26:39 user nova-compute[72849]:   </devices>
Aug 15 16:26:39 user nova-compute[72849]: </domain>
Aug 15 16:26:39 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:26:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1547849743',display_name='tempest-AttachVolumeNegativeTest-server-1547849743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1547849743',id=26,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw47CHyB3PkFVkTAeF16KwePrqj25hUBKXEHVU+LaQn+xs6YcCej6MnsV6xB8I/4RiJMRqo7S1Y7VagB2YKuovDg0jc1tZ/6DaPQd2Tr8/xLrjdRJjz8q+G1Q+F2LkbQA==',key_name='tempest-keypair-1368480049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0ddd223976e4b13a3b6a5638846f83a',ramdisk_id='',reservation_id='r-zgnqwo5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-693282259',owner_user_name='tempest-AttachVolumeNegativeTest-693282259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:26:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e99eefba54014b9ea83f1611b02efaad',uuid=15aa3de5-baee-4d40-8610-1bd08249c837,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "address": "fa:16:3e:e3:8c:d7", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f4dc6a-e6", "ovs_interfaceid": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converting VIF {"id": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "address": "fa:16:3e:e3:8c:d7", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f4dc6a-e6", "ovs_interfaceid": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=f4f4dc6a-e6b1-4777-b99b-c240cdbc8587,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f4dc6a-e6') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG os_vif [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=f4f4dc6a-e6b1-4777-b99b-c240cdbc8587,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f4dc6a-e6') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4f4dc6a-e6, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4f4dc6a-e6, col_values=(('external_ids', {'iface-id': 'f4f4dc6a-e6b1-4777-b99b-c240cdbc8587', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:8c:d7', 'vm-uuid': '15aa3de5-baee-4d40-8610-1bd08249c837'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:39 user nova-compute[72849]: INFO os_vif [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=f4f4dc6a-e6b1-4777-b99b-c240cdbc8587,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f4dc6a-e6')
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] No VIF found with MAC fa:16:3e:e3:8c:d7, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-b3b21cd2-de1f-452b-9eeb-f13066ed3d26 req-138a7933-e57b-45e9-83d9-6e98ad48a788 service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Updated VIF entry in instance network info cache for port f4f4dc6a-e6b1-4777-b99b-c240cdbc8587. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-b3b21cd2-de1f-452b-9eeb-f13066ed3d26 req-138a7933-e57b-45e9-83d9-6e98ad48a788 service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Updating instance_info_cache with network_info: [{"id": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "address": "fa:16:3e:e3:8c:d7", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f4dc6a-e6", "ovs_interfaceid": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b3b21cd2-de1f-452b-9eeb-f13066ed3d26 req-138a7933-e57b-45e9-83d9-6e98ad48a788 service nova] Releasing lock "refresh_cache-15aa3de5-baee-4d40-8610-1bd08249c837" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:26:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:40 user nova-compute[72849]: DEBUG nova.compute.manager [req-8ef15a81-f769-4dc6-af91-c2d62f9ea375 req-ce2f6e57-6181-4815-b5f3-694b59eb6c2a service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Received event network-vif-plugged-f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:26:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8ef15a81-f769-4dc6-af91-c2d62f9ea375 req-ce2f6e57-6181-4815-b5f3-694b59eb6c2a service nova] Acquiring lock "15aa3de5-baee-4d40-8610-1bd08249c837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8ef15a81-f769-4dc6-af91-c2d62f9ea375 req-ce2f6e57-6181-4815-b5f3-694b59eb6c2a service nova] Lock "15aa3de5-baee-4d40-8610-1bd08249c837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8ef15a81-f769-4dc6-af91-c2d62f9ea375 req-ce2f6e57-6181-4815-b5f3-694b59eb6c2a service nova] Lock "15aa3de5-baee-4d40-8610-1bd08249c837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:40 user nova-compute[72849]: DEBUG nova.compute.manager [req-8ef15a81-f769-4dc6-af91-c2d62f9ea375 req-ce2f6e57-6181-4815-b5f3-694b59eb6c2a service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] No waiting events found dispatching network-vif-plugged-f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:26:40 user nova-compute[72849]: WARNING nova.compute.manager [req-8ef15a81-f769-4dc6-af91-c2d62f9ea375 req-ce2f6e57-6181-4815-b5f3-694b59eb6c2a service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Received unexpected event network-vif-plugged-f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 for instance with vm_state building and task_state spawning.
Aug 15 16:26:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:42 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116802.6489582, 15aa3de5-baee-4d40-8610-1bd08249c837 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:26:42 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] VM Resumed (Lifecycle Event)
Aug 15 16:26:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:26:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:26:42 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Instance spawned successfully.
Aug 15 16:26:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:26:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:26:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:26:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:26:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:26:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:26:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:26:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:26:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:26:42 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:26:42 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116802.6526973, 15aa3de5-baee-4d40-8610-1bd08249c837 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:26:42 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] VM Started (Lifecycle Event)
Aug 15 16:26:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:26:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:26:42 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:26:42 user nova-compute[72849]: INFO nova.compute.manager [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Took 6.36 seconds to spawn the instance on the hypervisor.
Aug 15 16:26:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:26:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:42 user nova-compute[72849]: DEBUG nova.compute.manager [req-27323d0b-6b9a-4e09-9b09-6c39ae9ec3d4 req-1a8ff5db-cf40-4a32-af76-fb2a098a2a23 service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Received event network-vif-plugged-f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:26:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-27323d0b-6b9a-4e09-9b09-6c39ae9ec3d4 req-1a8ff5db-cf40-4a32-af76-fb2a098a2a23 service nova] Acquiring lock "15aa3de5-baee-4d40-8610-1bd08249c837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-27323d0b-6b9a-4e09-9b09-6c39ae9ec3d4 req-1a8ff5db-cf40-4a32-af76-fb2a098a2a23 service nova] Lock "15aa3de5-baee-4d40-8610-1bd08249c837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-27323d0b-6b9a-4e09-9b09-6c39ae9ec3d4 req-1a8ff5db-cf40-4a32-af76-fb2a098a2a23 service nova] Lock "15aa3de5-baee-4d40-8610-1bd08249c837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:42 user nova-compute[72849]: DEBUG nova.compute.manager [req-27323d0b-6b9a-4e09-9b09-6c39ae9ec3d4 req-1a8ff5db-cf40-4a32-af76-fb2a098a2a23 service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] No waiting events found dispatching network-vif-plugged-f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:26:42 user nova-compute[72849]: WARNING nova.compute.manager [req-27323d0b-6b9a-4e09-9b09-6c39ae9ec3d4 req-1a8ff5db-cf40-4a32-af76-fb2a098a2a23 service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Received unexpected event network-vif-plugged-f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 for instance with vm_state building and task_state spawning.
Aug 15 16:26:42 user nova-compute[72849]: INFO nova.compute.manager [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Took 7.06 seconds to build instance.
Aug 15 16:26:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5f81381-cebd-400a-8fda-21f25ebd42e7 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "15aa3de5-baee-4d40-8610-1bd08249c837" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.199s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "0900e8d0-6e7f-40a3-9016-39851e697d09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:45 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:26:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:26:45 user nova-compute[72849]: INFO nova.compute.claims [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Claim successful on node user
Aug 15 16:26:46 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:26:46 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:26:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:26:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:26:46 user nova-compute[72849]: DEBUG nova.network.neutron [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:26:46 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:26:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:26:46 user nova-compute[72849]: DEBUG nova.policy [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e867f247fc90437899a13a7451a3249a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb636c3c71c479d90cf2e170db941e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:26:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:26:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:26:46 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Creating image(s)
Aug 15 16:26:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "/opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "/opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "/opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk 1073741824" returned: 0 in 0.056s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.195s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:47 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:26:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:47 user nova-compute[72849]: DEBUG nova.network.neutron [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Successfully created port: 58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:26:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:47 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Cannot resize image /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:26:47 user nova-compute[72849]: DEBUG nova.objects.instance [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'migration_context' on Instance uuid 0900e8d0-6e7f-40a3-9016-39851e697d09 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:26:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:26:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Ensure instance console log exists: /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:26:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.network.neutron [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Successfully updated port: 58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquired lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.network.neutron [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.compute.manager [req-f71a78b1-c901-498c-bde4-678e44e23b0d req-62d5c47a-424a-457d-bb3f-3675262a9a04 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received event network-changed-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.compute.manager [req-f71a78b1-c901-498c-bde4-678e44e23b0d req-62d5c47a-424a-457d-bb3f-3675262a9a04 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Refreshing instance network info cache due to event network-changed-58268f65-6b08-4cdd-9ae3-b256ed150e60. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f71a78b1-c901-498c-bde4-678e44e23b0d req-62d5c47a-424a-457d-bb3f-3675262a9a04 service nova] Acquiring lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.network.neutron [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.network.neutron [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Updating instance_info_cache with network_info: [{"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Releasing lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Instance network_info: |[{"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f71a78b1-c901-498c-bde4-678e44e23b0d req-62d5c47a-424a-457d-bb3f-3675262a9a04 service nova] Acquired lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.network.neutron [req-f71a78b1-c901-498c-bde4-678e44e23b0d req-62d5c47a-424a-457d-bb3f-3675262a9a04 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Refreshing network info cache for port 58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Start _get_guest_xml network_info=[{"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:26:48 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:26:48 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:26:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1356134043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1356134043',id=27,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFI/WYqNgdhrW6ev+SXUzc863+su95TT4W3Vt1HMyWURKe/jZziC6ZzGxo7ZQjy5wAZn1VasI3e3uGWKduWt4WYUmvmETmO7289jUPX5hc72NdFOqpXF4ziM1kL0kqT9CQ==',key_name='tempest-keypair-1318766870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bb636c3c71c479d90cf2e170db941e1',ramdisk_id='',reservation_id='r-ik1in1jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1263463439',owner_user_name='tempest-AttachVolumeShelveTestJSON-1263463439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:26:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867f247fc90437899a13a7451a3249a',uuid=0900e8d0-6e7f-40a3-9016-39851e697d09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converting VIF {"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:64:c5,bridge_name='br-int',has_traffic_filtering=True,id=58268f65-6b08-4cdd-9ae3-b256ed150e60,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58268f65-6b') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.objects.instance [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'pci_devices' on Instance uuid 0900e8d0-6e7f-40a3-9016-39851e697d09 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:26:48 user nova-compute[72849]:   <uuid>0900e8d0-6e7f-40a3-9016-39851e697d09</uuid>
Aug 15 16:26:48 user nova-compute[72849]:   <name>instance-0000001b</name>
Aug 15 16:26:48 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:26:48 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:26:48 user nova-compute[72849]:   <metadata>
Aug 15 16:26:48 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:26:48 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:26:48 user nova-compute[72849]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1356134043</nova:name>
Aug 15 16:26:48 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:26:48</nova:creationTime>
Aug 15 16:26:48 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:26:48 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:26:48 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:26:48 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:26:48 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:26:48 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:26:48 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:26:48 user nova-compute[72849]:       <nova:owner>
Aug 15 16:26:48 user nova-compute[72849]:         <nova:user uuid="e867f247fc90437899a13a7451a3249a">tempest-AttachVolumeShelveTestJSON-1263463439-project-member</nova:user>
Aug 15 16:26:48 user nova-compute[72849]:         <nova:project uuid="1bb636c3c71c479d90cf2e170db941e1">tempest-AttachVolumeShelveTestJSON-1263463439</nova:project>
Aug 15 16:26:48 user nova-compute[72849]:       </nova:owner>
Aug 15 16:26:48 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:26:48 user nova-compute[72849]:       <nova:ports>
Aug 15 16:26:48 user nova-compute[72849]:         <nova:port uuid="58268f65-6b08-4cdd-9ae3-b256ed150e60">
Aug 15 16:26:48 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 16:26:48 user nova-compute[72849]:         </nova:port>
Aug 15 16:26:48 user nova-compute[72849]:       </nova:ports>
Aug 15 16:26:48 user nova-compute[72849]:     </nova:instance>
Aug 15 16:26:48 user nova-compute[72849]:   </metadata>
Aug 15 16:26:48 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:26:48 user nova-compute[72849]:     <system>
Aug 15 16:26:48 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:26:48 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:26:48 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:26:48 user nova-compute[72849]:       <entry name="serial">0900e8d0-6e7f-40a3-9016-39851e697d09</entry>
Aug 15 16:26:48 user nova-compute[72849]:       <entry name="uuid">0900e8d0-6e7f-40a3-9016-39851e697d09</entry>
Aug 15 16:26:48 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:26:48 user nova-compute[72849]:     </system>
Aug 15 16:26:48 user nova-compute[72849]:   </sysinfo>
Aug 15 16:26:48 user nova-compute[72849]:   <os>
Aug 15 16:26:48 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:26:48 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:26:48 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:26:48 user nova-compute[72849]:   </os>
Aug 15 16:26:48 user nova-compute[72849]:   <features>
Aug 15 16:26:48 user nova-compute[72849]:     <acpi/>
Aug 15 16:26:48 user nova-compute[72849]:     <apic/>
Aug 15 16:26:48 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:26:48 user nova-compute[72849]:   </features>
Aug 15 16:26:48 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:26:48 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:26:48 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:26:48 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:26:48 user nova-compute[72849]:   </clock>
Aug 15 16:26:48 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:26:48 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:26:48 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:26:48 user nova-compute[72849]:   </cpu>
Aug 15 16:26:48 user nova-compute[72849]:   <devices>
Aug 15 16:26:48 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:26:48 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:26:48 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk"/>
Aug 15 16:26:48 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:26:48 user nova-compute[72849]:     </disk>
Aug 15 16:26:48 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:26:48 user nova-compute[72849]:       <mac address="fa:16:3e:de:64:c5"/>
Aug 15 16:26:48 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:26:48 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:26:48 user nova-compute[72849]:       <target dev="tap58268f65-6b"/>
Aug 15 16:26:48 user nova-compute[72849]:     </interface>
Aug 15 16:26:48 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:26:48 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/console.log" append="off"/>
Aug 15 16:26:48 user nova-compute[72849]:     </serial>
Aug 15 16:26:48 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:26:48 user nova-compute[72849]:     <video>
Aug 15 16:26:48 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:26:48 user nova-compute[72849]:     </video>
Aug 15 16:26:48 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:26:48 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:26:48 user nova-compute[72849]:     </rng>
Aug 15 16:26:48 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:26:48 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:26:48 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:26:48 user nova-compute[72849]:     </memballoon>
Aug 15 16:26:48 user nova-compute[72849]:   </devices>
Aug 15 16:26:48 user nova-compute[72849]: </domain>
Aug 15 16:26:48 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:26:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1356134043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1356134043',id=27,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFI/WYqNgdhrW6ev+SXUzc863+su95TT4W3Vt1HMyWURKe/jZziC6ZzGxo7ZQjy5wAZn1VasI3e3uGWKduWt4WYUmvmETmO7289jUPX5hc72NdFOqpXF4ziM1kL0kqT9CQ==',key_name='tempest-keypair-1318766870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bb636c3c71c479d90cf2e170db941e1',ramdisk_id='',reservation_id='r-ik1in1jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1263463439',owner_user_name='tempest-AttachVolumeShelveTestJSON-1263463439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:26:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867f247fc90437899a13a7451a3249a',uuid=0900e8d0-6e7f-40a3-9016-39851e697d09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converting VIF {"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:64:c5,bridge_name='br-int',has_traffic_filtering=True,id=58268f65-6b08-4cdd-9ae3-b256ed150e60,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58268f65-6b') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG os_vif [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:64:c5,bridge_name='br-int',has_traffic_filtering=True,id=58268f65-6b08-4cdd-9ae3-b256ed150e60,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58268f65-6b') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58268f65-6b, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58268f65-6b, col_values=(('external_ids', {'iface-id': '58268f65-6b08-4cdd-9ae3-b256ed150e60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:64:c5', 'vm-uuid': '0900e8d0-6e7f-40a3-9016-39851e697d09'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:48 user nova-compute[72849]: INFO os_vif [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:64:c5,bridge_name='br-int',has_traffic_filtering=True,id=58268f65-6b08-4cdd-9ae3-b256ed150e60,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58268f65-6b')
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:26:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] No VIF found with MAC fa:16:3e:de:64:c5, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:26:49 user nova-compute[72849]: DEBUG nova.network.neutron [req-f71a78b1-c901-498c-bde4-678e44e23b0d req-62d5c47a-424a-457d-bb3f-3675262a9a04 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Updated VIF entry in instance network info cache for port 58268f65-6b08-4cdd-9ae3-b256ed150e60. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:26:49 user nova-compute[72849]: DEBUG nova.network.neutron [req-f71a78b1-c901-498c-bde4-678e44e23b0d req-62d5c47a-424a-457d-bb3f-3675262a9a04 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Updating instance_info_cache with network_info: [{"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:26:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f71a78b1-c901-498c-bde4-678e44e23b0d req-62d5c47a-424a-457d-bb3f-3675262a9a04 service nova] Releasing lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:26:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:50 user nova-compute[72849]: DEBUG nova.compute.manager [req-ebe0e027-5cc2-4b6b-9196-a4b9045af0e3 req-fe268574-a71e-4257-acc2-534a12e2ff7c service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received event network-vif-plugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:26:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ebe0e027-5cc2-4b6b-9196-a4b9045af0e3 req-fe268574-a71e-4257-acc2-534a12e2ff7c service nova] Acquiring lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ebe0e027-5cc2-4b6b-9196-a4b9045af0e3 req-fe268574-a71e-4257-acc2-534a12e2ff7c service nova] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ebe0e027-5cc2-4b6b-9196-a4b9045af0e3 req-fe268574-a71e-4257-acc2-534a12e2ff7c service nova] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:50 user nova-compute[72849]: DEBUG nova.compute.manager [req-ebe0e027-5cc2-4b6b-9196-a4b9045af0e3 req-fe268574-a71e-4257-acc2-534a12e2ff7c service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] No waiting events found dispatching network-vif-plugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:26:50 user nova-compute[72849]: WARNING nova.compute.manager [req-ebe0e027-5cc2-4b6b-9196-a4b9045af0e3 req-fe268574-a71e-4257-acc2-534a12e2ff7c service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received unexpected event network-vif-plugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 for instance with vm_state building and task_state spawning.
Aug 15 16:26:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116812.38811, 0900e8d0-6e7f-40a3-9016-39851e697d09 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:26:52 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] VM Resumed (Lifecycle Event)
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:26:52 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Instance spawned successfully.
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:26:52 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116812.3915076, 0900e8d0-6e7f-40a3-9016-39851e697d09 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:26:52 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] VM Started (Lifecycle Event)
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:26:52 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:26:52 user nova-compute[72849]: INFO nova.compute.manager [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Took 5.94 seconds to spawn the instance on the hypervisor.
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:26:52 user nova-compute[72849]: INFO nova.compute.manager [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] instance snapshotting
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-a3f18211-0d77-4ac1-b038-38bd45bf1e82 req-dc87302a-4b90-41b6-814c-63ee17958938 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received event network-vif-plugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a3f18211-0d77-4ac1-b038-38bd45bf1e82 req-dc87302a-4b90-41b6-814c-63ee17958938 service nova] Acquiring lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a3f18211-0d77-4ac1-b038-38bd45bf1e82 req-dc87302a-4b90-41b6-814c-63ee17958938 service nova] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a3f18211-0d77-4ac1-b038-38bd45bf1e82 req-dc87302a-4b90-41b6-814c-63ee17958938 service nova] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-a3f18211-0d77-4ac1-b038-38bd45bf1e82 req-dc87302a-4b90-41b6-814c-63ee17958938 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] No waiting events found dispatching network-vif-plugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:26:52 user nova-compute[72849]: WARNING nova.compute.manager [req-a3f18211-0d77-4ac1-b038-38bd45bf1e82 req-dc87302a-4b90-41b6-814c-63ee17958938 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received unexpected event network-vif-plugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 for instance with vm_state building and task_state spawning.
Aug 15 16:26:52 user nova-compute[72849]: INFO nova.compute.manager [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Took 6.76 seconds to build instance.
Aug 15 16:26:52 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Beginning live snapshot process
Aug 15 16:26:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f105f92f-0d66-4bb2-a476-e0cb998f4e70 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.864s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json -f qcow2 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json -f qcow2 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8tq6gk0o/be83841c427a4f8893262536a4712fc5.delta 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8tq6gk0o/be83841c427a4f8893262536a4712fc5.delta 1073741824" returned: 0 in 0.053s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:53 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 16:26:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:26:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:26:54 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 16:26:54 user nova-compute[72849]: DEBUG nova.privsep.utils [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72849) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 16:26:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8tq6gk0o/be83841c427a4f8893262536a4712fc5.delta /opt/stack/data/nova/instances/snapshots/tmp8tq6gk0o/be83841c427a4f8893262536a4712fc5 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:26:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8tq6gk0o/be83841c427a4f8893262536a4712fc5.delta /opt/stack/data/nova/instances/snapshots/tmp8tq6gk0o/be83841c427a4f8893262536a4712fc5" returned: 0 in 0.540s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:26:55 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Snapshot extracted, beginning image upload
Aug 15 16:26:57 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Snapshot image upload complete
Aug 15 16:26:57 user nova-compute[72849]: INFO nova.compute.manager [None req-5ea58503-d243-481a-b929-be12f2f8a8fa tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Took 5.29 seconds to snapshot the instance on the hypervisor.
Aug 15 16:26:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:26:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-2fe80c75-31e4-4d07-add0-653f43066b33 req-7e36a179-3f90-4b55-b725-1076f3960508 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received event network-changed-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:27:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-2fe80c75-31e4-4d07-add0-653f43066b33 req-7e36a179-3f90-4b55-b725-1076f3960508 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Refreshing instance network info cache due to event network-changed-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:27:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2fe80c75-31e4-4d07-add0-653f43066b33 req-7e36a179-3f90-4b55-b725-1076f3960508 service nova] Acquiring lock "refresh_cache-f1da55ae-5150-476c-a229-f26ddfee7e9e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:27:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2fe80c75-31e4-4d07-add0-653f43066b33 req-7e36a179-3f90-4b55-b725-1076f3960508 service nova] Acquired lock "refresh_cache-f1da55ae-5150-476c-a229-f26ddfee7e9e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:27:08 user nova-compute[72849]: DEBUG nova.network.neutron [req-2fe80c75-31e4-4d07-add0-653f43066b33 req-7e36a179-3f90-4b55-b725-1076f3960508 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Refreshing network info cache for port 71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:27:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:09 user nova-compute[72849]: DEBUG nova.network.neutron [req-2fe80c75-31e4-4d07-add0-653f43066b33 req-7e36a179-3f90-4b55-b725-1076f3960508 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Updated VIF entry in instance network info cache for port 71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:27:09 user nova-compute[72849]: DEBUG nova.network.neutron [req-2fe80c75-31e4-4d07-add0-653f43066b33 req-7e36a179-3f90-4b55-b725-1076f3960508 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Updating instance_info_cache with network_info: [{"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:27:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2fe80c75-31e4-4d07-add0-653f43066b33 req-7e36a179-3f90-4b55-b725-1076f3960508 service nova] Releasing lock "refresh_cache-f1da55ae-5150-476c-a229-f26ddfee7e9e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:27:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:27:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:27:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:27:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:27:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:27:11 user nova-compute[72849]: INFO nova.compute.manager [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Terminating instance
Aug 15 16:27:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-a1af995c-2a06-4e5b-95f8-48aa79fa5b3d req-90ea795f-6c2e-416c-ae93-0d5c1db12213 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received event network-vif-unplugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a1af995c-2a06-4e5b-95f8-48aa79fa5b3d req-90ea795f-6c2e-416c-ae93-0d5c1db12213 service nova] Acquiring lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a1af995c-2a06-4e5b-95f8-48aa79fa5b3d req-90ea795f-6c2e-416c-ae93-0d5c1db12213 service nova] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a1af995c-2a06-4e5b-95f8-48aa79fa5b3d req-90ea795f-6c2e-416c-ae93-0d5c1db12213 service nova] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-a1af995c-2a06-4e5b-95f8-48aa79fa5b3d req-90ea795f-6c2e-416c-ae93-0d5c1db12213 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] No waiting events found dispatching network-vif-unplugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-a1af995c-2a06-4e5b-95f8-48aa79fa5b3d req-90ea795f-6c2e-416c-ae93-0d5c1db12213 service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received event network-vif-unplugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:27:11 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Instance destroyed successfully.
Aug 15 16:27:11 user nova-compute[72849]: DEBUG nova.objects.instance [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lazy-loading 'resources' on Instance uuid 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1576542286',display_name='tempest-TestMinimumBasicScenario-server-1576542286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1576542286',id=18,image_ref='e96995a9-02fd-46b4-a493-49c55a019fb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLITvhTIKxyK1vxPra8HPdLGNslu1aZMvggvPZhZAqmN29/j8ALHmk9hr8DlNcPQ6RB8/ui+J8dT3ULem3B9LDvmcgD/X4+LLLqAj30wexD4v1PAuESvTiKNIJpS8gNsA==',key_name='tempest-TestMinimumBasicScenario-1485864520',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:21:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8512a50775b24f798c5cf345f08e0dd2',ramdisk_id='',reservation_id='r-rs5ok5tt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e96995a9-02fd-46b4-a493-49c55a019fb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2032437405',owner_user_name='tempest-TestMinimumBasicScenario-2032437405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:24:28Z,user_data=None,user_id='d9420a64b5ea462681f3a9c6cf55986c',uuid=7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Converting VIF {"id": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "address": "fa:16:3e:cd:cb:17", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ec1882-94", "ovs_interfaceid": "a5ec1882-941b-4bf8-94c2-dd58f74762c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:cb:17,bridge_name='br-int',has_traffic_filtering=True,id=a5ec1882-941b-4bf8-94c2-dd58f74762c6,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5ec1882-94') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG os_vif [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:cb:17,bridge_name='br-int',has_traffic_filtering=True,id=a5ec1882-941b-4bf8-94c2-dd58f74762c6,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5ec1882-94') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5ec1882-94, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:11 user nova-compute[72849]: INFO os_vif [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:cb:17,bridge_name='br-int',has_traffic_filtering=True,id=a5ec1882-941b-4bf8-94c2-dd58f74762c6,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5ec1882-94')
Aug 15 16:27:11 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Deleting instance files /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff_del
Aug 15 16:27:11 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Deletion of /opt/stack/data/nova/instances/7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff_del complete
Aug 15 16:27:11 user nova-compute[72849]: INFO nova.compute.manager [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 15 16:27:11 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:27:11 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:27:12 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:27:12 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Took 0.78 seconds to deallocate network for instance.
Aug 15 16:27:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:27:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:27:13 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:27:13 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:27:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:27:13 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Deleted allocations for instance 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff
Aug 15 16:27:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-539ce12e-c02d-4572-8ff8-2915dd101693 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.356s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:27:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-746a3c19-43fe-4f0a-8980-309940427984 req-92a617c6-5912-46c3-9d29-498ff78b327b service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received event network-vif-plugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:27:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-746a3c19-43fe-4f0a-8980-309940427984 req-92a617c6-5912-46c3-9d29-498ff78b327b service nova] Acquiring lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:27:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-746a3c19-43fe-4f0a-8980-309940427984 req-92a617c6-5912-46c3-9d29-498ff78b327b service nova] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:27:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-746a3c19-43fe-4f0a-8980-309940427984 req-92a617c6-5912-46c3-9d29-498ff78b327b service nova] Lock "7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:27:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-746a3c19-43fe-4f0a-8980-309940427984 req-92a617c6-5912-46c3-9d29-498ff78b327b service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] No waiting events found dispatching network-vif-plugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:27:13 user nova-compute[72849]: WARNING nova.compute.manager [req-746a3c19-43fe-4f0a-8980-309940427984 req-92a617c6-5912-46c3-9d29-498ff78b327b service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received unexpected event network-vif-plugged-a5ec1882-941b-4bf8-94c2-dd58f74762c6 for instance with vm_state deleted and task_state None.
Aug 15 16:27:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-746a3c19-43fe-4f0a-8980-309940427984 req-92a617c6-5912-46c3-9d29-498ff78b327b service nova] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Received event network-vif-deleted-a5ec1882-941b-4bf8-94c2-dd58f74762c6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:27:14 user nova-compute[72849]: INFO nova.compute.manager [None req-9f9d708c-1397-4b4c-9650-9a9e12645699 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Unrescuing
Aug 15 16:27:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f9d708c-1397-4b4c-9650-9a9e12645699 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:27:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f9d708c-1397-4b4c-9650-9a9e12645699 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquired lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:27:14 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9f9d708c-1397-4b4c-9650-9a9e12645699 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:27:14 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9f9d708c-1397-4b4c-9650-9a9e12645699 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Updating instance_info_cache with network_info: [{"id": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "address": "fa:16:3e:ca:d6:ea", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010fd638-d6", "ovs_interfaceid": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:27:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f9d708c-1397-4b4c-9650-9a9e12645699 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Releasing lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:27:14 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9f9d708c-1397-4b4c-9650-9a9e12645699 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'flavor' on Instance uuid cc521d87-09aa-44ba-a87c-1cd5517b3707 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:27:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:27:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:27:14 user nova-compute[72849]: DEBUG nova.objects.instance [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'flavor' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:27:15 user nova-compute[72849]: INFO nova.compute.manager [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Attaching volume 72ab3753-6199-4221-ad21-89c5e58a022f to /dev/vdb
Aug 15 16:27:15 user nova-compute[72849]: DEBUG os_brick.utils [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0cb62c-e8db-4233-bc53-5cf1ad8575ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffe83cb-6070-4d80-8db9-33efd995a0d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1c6b1e-cbd6-49ec-b109-2fced931b9c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b6580b-ad61-47a7-ac1f-27e59d1880fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:27:15 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e592a2-c1db-4cdc-a253-13779bcc2fcc]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG os_brick.utils [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Updating existing volume attachment record: ea78ae01-6579-4784-b260-e879b09c323d {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-d01dd286-ced3-4afe-964b-6a83bdeb5851 req-3c36a91e-34cc-4236-a185-efd1376cfb25 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received event network-vif-unplugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d01dd286-ced3-4afe-964b-6a83bdeb5851 req-3c36a91e-34cc-4236-a185-efd1376cfb25 service nova] Acquiring lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d01dd286-ced3-4afe-964b-6a83bdeb5851 req-3c36a91e-34cc-4236-a185-efd1376cfb25 service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d01dd286-ced3-4afe-964b-6a83bdeb5851 req-3c36a91e-34cc-4236-a185-efd1376cfb25 service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:27:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-d01dd286-ced3-4afe-964b-6a83bdeb5851 req-3c36a91e-34cc-4236-a185-efd1376cfb25 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] No waiting events found dispatching network-vif-unplugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:27:15 user nova-compute[72849]: WARNING nova.compute.manager [req-d01dd286-ced3-4afe-964b-6a83bdeb5851 req-3c36a91e-34cc-4236-a185-efd1376cfb25 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received unexpected event network-vif-unplugged-010fd638-d6f5-40be-b322-8d3f7b1d29de for instance with vm_state rescued and task_state unrescuing.
Aug 15 16:27:15 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Instance destroyed successfully.
Aug 15 16:27:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-e4813728-89c5-490b-a64e-2e6cb9dc5734 req-32ee88b4-09e2-4b51-a848-09a398c84a88 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received event network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:27:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e4813728-89c5-490b-a64e-2e6cb9dc5734 req-32ee88b4-09e2-4b51-a848-09a398c84a88 service nova] Acquiring lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:27:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e4813728-89c5-490b-a64e-2e6cb9dc5734 req-32ee88b4-09e2-4b51-a848-09a398c84a88 service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:27:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e4813728-89c5-490b-a64e-2e6cb9dc5734 req-32ee88b4-09e2-4b51-a848-09a398c84a88 service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:27:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-e4813728-89c5-490b-a64e-2e6cb9dc5734 req-32ee88b4-09e2-4b51-a848-09a398c84a88 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] No waiting events found dispatching network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:27:17 user nova-compute[72849]: WARNING nova.compute.manager [req-e4813728-89c5-490b-a64e-2e6cb9dc5734 req-32ee88b4-09e2-4b51-a848-09a398c84a88 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received unexpected event network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de for instance with vm_state rescued and task_state unrescuing.
Aug 15 16:27:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-e4813728-89c5-490b-a64e-2e6cb9dc5734 req-32ee88b4-09e2-4b51-a848-09a398c84a88 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received event network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:27:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e4813728-89c5-490b-a64e-2e6cb9dc5734 req-32ee88b4-09e2-4b51-a848-09a398c84a88 service nova] Acquiring lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:27:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e4813728-89c5-490b-a64e-2e6cb9dc5734 req-32ee88b4-09e2-4b51-a848-09a398c84a88 service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:27:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e4813728-89c5-490b-a64e-2e6cb9dc5734 req-32ee88b4-09e2-4b51-a848-09a398c84a88 service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:27:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-e4813728-89c5-490b-a64e-2e6cb9dc5734 req-32ee88b4-09e2-4b51-a848-09a398c84a88 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] No waiting events found dispatching network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:27:17 user nova-compute[72849]: WARNING nova.compute.manager [req-e4813728-89c5-490b-a64e-2e6cb9dc5734 req-32ee88b4-09e2-4b51-a848-09a398c84a88 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received unexpected event network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de for instance with vm_state rescued and task_state unrescuing.
Aug 15 16:27:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Removed pending event for cc521d87-09aa-44ba-a87c-1cd5517b3707 due to event {{(pid=72849) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 16:27:19 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116839.51572, cc521d87-09aa-44ba-a87c-1cd5517b3707 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:27:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] VM Resumed (Lifecycle Event)
Aug 15 16:27:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9f9d708c-1397-4b4c-9650-9a9e12645699 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:27:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:27:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:27:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 16:27:19 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116839.5168574, cc521d87-09aa-44ba-a87c-1cd5517b3707 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:27:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] VM Started (Lifecycle Event)
Aug 15 16:27:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:27:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:27:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-c5846837-308b-410e-87ac-ae5c843318f1 req-a96a4476-cab2-4f87-8ca2-daa90030e236 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received event network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:27:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c5846837-308b-410e-87ac-ae5c843318f1 req-a96a4476-cab2-4f87-8ca2-daa90030e236 service nova] Acquiring lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:27:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c5846837-308b-410e-87ac-ae5c843318f1 req-a96a4476-cab2-4f87-8ca2-daa90030e236 service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:27:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c5846837-308b-410e-87ac-ae5c843318f1 req-a96a4476-cab2-4f87-8ca2-daa90030e236 service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:27:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-c5846837-308b-410e-87ac-ae5c843318f1 req-a96a4476-cab2-4f87-8ca2-daa90030e236 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] No waiting events found dispatching network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:27:19 user nova-compute[72849]: WARNING nova.compute.manager [req-c5846837-308b-410e-87ac-ae5c843318f1 req-a96a4476-cab2-4f87-8ca2-daa90030e236 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received unexpected event network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de for instance with vm_state active and task_state None.
Aug 15 16:27:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:22 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:27:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:27:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIrUsVkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:27:24 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:27:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:27:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:27:24 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:27:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:27:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:27:24 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:27:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb84221-7dc2-4690-91c7-fd872ffbf79a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:27:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:27:24 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:27:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81b6526-e606-4ed9-9462-4a189f8a5f21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:27:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f] added
Aug 15 16:27:24 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:27:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec938256-bab1-4dd9-a512-198ba0b41236]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d6dd09-ceb0-4240-9b44-9b6efeeefcbc]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QIrUsVkZ {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QIrUsVkZ" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5b158d-f9de-4ee2-ba19-12ac1b13544c]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QIrUsVkZ'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[af12a442-fcb3-4d4e-bf47-ef6e34e2dfdb]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b740e88-9420-4fdf-a2d1-1de163cdf460]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:27:25 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:27:25 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab08bf2-5573-43c8-a07c-012afc5d0179]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f, portal: 172.16.0.220,3260]
Aug 15 16:27:25 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f, portal: 172.16.0.220,3260] successful.
Aug 15 16:27:25 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b497669-2adc-4424-b062-218a7e673a21]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[620ae6ad-ad34-4fc9-81ad-aa05ce683d7d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:27:25 user nova-compute[72849]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:27:25 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:27:25 user nova-compute[72849]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:27:25 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8d21e2-f4a4-41a5-ad80-ce2a27458189]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIrUsVkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:27:25 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23862663831353238', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862663831353238', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG nova.objects.instance [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'flavor' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:27:26 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:27:26 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:27:26 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:27:26 user nova-compute[72849]:   <serial>72ab3753-6199-4221-ad21-89c5e58a022f</serial>
Aug 15 16:27:26 user nova-compute[72849]: </disk>
Aug 15 16:27:26 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] No VIF found with MAC fa:16:3e:62:d6:3e, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116831.8060274, 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:27:26 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] VM Stopped (Lifecycle Event)
Aug 15 16:27:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-df85fbb7-737d-4b9f-9dd6-af3d8683488d None None] [instance: 7c6d5b24-2790-4ad8-8dfe-f933b1d4d8ff] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Updating instance_info_cache with network_info: [{"id": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "address": "fa:16:3e:ca:d6:ea", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010fd638-d6", "ovs_interfaceid": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 16:27:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] There are 0 instances to clean {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 16:27:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-61f0e75c-ad41-45b3-baf0-08ff65918202 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.886s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:27:27 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:27:27 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6f6970f3-8cfa-4404-a8aa-e526e298db52 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6f6970f3-8cfa-4404-a8aa-e526e298db52 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-6f6970f3-8cfa-4404-a8aa-e526e298db52 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-6f6970f3-8cfa-4404-a8aa-e526e298db52 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72849) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG nova.objects.instance [None req-6f6970f3-8cfa-4404-a8aa-e526e298db52 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'flavor' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG nova.compute.manager [req-a37e2092-d94b-4b7c-9d60-df5d19512fb3 req-803d4447-7a11-48f2-bd1b-c529b7d77cee service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received event network-vif-unplugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a37e2092-d94b-4b7c-9d60-df5d19512fb3 req-803d4447-7a11-48f2-bd1b-c529b7d77cee service nova] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a37e2092-d94b-4b7c-9d60-df5d19512fb3 req-803d4447-7a11-48f2-bd1b-c529b7d77cee service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a37e2092-d94b-4b7c-9d60-df5d19512fb3 req-803d4447-7a11-48f2-bd1b-c529b7d77cee service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:27:28 user nova-compute[72849]: DEBUG nova.compute.manager [req-a37e2092-d94b-4b7c-9d60-df5d19512fb3 req-803d4447-7a11-48f2-bd1b-c529b7d77cee service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] No waiting events found dispatching network-vif-unplugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:27:28 user nova-compute[72849]: WARNING nova.compute.manager [req-a37e2092-d94b-4b7c-9d60-df5d19512fb3 req-803d4447-7a11-48f2-bd1b-c529b7d77cee service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received unexpected event network-vif-unplugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba for instance with vm_state active and task_state powering-off.
Aug 15 16:27:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:29 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Instance destroyed successfully.
Aug 15 16:27:29 user nova-compute[72849]: DEBUG nova.compute.manager [None req-6f6970f3-8cfa-4404-a8aa-e526e298db52 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:27:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6f6970f3-8cfa-4404-a8aa-e526e298db52 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.977s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:27:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:27:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:27:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:30 user nova-compute[72849]: DEBUG nova.compute.manager [req-1ef64c72-4a5b-455e-85f1-60537db98fc4 req-dcadc370-9540-4147-8692-fe2f31102d84 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received event network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:27:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1ef64c72-4a5b-455e-85f1-60537db98fc4 req-dcadc370-9540-4147-8692-fe2f31102d84 service nova] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:27:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1ef64c72-4a5b-455e-85f1-60537db98fc4 req-dcadc370-9540-4147-8692-fe2f31102d84 service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:27:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1ef64c72-4a5b-455e-85f1-60537db98fc4 req-dcadc370-9540-4147-8692-fe2f31102d84 service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:27:30 user nova-compute[72849]: DEBUG nova.compute.manager [req-1ef64c72-4a5b-455e-85f1-60537db98fc4 req-dcadc370-9540-4147-8692-fe2f31102d84 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] No waiting events found dispatching network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:27:30 user nova-compute[72849]: WARNING nova.compute.manager [req-1ef64c72-4a5b-455e-85f1-60537db98fc4 req-dcadc370-9540-4147-8692-fe2f31102d84 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received unexpected event network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba for instance with vm_state stopped and task_state None.
Aug 15 16:27:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:27:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:27:33 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:27:33 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:27:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=7428MB free_disk=25.229183197021484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:27:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:27:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc521d87-09aa-44ba-a87c-1cd5517b3707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 46f0aa43-e313-4aff-bacc-aa5290193b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance a3221960-e5ff-4185-a5dd-09f2cd293cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance d51623f1-6613-41d6-abcb-9e4e626a97af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f1da55ae-5150-476c-a229-f26ddfee7e9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 15aa3de5-baee-4d40-8610-1bd08249c837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0900e8d0-6e7f-40a3-9016-39851e697d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing inventories for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating ProviderTree inventory for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating inventory in ProviderTree for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing aggregate associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, aggregates: None {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing trait associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.691s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72849) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 16:27:34 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:27:35 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:27:35 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:27:35 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:27:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:27:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:44 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116849.1656861, f1da55ae-5150-476c-a229-f26ddfee7e9e => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:27:44 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] VM Stopped (Lifecycle Event)
Aug 15 16:27:44 user nova-compute[72849]: DEBUG nova.compute.manager [None req-07402bed-f025-4ad1-8439-1b22b10b304e None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:27:44 user nova-compute[72849]: DEBUG nova.compute.manager [None req-07402bed-f025-4ad1-8439-1b22b10b304e None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:27:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:27:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:00 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:28:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:00 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:28:00 user nova-compute[72849]: INFO nova.compute.claims [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Claim successful on node user
Aug 15 16:28:01 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:28:01 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:28:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:01 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:28:01 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:28:01 user nova-compute[72849]: DEBUG nova.network.neutron [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:28:01 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:28:01 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:28:01 user nova-compute[72849]: INFO nova.virt.block_device [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Booting with volume-backed-image 59265a51-1c51-4986-ae25-4fec6807c20c at /dev/vda
Aug 15 16:28:01 user nova-compute[72849]: DEBUG nova.policy [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd6279423b7f43c4aac7956aec43efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51f800c0ca74e149a2f8ed9718b221f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:28:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:02 user nova-compute[72849]: DEBUG nova.network.neutron [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Successfully created port: 65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:28:03 user nova-compute[72849]: DEBUG nova.network.neutron [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Successfully updated port: 65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:28:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "refresh_cache-ea9d5a00-42db-41e4-bb81-b3875e84f16c" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:28:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquired lock "refresh_cache-ea9d5a00-42db-41e4-bb81-b3875e84f16c" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:28:03 user nova-compute[72849]: DEBUG nova.network.neutron [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:28:03 user nova-compute[72849]: DEBUG nova.compute.manager [req-8c9c89ba-78d1-4610-8e4e-e87305e0c6e6 req-3f01c847-a353-4392-bf74-4290674bb787 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received event network-changed-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:03 user nova-compute[72849]: DEBUG nova.compute.manager [req-8c9c89ba-78d1-4610-8e4e-e87305e0c6e6 req-3f01c847-a353-4392-bf74-4290674bb787 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Refreshing instance network info cache due to event network-changed-65f4c47f-0546-4a8a-bbe6-64a38fb5210b. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:28:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8c9c89ba-78d1-4610-8e4e-e87305e0c6e6 req-3f01c847-a353-4392-bf74-4290674bb787 service nova] Acquiring lock "refresh_cache-ea9d5a00-42db-41e4-bb81-b3875e84f16c" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:28:03 user nova-compute[72849]: DEBUG nova.network.neutron [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:28:04 user nova-compute[72849]: DEBUG nova.network.neutron [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Updating instance_info_cache with network_info: [{"id": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "address": "fa:16:3e:f4:f0:ec", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f4c47f-05", "ovs_interfaceid": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:28:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Releasing lock "refresh_cache-ea9d5a00-42db-41e4-bb81-b3875e84f16c" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:28:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Instance network_info: |[{"id": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "address": "fa:16:3e:f4:f0:ec", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f4c47f-05", "ovs_interfaceid": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:28:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8c9c89ba-78d1-4610-8e4e-e87305e0c6e6 req-3f01c847-a353-4392-bf74-4290674bb787 service nova] Acquired lock "refresh_cache-ea9d5a00-42db-41e4-bb81-b3875e84f16c" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:28:04 user nova-compute[72849]: DEBUG nova.network.neutron [req-8c9c89ba-78d1-4610-8e4e-e87305e0c6e6 req-3f01c847-a353-4392-bf74-4290674bb787 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Refreshing network info cache for port 65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:28:04 user nova-compute[72849]: DEBUG nova.network.neutron [req-8c9c89ba-78d1-4610-8e4e-e87305e0c6e6 req-3f01c847-a353-4392-bf74-4290674bb787 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Updated VIF entry in instance network info cache for port 65f4c47f-0546-4a8a-bbe6-64a38fb5210b. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:28:04 user nova-compute[72849]: DEBUG nova.network.neutron [req-8c9c89ba-78d1-4610-8e4e-e87305e0c6e6 req-3f01c847-a353-4392-bf74-4290674bb787 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Updating instance_info_cache with network_info: [{"id": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "address": "fa:16:3e:f4:f0:ec", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f4c47f-05", "ovs_interfaceid": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:28:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8c9c89ba-78d1-4610-8e4e-e87305e0c6e6 req-3f01c847-a353-4392-bf74-4290674bb787 service nova] Releasing lock "refresh_cache-ea9d5a00-42db-41e4-bb81-b3875e84f16c" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:28:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:28:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:28:06 user nova-compute[72849]: INFO nova.compute.claims [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Claim successful on node user
Aug 15 16:28:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:28:06 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:28:07 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:28:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:07 user nova-compute[72849]: DEBUG nova.compute.manager [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:28:07 user nova-compute[72849]: DEBUG nova.compute.manager [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:28:07 user nova-compute[72849]: DEBUG nova.network.neutron [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:28:07 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:28:07 user nova-compute[72849]: DEBUG nova.compute.manager [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:28:07 user nova-compute[72849]: DEBUG nova.compute.manager [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:28:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:28:07 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Creating image(s)
Aug 15 16:28:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "/opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "/opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "/opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "373bd9fa5fba49f160b4aec32986cbd35921a0d3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "373bd9fa5fba49f160b4aec32986cbd35921a0d3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:07 user nova-compute[72849]: DEBUG nova.policy [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9420a64b5ea462681f3a9c6cf55986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512a50775b24f798c5cf345f08e0dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:28:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3.part --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3.part --force-share --output=json" returned: 0 in 0.195s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:07 user nova-compute[72849]: DEBUG nova.virt.images [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] 6719f73e-264d-4d11-bcbd-f88a02f98c71 was qcow2, converting to raw {{(pid=72849) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 16:28:07 user nova-compute[72849]: DEBUG nova.privsep.utils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72849) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 16:28:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3.part /opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3.converted {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:08 user nova-compute[72849]: DEBUG nova.network.neutron [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Successfully created port: 1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:28:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3.part /opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3.converted" returned: 0 in 0.298s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3.converted --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "373bd9fa5fba49f160b4aec32986cbd35921a0d3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.156s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3 --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "373bd9fa5fba49f160b4aec32986cbd35921a0d3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "373bd9fa5fba49f160b4aec32986cbd35921a0d3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3 --force-share --output=json" returned: 0 in 0.203s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3,backing_fmt=raw /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3,backing_fmt=raw /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk 1073741824" returned: 0 in 0.066s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "373bd9fa5fba49f160b4aec32986cbd35921a0d3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3 --force-share --output=json" returned: 0 in 0.226s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG nova.network.neutron [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Successfully updated port: 1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquired lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG nova.network.neutron [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-2c39cfe8-8613-4c35-913f-693ae848f751 req-50be3925-898c-47b0-b4e3-532fbd935d8c service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received event network-changed-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-2c39cfe8-8613-4c35-913f-693ae848f751 req-50be3925-898c-47b0-b4e3-532fbd935d8c service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Refreshing instance network info cache due to event network-changed-1ef6b77c-2391-485e-ad7f-851bfac1b315. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2c39cfe8-8613-4c35-913f-693ae848f751 req-50be3925-898c-47b0-b4e3-532fbd935d8c service nova] Acquiring lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Cannot resize image /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG nova.objects.instance [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lazy-loading 'migration_context' on Instance uuid 82f61128-3af4-4f82-ac4c-8ee746b5a829 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Ensure instance console log exists: /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:09 user nova-compute[72849]: DEBUG nova.network.neutron [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.network.neutron [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Updating instance_info_cache with network_info: [{"id": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "address": "fa:16:3e:ca:59:78", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef6b77c-23", "ovs_interfaceid": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Releasing lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Instance network_info: |[{"id": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "address": "fa:16:3e:ca:59:78", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef6b77c-23", "ovs_interfaceid": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2c39cfe8-8613-4c35-913f-693ae848f751 req-50be3925-898c-47b0-b4e3-532fbd935d8c service nova] Acquired lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.network.neutron [req-2c39cfe8-8613-4c35-913f-693ae848f751 req-50be3925-898c-47b0-b4e3-532fbd935d8c service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Refreshing network info cache for port 1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Start _get_guest_xml network_info=[{"id": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "address": "fa:16:3e:ca:59:78", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef6b77c-23", "ovs_interfaceid": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:28:02Z,direct_url=<?>,disk_format='qcow2',id=6719f73e-264d-4d11-bcbd-f88a02f98c71,min_disk=0,min_ram=0,name='tempest-scenario-img--1049347549',owner='8512a50775b24f798c5cf345f08e0dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:28:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '6719f73e-264d-4d11-bcbd-f88a02f98c71'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:28:10 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:28:10 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:28:02Z,direct_url=<?>,disk_format='qcow2',id=6719f73e-264d-4d11-bcbd-f88a02f98c71,min_disk=0,min_ram=0,name='tempest-scenario-img--1049347549',owner='8512a50775b24f798c5cf345f08e0dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:28:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-365929827',display_name='tempest-TestMinimumBasicScenario-server-365929827',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-365929827',id=29,image_ref='6719f73e-264d-4d11-bcbd-f88a02f98c71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjER5UtwRI+rP16dcAJycNrE1LL4uKxZ8IeE4zGjJ4ywSwno6+QPUQPvFfyNaI/VvBhZlT34caF/ZgMZ1ggK70kd84SJPZ4Pq2yHXiJU9gvoSUbLNznFdDAQXqw1xpPLA==',key_name='tempest-TestMinimumBasicScenario-1014285734',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8512a50775b24f798c5cf345f08e0dd2',ramdisk_id='',reservation_id='r-kp7aiq6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6719f73e-264d-4d11-bcbd-f88a02f98c71',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2032437405',owner_user_name='tempest-TestMinimumBasicScenario-2032437405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:28:07Z,user_data=None,user_id='d9420a64b5ea462681f3a9c6cf55986c',uuid=82f61128-3af4-4f82-ac4c-8ee746b5a829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "address": "fa:16:3e:ca:59:78", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef6b77c-23", "ovs_interfaceid": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Converting VIF {"id": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "address": "fa:16:3e:ca:59:78", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef6b77c-23", "ovs_interfaceid": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:59:78,bridge_name='br-int',has_traffic_filtering=True,id=1ef6b77c-2391-485e-ad7f-851bfac1b315,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef6b77c-23') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.objects.instance [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lazy-loading 'pci_devices' on Instance uuid 82f61128-3af4-4f82-ac4c-8ee746b5a829 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:28:10 user nova-compute[72849]:   <uuid>82f61128-3af4-4f82-ac4c-8ee746b5a829</uuid>
Aug 15 16:28:10 user nova-compute[72849]:   <name>instance-0000001d</name>
Aug 15 16:28:10 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:28:10 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:28:10 user nova-compute[72849]:   <metadata>
Aug 15 16:28:10 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:28:10 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:28:10 user nova-compute[72849]:       <nova:name>tempest-TestMinimumBasicScenario-server-365929827</nova:name>
Aug 15 16:28:10 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:28:10</nova:creationTime>
Aug 15 16:28:10 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:28:10 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:28:10 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:28:10 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:28:10 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:28:10 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:28:10 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:28:10 user nova-compute[72849]:       <nova:owner>
Aug 15 16:28:10 user nova-compute[72849]:         <nova:user uuid="d9420a64b5ea462681f3a9c6cf55986c">tempest-TestMinimumBasicScenario-2032437405-project-member</nova:user>
Aug 15 16:28:10 user nova-compute[72849]:         <nova:project uuid="8512a50775b24f798c5cf345f08e0dd2">tempest-TestMinimumBasicScenario-2032437405</nova:project>
Aug 15 16:28:10 user nova-compute[72849]:       </nova:owner>
Aug 15 16:28:10 user nova-compute[72849]:       <nova:root type="image" uuid="6719f73e-264d-4d11-bcbd-f88a02f98c71"/>
Aug 15 16:28:10 user nova-compute[72849]:       <nova:ports>
Aug 15 16:28:10 user nova-compute[72849]:         <nova:port uuid="1ef6b77c-2391-485e-ad7f-851bfac1b315">
Aug 15 16:28:10 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 16:28:10 user nova-compute[72849]:         </nova:port>
Aug 15 16:28:10 user nova-compute[72849]:       </nova:ports>
Aug 15 16:28:10 user nova-compute[72849]:     </nova:instance>
Aug 15 16:28:10 user nova-compute[72849]:   </metadata>
Aug 15 16:28:10 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:28:10 user nova-compute[72849]:     <system>
Aug 15 16:28:10 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:28:10 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:28:10 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:28:10 user nova-compute[72849]:       <entry name="serial">82f61128-3af4-4f82-ac4c-8ee746b5a829</entry>
Aug 15 16:28:10 user nova-compute[72849]:       <entry name="uuid">82f61128-3af4-4f82-ac4c-8ee746b5a829</entry>
Aug 15 16:28:10 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:28:10 user nova-compute[72849]:     </system>
Aug 15 16:28:10 user nova-compute[72849]:   </sysinfo>
Aug 15 16:28:10 user nova-compute[72849]:   <os>
Aug 15 16:28:10 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:28:10 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:28:10 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:28:10 user nova-compute[72849]:   </os>
Aug 15 16:28:10 user nova-compute[72849]:   <features>
Aug 15 16:28:10 user nova-compute[72849]:     <acpi/>
Aug 15 16:28:10 user nova-compute[72849]:     <apic/>
Aug 15 16:28:10 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:28:10 user nova-compute[72849]:   </features>
Aug 15 16:28:10 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:28:10 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:28:10 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:28:10 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:28:10 user nova-compute[72849]:   </clock>
Aug 15 16:28:10 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:28:10 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:28:10 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:28:10 user nova-compute[72849]:   </cpu>
Aug 15 16:28:10 user nova-compute[72849]:   <devices>
Aug 15 16:28:10 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:28:10 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:28:10 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk"/>
Aug 15 16:28:10 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:28:10 user nova-compute[72849]:     </disk>
Aug 15 16:28:10 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:28:10 user nova-compute[72849]:       <mac address="fa:16:3e:ca:59:78"/>
Aug 15 16:28:10 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:28:10 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:28:10 user nova-compute[72849]:       <target dev="tap1ef6b77c-23"/>
Aug 15 16:28:10 user nova-compute[72849]:     </interface>
Aug 15 16:28:10 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:28:10 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/console.log" append="off"/>
Aug 15 16:28:10 user nova-compute[72849]:     </serial>
Aug 15 16:28:10 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:28:10 user nova-compute[72849]:     <video>
Aug 15 16:28:10 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:28:10 user nova-compute[72849]:     </video>
Aug 15 16:28:10 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:28:10 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:28:10 user nova-compute[72849]:     </rng>
Aug 15 16:28:10 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:28:10 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:28:10 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:28:10 user nova-compute[72849]:     </memballoon>
Aug 15 16:28:10 user nova-compute[72849]:   </devices>
Aug 15 16:28:10 user nova-compute[72849]: </domain>
Aug 15 16:28:10 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-365929827',display_name='tempest-TestMinimumBasicScenario-server-365929827',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-365929827',id=29,image_ref='6719f73e-264d-4d11-bcbd-f88a02f98c71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjER5UtwRI+rP16dcAJycNrE1LL4uKxZ8IeE4zGjJ4ywSwno6+QPUQPvFfyNaI/VvBhZlT34caF/ZgMZ1ggK70kd84SJPZ4Pq2yHXiJU9gvoSUbLNznFdDAQXqw1xpPLA==',key_name='tempest-TestMinimumBasicScenario-1014285734',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8512a50775b24f798c5cf345f08e0dd2',ramdisk_id='',reservation_id='r-kp7aiq6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6719f73e-264d-4d11-bcbd-f88a02f98c71',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2032437405',owner_user_name='tempest-TestMinimumBasicScenario-2032437405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:28:07Z,user_data=None,user_id='d9420a64b5ea462681f3a9c6cf55986c',uuid=82f61128-3af4-4f82-ac4c-8ee746b5a829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "address": "fa:16:3e:ca:59:78", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef6b77c-23", "ovs_interfaceid": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Converting VIF {"id": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "address": "fa:16:3e:ca:59:78", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef6b77c-23", "ovs_interfaceid": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:59:78,bridge_name='br-int',has_traffic_filtering=True,id=1ef6b77c-2391-485e-ad7f-851bfac1b315,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef6b77c-23') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG os_vif [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:59:78,bridge_name='br-int',has_traffic_filtering=True,id=1ef6b77c-2391-485e-ad7f-851bfac1b315,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef6b77c-23') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ef6b77c-23, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ef6b77c-23, col_values=(('external_ids', {'iface-id': '1ef6b77c-2391-485e-ad7f-851bfac1b315', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:59:78', 'vm-uuid': '82f61128-3af4-4f82-ac4c-8ee746b5a829'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:10 user nova-compute[72849]: INFO os_vif [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:59:78,bridge_name='br-int',has_traffic_filtering=True,id=1ef6b77c-2391-485e-ad7f-851bfac1b315,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef6b77c-23')
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] No VIF found with MAC fa:16:3e:ca:59:78, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "98358bbf-c7c1-4868-81ee-77bd229133fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:28:10 user nova-compute[72849]: INFO nova.compute.claims [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Claim successful on node user
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.network.neutron [req-2c39cfe8-8613-4c35-913f-693ae848f751 req-50be3925-898c-47b0-b4e3-532fbd935d8c service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Updated VIF entry in instance network info cache for port 1ef6b77c-2391-485e-ad7f-851bfac1b315. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG nova.network.neutron [req-2c39cfe8-8613-4c35-913f-693ae848f751 req-50be3925-898c-47b0-b4e3-532fbd935d8c service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Updating instance_info_cache with network_info: [{"id": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "address": "fa:16:3e:ca:59:78", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef6b77c-23", "ovs_interfaceid": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:28:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2c39cfe8-8613-4c35-913f-693ae848f751 req-50be3925-898c-47b0-b4e3-532fbd935d8c service nova] Releasing lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG nova.network.neutron [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:28:11 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:28:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:28:11 user nova-compute[72849]: INFO nova.virt.block_device [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Booting with volume 5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 at /dev/vda
Aug 15 16:28:11 user nova-compute[72849]: DEBUG os_brick.utils [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0234aa2-2150-44cb-987e-57b31cbf43f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c0688f-f785-4843-883c-e0f1be03e1ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[290ad046-cffc-4e38-b8e1-4e78d479c5ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e1f1b0-1f59-4427-ba68-1809e14ba550]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG nova.policy [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60cbe30799ad4438b84251a254691b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a3a3412c95451db4dd0edc27f361cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:28:11 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:28:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f68decf-799e-4ed2-a108-41d2bb40981d]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG os_brick.utils [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Updating existing volume attachment record: 04e8f808-2990-451e-b152-c25157108abb {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG os_brick.utils [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ac6db2-aec1-4aaa-8051-d417b98678d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b81bb3-12a8-4b45-a9aa-f376ebc49e3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a4825b-2bd9-4009-ab2a-b0265bc5e558]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5e9861-5dcf-4bb5-aa56-38c5fec1160e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-da3b08c8-b49f-442c-81e5-4bd30a6f9cba req-f0a50827-ab2e-4e3b-bfc7-cf769b2a0ab7 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received event network-vif-plugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-da3b08c8-b49f-442c-81e5-4bd30a6f9cba req-f0a50827-ab2e-4e3b-bfc7-cf769b2a0ab7 service nova] Acquiring lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-da3b08c8-b49f-442c-81e5-4bd30a6f9cba req-f0a50827-ab2e-4e3b-bfc7-cf769b2a0ab7 service nova] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-da3b08c8-b49f-442c-81e5-4bd30a6f9cba req-f0a50827-ab2e-4e3b-bfc7-cf769b2a0ab7 service nova] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-da3b08c8-b49f-442c-81e5-4bd30a6f9cba req-f0a50827-ab2e-4e3b-bfc7-cf769b2a0ab7 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] No waiting events found dispatching network-vif-plugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:28:12 user nova-compute[72849]: WARNING nova.compute.manager [req-da3b08c8-b49f-442c-81e5-4bd30a6f9cba req-f0a50827-ab2e-4e3b-bfc7-cf769b2a0ab7 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received unexpected event network-vif-plugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 for instance with vm_state building and task_state spawning.
Aug 15 16:28:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:28:12 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:28:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[45937cca-6fba-42e4-8e81-1288645acf3d]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG os_brick.utils [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Updating existing volume attachment record: 2de9c3e8-ffb2-49e8-ba5a-2ae066b9d2d4 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:12 user nova-compute[72849]: DEBUG nova.network.neutron [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Successfully created port: f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:28:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:13 user nova-compute[72849]: DEBUG nova.network.neutron [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Successfully updated port: f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:28:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "refresh_cache-98358bbf-c7c1-4868-81ee-77bd229133fd" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:28:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquired lock "refresh_cache-98358bbf-c7c1-4868-81ee-77bd229133fd" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:28:13 user nova-compute[72849]: DEBUG nova.network.neutron [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:28:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-665878bc-9ff3-4d7e-a932-62b3019ff057 req-0c2d844a-65be-470b-b9b2-88c2f431f4ce service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received event network-changed-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-665878bc-9ff3-4d7e-a932-62b3019ff057 req-0c2d844a-65be-470b-b9b2-88c2f431f4ce service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Refreshing instance network info cache due to event network-changed-f6196531-f18f-4440-8a72-27835267e702. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:28:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-665878bc-9ff3-4d7e-a932-62b3019ff057 req-0c2d844a-65be-470b-b9b2-88c2f431f4ce service nova] Acquiring lock "refresh_cache-98358bbf-c7c1-4868-81ee-77bd229133fd" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:28:13 user nova-compute[72849]: DEBUG nova.network.neutron [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.network.neutron [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Updating instance_info_cache with network_info: [{"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Releasing lock "refresh_cache-98358bbf-c7c1-4868-81ee-77bd229133fd" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Instance network_info: |[{"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116894.227711, 82f61128-3af4-4f82-ac4c-8ee746b5a829 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:28:14 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] VM Resumed (Lifecycle Event)
Aug 15 16:28:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-665878bc-9ff3-4d7e-a932-62b3019ff057 req-0c2d844a-65be-470b-b9b2-88c2f431f4ce service nova] Acquired lock "refresh_cache-98358bbf-c7c1-4868-81ee-77bd229133fd" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.network.neutron [req-665878bc-9ff3-4d7e-a932-62b3019ff057 req-0c2d844a-65be-470b-b9b2-88c2f431f4ce service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Refreshing network info cache for port f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:28:14 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Instance spawned successfully.
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:14 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116894.2286944, 82f61128-3af4-4f82-ac4c-8ee746b5a829 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:28:14 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] VM Started (Lifecycle Event)
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:28:14 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.compute.manager [req-94be787d-607a-452c-9362-a5512de47255 req-3ac6c927-381a-44d2-95e0-e38abba260b2 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received event network-vif-plugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-94be787d-607a-452c-9362-a5512de47255 req-3ac6c927-381a-44d2-95e0-e38abba260b2 service nova] Acquiring lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-94be787d-607a-452c-9362-a5512de47255 req-3ac6c927-381a-44d2-95e0-e38abba260b2 service nova] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-94be787d-607a-452c-9362-a5512de47255 req-3ac6c927-381a-44d2-95e0-e38abba260b2 service nova] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.compute.manager [req-94be787d-607a-452c-9362-a5512de47255 req-3ac6c927-381a-44d2-95e0-e38abba260b2 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] No waiting events found dispatching network-vif-plugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:28:14 user nova-compute[72849]: WARNING nova.compute.manager [req-94be787d-607a-452c-9362-a5512de47255 req-3ac6c927-381a-44d2-95e0-e38abba260b2 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received unexpected event network-vif-plugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 for instance with vm_state building and task_state spawning.
Aug 15 16:28:14 user nova-compute[72849]: INFO nova.compute.manager [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Took 7.07 seconds to spawn the instance on the hypervisor.
Aug 15 16:28:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:28:14 user nova-compute[72849]: INFO nova.compute.manager [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Took 8.31 seconds to build instance.
Aug 15 16:28:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03e41f6b-2260-4ea0-8f74-0ba7f9661bb5 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.408s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:15 user nova-compute[72849]: DEBUG nova.network.neutron [req-665878bc-9ff3-4d7e-a932-62b3019ff057 req-0c2d844a-65be-470b-b9b2-88c2f431f4ce service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Updated VIF entry in instance network info cache for port f6196531-f18f-4440-8a72-27835267e702. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:28:15 user nova-compute[72849]: DEBUG nova.network.neutron [req-665878bc-9ff3-4d7e-a932-62b3019ff057 req-0c2d844a-65be-470b-b9b2-88c2f431f4ce service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Updating instance_info_cache with network_info: [{"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:28:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-665878bc-9ff3-4d7e-a932-62b3019ff057 req-0c2d844a-65be-470b-b9b2-88c2f431f4ce service nova] Releasing lock "refresh_cache-98358bbf-c7c1-4868-81ee-77bd229133fd" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:28:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:28:24 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Creating image(s)
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Did not create local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Ensure instance console log exists: /opt/stack/data/nova/instances/98358bbf-c7c1-4868-81ee-77bd229133fd/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Start _get_guest_xml network_info=[{"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzMGVaDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '98358bbf-c7c1-4868-81ee-77bd229133fd', 'attached_at': '', 'detached_at': '', 'volume_id': '5f4a35b3-572d-4c8f-b4bd-f97d7d15b792', 'serial': '5f4a35b3-572d-4c8f-b4bd-f97d7d15b792'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '04e8f808-2990-451e-b152-c25157108abb', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:28:24 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:28:24 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzMGVaDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:28:24 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:28:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:28:24 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:28:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:28:24 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bcdfe9-6c53-4f55-a2ec-43832769825d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:28:24 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[50201fa1-cee0-402b-b1b6-d6f5dfc127e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792] added
Aug 15 16:28:24 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d58910-9cd7-4ad6-8274-8d8cff45f728]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff10f1f6-50cd-4621-8099-884f7b997b85]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UzMGVaDy {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UzMGVaDy" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f15499d-8a3c-492c-bcc6-ba66cb0b9b13]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UzMGVaDy'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6199b17d-694c-4cf1-9b9d-c27bea5793b4]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[da306942-3035-427a-b76a-4a20ad5b420f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:28:24 user nova-compute[72849]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:28:24 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:28:24 user nova-compute[72849]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:28:24 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:28:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db86c77-f0b1-4bc8-b32b-82b4da691bac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792, portal: 172.16.0.220,3260]
Aug 15 16:28:25 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792, portal: 172.16.0.220,3260] successful.
Aug 15 16:28:25 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2712865-5634-469f-8eb7-06ed0bed34ce]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f8dbcc-68f3-453c-a83c-fc4348a90bde]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:28:25 user nova-compute[72849]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:28:25 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:28:25 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:28:25 user nova-compute[72849]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:28:25 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:28:25 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48b16a3-9006-4ac8-9a54-83f4ac40bc2b]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzMGVaDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23739653363653031', 'path': '/dev/sdc'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739653363653031', 'path': '/dev/sdc'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2006001136',display_name='tempest-ServerActionsTestOtherA-server-2006001136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2006001136',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFz77lNADA9bIEqsG+/0pmqytVknVJgn2QYVHLyikCb7OZcHj5oDk3lRMMWld0kQEG++u8j1QCo1UgVUz17EVZQY5cNigvtxWp2mZweLxgKV8OVoFjr81Ihq1bC8gLICA==',key_name='tempest-keypair-669870558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33a3a3412c95451db4dd0edc27f361cc',ramdisk_id='',reservation_id='r-hj2o5jsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-514064593',owner_user_name='tempest-ServerActionsTestOtherA-514064593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:28:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60cbe30799ad4438b84251a254691b70',uuid=98358bbf-c7c1-4868-81ee-77bd229133fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converting VIF {"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:b9:08,bridge_name='br-int',has_traffic_filtering=True,id=f6196531-f18f-4440-8a72-27835267e702,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6196531-f1') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG nova.objects.instance [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'pci_devices' on Instance uuid 98358bbf-c7c1-4868-81ee-77bd229133fd {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:28:26 user nova-compute[72849]:   <uuid>98358bbf-c7c1-4868-81ee-77bd229133fd</uuid>
Aug 15 16:28:26 user nova-compute[72849]:   <name>instance-0000001e</name>
Aug 15 16:28:26 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:28:26 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:28:26 user nova-compute[72849]:   <metadata>
Aug 15 16:28:26 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:28:26 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:28:26 user nova-compute[72849]:       <nova:name>tempest-ServerActionsTestOtherA-server-2006001136</nova:name>
Aug 15 16:28:26 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:28:24</nova:creationTime>
Aug 15 16:28:26 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:28:26 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:28:26 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:28:26 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:28:26 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:28:26 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:28:26 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:28:26 user nova-compute[72849]:       <nova:owner>
Aug 15 16:28:26 user nova-compute[72849]:         <nova:user uuid="60cbe30799ad4438b84251a254691b70">tempest-ServerActionsTestOtherA-514064593-project-member</nova:user>
Aug 15 16:28:26 user nova-compute[72849]:         <nova:project uuid="33a3a3412c95451db4dd0edc27f361cc">tempest-ServerActionsTestOtherA-514064593</nova:project>
Aug 15 16:28:26 user nova-compute[72849]:       </nova:owner>
Aug 15 16:28:26 user nova-compute[72849]:       <nova:ports>
Aug 15 16:28:26 user nova-compute[72849]:         <nova:port uuid="f6196531-f18f-4440-8a72-27835267e702">
Aug 15 16:28:26 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 16:28:26 user nova-compute[72849]:         </nova:port>
Aug 15 16:28:26 user nova-compute[72849]:       </nova:ports>
Aug 15 16:28:26 user nova-compute[72849]:     </nova:instance>
Aug 15 16:28:26 user nova-compute[72849]:   </metadata>
Aug 15 16:28:26 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:28:26 user nova-compute[72849]:     <system>
Aug 15 16:28:26 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:28:26 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:28:26 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:28:26 user nova-compute[72849]:       <entry name="serial">98358bbf-c7c1-4868-81ee-77bd229133fd</entry>
Aug 15 16:28:26 user nova-compute[72849]:       <entry name="uuid">98358bbf-c7c1-4868-81ee-77bd229133fd</entry>
Aug 15 16:28:26 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:28:26 user nova-compute[72849]:     </system>
Aug 15 16:28:26 user nova-compute[72849]:   </sysinfo>
Aug 15 16:28:26 user nova-compute[72849]:   <os>
Aug 15 16:28:26 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:28:26 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:28:26 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:28:26 user nova-compute[72849]:   </os>
Aug 15 16:28:26 user nova-compute[72849]:   <features>
Aug 15 16:28:26 user nova-compute[72849]:     <acpi/>
Aug 15 16:28:26 user nova-compute[72849]:     <apic/>
Aug 15 16:28:26 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:28:26 user nova-compute[72849]:   </features>
Aug 15 16:28:26 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:28:26 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:28:26 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:28:26 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:28:26 user nova-compute[72849]:   </clock>
Aug 15 16:28:26 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:28:26 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:28:26 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:28:26 user nova-compute[72849]:   </cpu>
Aug 15 16:28:26 user nova-compute[72849]:   <devices>
Aug 15 16:28:26 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:28:26 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:28:26 user nova-compute[72849]:       <source dev="/dev/sdc"/>
Aug 15 16:28:26 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:28:26 user nova-compute[72849]:       <serial>5f4a35b3-572d-4c8f-b4bd-f97d7d15b792</serial>
Aug 15 16:28:26 user nova-compute[72849]:     </disk>
Aug 15 16:28:26 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:28:26 user nova-compute[72849]:       <mac address="fa:16:3e:81:b9:08"/>
Aug 15 16:28:26 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:28:26 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:28:26 user nova-compute[72849]:       <target dev="tapf6196531-f1"/>
Aug 15 16:28:26 user nova-compute[72849]:     </interface>
Aug 15 16:28:26 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:28:26 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/98358bbf-c7c1-4868-81ee-77bd229133fd/console.log" append="off"/>
Aug 15 16:28:26 user nova-compute[72849]:     </serial>
Aug 15 16:28:26 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:28:26 user nova-compute[72849]:     <video>
Aug 15 16:28:26 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:28:26 user nova-compute[72849]:     </video>
Aug 15 16:28:26 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:28:26 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:28:26 user nova-compute[72849]:     </rng>
Aug 15 16:28:26 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:28:26 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:28:26 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:28:26 user nova-compute[72849]:     </memballoon>
Aug 15 16:28:26 user nova-compute[72849]:   </devices>
Aug 15 16:28:26 user nova-compute[72849]: </domain>
Aug 15 16:28:26 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2006001136',display_name='tempest-ServerActionsTestOtherA-server-2006001136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2006001136',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFz77lNADA9bIEqsG+/0pmqytVknVJgn2QYVHLyikCb7OZcHj5oDk3lRMMWld0kQEG++u8j1QCo1UgVUz17EVZQY5cNigvtxWp2mZweLxgKV8OVoFjr81Ihq1bC8gLICA==',key_name='tempest-keypair-669870558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33a3a3412c95451db4dd0edc27f361cc',ramdisk_id='',reservation_id='r-hj2o5jsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-514064593',owner_user_name='tempest-ServerActionsTestOtherA-514064593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:28:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60cbe30799ad4438b84251a254691b70',uuid=98358bbf-c7c1-4868-81ee-77bd229133fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converting VIF {"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:b9:08,bridge_name='br-int',has_traffic_filtering=True,id=f6196531-f18f-4440-8a72-27835267e702,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6196531-f1') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG os_vif [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:b9:08,bridge_name='br-int',has_traffic_filtering=True,id=f6196531-f18f-4440-8a72-27835267e702,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6196531-f1') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6196531-f1, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf6196531-f1, col_values=(('external_ids', {'iface-id': 'f6196531-f18f-4440-8a72-27835267e702', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:b9:08', 'vm-uuid': '98358bbf-c7c1-4868-81ee-77bd229133fd'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:26 user nova-compute[72849]: INFO os_vif [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:b9:08,bridge_name='br-int',has_traffic_filtering=True,id=f6196531-f18f-4440-8a72-27835267e702,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6196531-f1')
Aug 15 16:28:26 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] No VIF found with MAC fa:16:3e:81:b9:08, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-46f0aa43-e313-4aff-bacc-aa5290193b00" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-46f0aa43-e313-4aff-bacc-aa5290193b00" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:28:26 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:28:27 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Updating instance_info_cache with network_info: [{"id": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "address": "fa:16:3e:dc:17:58", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6eba8c-01", "ovs_interfaceid": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:28:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-46f0aa43-e313-4aff-bacc-aa5290193b00" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:28:27 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:28:27 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:28:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-f81c1b0b-ed52-45e5-b779-1fba0dbf94d9 req-be3df475-ec4d-47b9-b158-cd9b5957041b service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Received event network-changed-f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-f81c1b0b-ed52-45e5-b779-1fba0dbf94d9 req-be3df475-ec4d-47b9-b158-cd9b5957041b service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Refreshing instance network info cache due to event network-changed-f4f4dc6a-e6b1-4777-b99b-c240cdbc8587. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:28:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f81c1b0b-ed52-45e5-b779-1fba0dbf94d9 req-be3df475-ec4d-47b9-b158-cd9b5957041b service nova] Acquiring lock "refresh_cache-15aa3de5-baee-4d40-8610-1bd08249c837" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:28:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f81c1b0b-ed52-45e5-b779-1fba0dbf94d9 req-be3df475-ec4d-47b9-b158-cd9b5957041b service nova] Acquired lock "refresh_cache-15aa3de5-baee-4d40-8610-1bd08249c837" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:28:27 user nova-compute[72849]: DEBUG nova.network.neutron [req-f81c1b0b-ed52-45e5-b779-1fba0dbf94d9 req-be3df475-ec4d-47b9-b158-cd9b5957041b service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Refreshing network info cache for port f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:28:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:28 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:28:28 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:28:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:28:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:29 user nova-compute[72849]: DEBUG nova.network.neutron [req-f81c1b0b-ed52-45e5-b779-1fba0dbf94d9 req-be3df475-ec4d-47b9-b158-cd9b5957041b service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Updated VIF entry in instance network info cache for port f4f4dc6a-e6b1-4777-b99b-c240cdbc8587. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:28:29 user nova-compute[72849]: DEBUG nova.network.neutron [req-f81c1b0b-ed52-45e5-b779-1fba0dbf94d9 req-be3df475-ec4d-47b9-b158-cd9b5957041b service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Updating instance_info_cache with network_info: [{"id": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "address": "fa:16:3e:e3:8c:d7", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f4dc6a-e6", "ovs_interfaceid": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:28:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f81c1b0b-ed52-45e5-b779-1fba0dbf94d9 req-be3df475-ec4d-47b9-b158-cd9b5957041b service nova] Releasing lock "refresh_cache-15aa3de5-baee-4d40-8610-1bd08249c837" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:28:29 user nova-compute[72849]: DEBUG nova.compute.manager [req-3439a25f-fa59-4567-b781-f1f55e211787 req-07b86622-be5a-4c74-9256-beb8038b87b8 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received event network-vif-plugged-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3439a25f-fa59-4567-b781-f1f55e211787 req-07b86622-be5a-4c74-9256-beb8038b87b8 service nova] Acquiring lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3439a25f-fa59-4567-b781-f1f55e211787 req-07b86622-be5a-4c74-9256-beb8038b87b8 service nova] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3439a25f-fa59-4567-b781-f1f55e211787 req-07b86622-be5a-4c74-9256-beb8038b87b8 service nova] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:29 user nova-compute[72849]: DEBUG nova.compute.manager [req-3439a25f-fa59-4567-b781-f1f55e211787 req-07b86622-be5a-4c74-9256-beb8038b87b8 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] No waiting events found dispatching network-vif-plugged-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:28:29 user nova-compute[72849]: WARNING nova.compute.manager [req-3439a25f-fa59-4567-b781-f1f55e211787 req-07b86622-be5a-4c74-9256-beb8038b87b8 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received unexpected event network-vif-plugged-f6196531-f18f-4440-8a72-27835267e702 for instance with vm_state building and task_state spawning.
Aug 15 16:28:29 user nova-compute[72849]: DEBUG nova.compute.manager [req-3439a25f-fa59-4567-b781-f1f55e211787 req-07b86622-be5a-4c74-9256-beb8038b87b8 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received event network-vif-plugged-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3439a25f-fa59-4567-b781-f1f55e211787 req-07b86622-be5a-4c74-9256-beb8038b87b8 service nova] Acquiring lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3439a25f-fa59-4567-b781-f1f55e211787 req-07b86622-be5a-4c74-9256-beb8038b87b8 service nova] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3439a25f-fa59-4567-b781-f1f55e211787 req-07b86622-be5a-4c74-9256-beb8038b87b8 service nova] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:29 user nova-compute[72849]: DEBUG nova.compute.manager [req-3439a25f-fa59-4567-b781-f1f55e211787 req-07b86622-be5a-4c74-9256-beb8038b87b8 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] No waiting events found dispatching network-vif-plugged-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:28:29 user nova-compute[72849]: WARNING nova.compute.manager [req-3439a25f-fa59-4567-b781-f1f55e211787 req-07b86622-be5a-4c74-9256-beb8038b87b8 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received unexpected event network-vif-plugged-f6196531-f18f-4440-8a72-27835267e702 for instance with vm_state building and task_state spawning.
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116910.1934211, 98358bbf-c7c1-4868-81ee-77bd229133fd => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:28:30 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] VM Resumed (Lifecycle Event)
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:28:30 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Instance spawned successfully.
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:30 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116910.1971753, 98358bbf-c7c1-4868-81ee-77bd229133fd => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:28:30 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] VM Started (Lifecycle Event)
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:28:30 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:28:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:28:30 user nova-compute[72849]: INFO nova.compute.manager [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Took 5.60 seconds to spawn the instance on the hypervisor.
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Acquiring lock "306a1d17-459d-42cb-b575-fceae948fa79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "306a1d17-459d-42cb-b575-fceae948fa79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:28:30 user nova-compute[72849]: INFO nova.compute.manager [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Took 19.66 seconds to build instance.
Aug 15 16:28:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d4329ef5-f84c-4f96-829c-04802483958d tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.762s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:28:30 user nova-compute[72849]: INFO nova.compute.claims [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Claim successful on node user
Aug 15 16:28:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.653s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:31 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:28:31 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG nova.policy [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52003946466941bcb8d5d55373c14eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c15369c3d34f9d850252762620f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:28:31 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Creating image(s)
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Acquiring lock "/opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "/opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "/opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.235s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.220s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk 1073741824" returned: 0 in 0.073s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Successfully created port: 601b3faf-ad9f-4219-8f5c-bd7cca827303 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:28:32 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Creating image(s)
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Did not create local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Ensure instance console log exists: /opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Start _get_guest_xml network_info=[{"id": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "address": "fa:16:3e:f4:f0:ec", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f4c47f-05", "ovs_interfaceid": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZvYJlWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ea9d5a00-42db-41e4-bb81-b3875e84f16c', 'attached_at': '', 'detached_at': '', 'volume_id': '23f99289-8881-40a2-9fe0-dee320c8131a', 'serial': '23f99289-8881-40a2-9fe0-dee320c8131a'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '2de9c3e8-ffb2-49e8-ba5a-2ae066b9d2d4', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:28:32 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:28:32 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZvYJlWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:28:32 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:28:32 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:28:32 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.238s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f94c50-8362-4f56-b34b-b2415850495c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:28:32 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b95ffb-1566-4da6-9533-69927e9f77d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a] added
Aug 15 16:28:32 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1c9958-2bc6-4eff-99b9-2937839aeefd]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1118994-9c48-40c2-b484-5179bd32d09c]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZvYJlWR {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZvYJlWR" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[af92e7d3-4d26-4d68-831e-db3e6c7fc22f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BZvYJlWR'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4ada98-2cf0-47f7-ba4f-f8f1b5f02a34]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9db55c-3158-487d-b813-3ba3b37ca11a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:28:32 user nova-compute[72849]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:28:32 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:28:32 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:28:32 user nova-compute[72849]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:28:32 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:28:32 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Cannot resize image /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.objects.instance [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lazy-loading 'migration_context' on Instance uuid 306a1d17-459d-42cb-b575-fceae948fa79 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Ensure instance console log exists: /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[694f69d2-f085-4f78-be5c-7f0e672de8da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a, portal: 172.16.0.220,3260]
Aug 15 16:28:32 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a, portal: 172.16.0.220,3260] successful.
Aug 15 16:28:32 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa05be5-f379-411f-86f0-04a9a2c4ff6f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e717467-7074-4b82-bcb9-604999535449]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:28:32 user nova-compute[72849]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:28:32 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:28:32 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:28:32 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:28:32 user nova-compute[72849]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:28:32 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:28:32 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:28:32 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70348a7-78c3-4f2c-a19d-4f900485d123]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZvYJlWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "15aa3de5-baee-4d40-8610-1bd08249c837" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "15aa3de5-baee-4d40-8610-1bd08249c837" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG nova.objects.instance [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'flavor' on Instance uuid 15aa3de5-baee-4d40-8610-1bd08249c837 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:28:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "15aa3de5-baee-4d40-8610-1bd08249c837" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Successfully updated port: 601b3faf-ad9f-4219-8f5c-bd7cca827303 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "15aa3de5-baee-4d40-8610-1bd08249c837" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "15aa3de5-baee-4d40-8610-1bd08249c837" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:33 user nova-compute[72849]: INFO nova.compute.manager [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Attaching volume 21306e05-cf9e-4c6e-abc4-af9433f700cf to /dev/vdb
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-8dca7a40-2374-4cc2-a776-e84469ecbb44 req-ff7a73e1-d15c-439f-a7f9-80bd3efc5484 service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Received event network-changed-601b3faf-ad9f-4219-8f5c-bd7cca827303 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-8dca7a40-2374-4cc2-a776-e84469ecbb44 req-ff7a73e1-d15c-439f-a7f9-80bd3efc5484 service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Refreshing instance network info cache due to event network-changed-601b3faf-ad9f-4219-8f5c-bd7cca827303. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8dca7a40-2374-4cc2-a776-e84469ecbb44 req-ff7a73e1-d15c-439f-a7f9-80bd3efc5484 service nova] Acquiring lock "refresh_cache-306a1d17-459d-42cb-b575-fceae948fa79" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8dca7a40-2374-4cc2-a776-e84469ecbb44 req-ff7a73e1-d15c-439f-a7f9-80bd3efc5484 service nova] Acquired lock "refresh_cache-306a1d17-459d-42cb-b575-fceae948fa79" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.network.neutron [req-8dca7a40-2374-4cc2-a776-e84469ecbb44 req-ff7a73e1-d15c-439f-a7f9-80bd3efc5484 service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Refreshing network info cache for port 601b3faf-ad9f-4219-8f5c-bd7cca827303 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Acquiring lock "refresh_cache-306a1d17-459d-42cb-b575-fceae948fa79" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG os_brick.utils [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[973e5c11-901d-449b-a802-0155e586c231]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.network.neutron [req-8dca7a40-2374-4cc2-a776-e84469ecbb44 req-ff7a73e1-d15c-439f-a7f9-80bd3efc5484 service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1235721-1448-4743-aeca-0b6d242dcdc7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[50503d79-1703-4d5d-a304-9d647de27cce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb7f160-8f2a-4182-a531-6690ed82feec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:28:33 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c8ee48-ea32-4779-a592-8700655cf31c]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG os_brick.utils [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Updating existing volume attachment record: aa018f3f-76d3-46db-8b61-3eeb1bcac0f9 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.network.neutron [req-8dca7a40-2374-4cc2-a776-e84469ecbb44 req-ff7a73e1-d15c-439f-a7f9-80bd3efc5484 service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8dca7a40-2374-4cc2-a776-e84469ecbb44 req-ff7a73e1-d15c-439f-a7f9-80bd3efc5484 service nova] Releasing lock "refresh_cache-306a1d17-459d-42cb-b575-fceae948fa79" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Acquired lock "refresh_cache-306a1d17-459d-42cb-b575-fceae948fa79" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '23131353136303961', 'path': '/dev/sdd'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131353136303961', 'path': '/dev/sdd'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-111188340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-111188340',id=28,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f51f800c0ca74e149a2f8ed9718b221f',ramdisk_id='',reservation_id='r-0c8a77eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:28:01Z,user_data=None,user_id='cd6279423b7f43c4aac7956aec43efdd',uuid=ea9d5a00-42db-41e4-bb81-b3875e84f16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "address": "fa:16:3e:f4:f0:ec", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f4c47f-05", "ovs_interfaceid": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converting VIF {"id": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "address": "fa:16:3e:f4:f0:ec", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f4c47f-05", "ovs_interfaceid": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:f0:ec,bridge_name='br-int',has_traffic_filtering=True,id=65f4c47f-0546-4a8a-bbe6-64a38fb5210b,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f4c47f-05') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.objects.instance [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'pci_devices' on Instance uuid ea9d5a00-42db-41e4-bb81-b3875e84f16c {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:28:33 user nova-compute[72849]:   <uuid>ea9d5a00-42db-41e4-bb81-b3875e84f16c</uuid>
Aug 15 16:28:33 user nova-compute[72849]:   <name>instance-0000001c</name>
Aug 15 16:28:33 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:28:33 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:28:33 user nova-compute[72849]:   <metadata>
Aug 15 16:28:33 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:28:33 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:28:33 user nova-compute[72849]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-111188340</nova:name>
Aug 15 16:28:33 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:28:32</nova:creationTime>
Aug 15 16:28:33 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:28:33 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:28:33 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:28:33 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:28:33 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:28:33 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:28:33 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:28:33 user nova-compute[72849]:       <nova:owner>
Aug 15 16:28:33 user nova-compute[72849]:         <nova:user uuid="cd6279423b7f43c4aac7956aec43efdd">tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member</nova:user>
Aug 15 16:28:33 user nova-compute[72849]:         <nova:project uuid="f51f800c0ca74e149a2f8ed9718b221f">tempest-ServerBootFromVolumeStableRescueTest-1207284584</nova:project>
Aug 15 16:28:33 user nova-compute[72849]:       </nova:owner>
Aug 15 16:28:33 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:28:33 user nova-compute[72849]:       <nova:ports>
Aug 15 16:28:33 user nova-compute[72849]:         <nova:port uuid="65f4c47f-0546-4a8a-bbe6-64a38fb5210b">
Aug 15 16:28:33 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 16:28:33 user nova-compute[72849]:         </nova:port>
Aug 15 16:28:33 user nova-compute[72849]:       </nova:ports>
Aug 15 16:28:33 user nova-compute[72849]:     </nova:instance>
Aug 15 16:28:33 user nova-compute[72849]:   </metadata>
Aug 15 16:28:33 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:28:33 user nova-compute[72849]:     <system>
Aug 15 16:28:33 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:28:33 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:28:33 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:28:33 user nova-compute[72849]:       <entry name="serial">ea9d5a00-42db-41e4-bb81-b3875e84f16c</entry>
Aug 15 16:28:33 user nova-compute[72849]:       <entry name="uuid">ea9d5a00-42db-41e4-bb81-b3875e84f16c</entry>
Aug 15 16:28:33 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:28:33 user nova-compute[72849]:     </system>
Aug 15 16:28:33 user nova-compute[72849]:   </sysinfo>
Aug 15 16:28:33 user nova-compute[72849]:   <os>
Aug 15 16:28:33 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:28:33 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:28:33 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:28:33 user nova-compute[72849]:   </os>
Aug 15 16:28:33 user nova-compute[72849]:   <features>
Aug 15 16:28:33 user nova-compute[72849]:     <acpi/>
Aug 15 16:28:33 user nova-compute[72849]:     <apic/>
Aug 15 16:28:33 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:28:33 user nova-compute[72849]:   </features>
Aug 15 16:28:33 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:28:33 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:28:33 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:28:33 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:28:33 user nova-compute[72849]:   </clock>
Aug 15 16:28:33 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:28:33 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:28:33 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:28:33 user nova-compute[72849]:   </cpu>
Aug 15 16:28:33 user nova-compute[72849]:   <devices>
Aug 15 16:28:33 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:28:33 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:28:33 user nova-compute[72849]:       <source dev="/dev/sdd"/>
Aug 15 16:28:33 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:28:33 user nova-compute[72849]:       <serial>23f99289-8881-40a2-9fe0-dee320c8131a</serial>
Aug 15 16:28:33 user nova-compute[72849]:     </disk>
Aug 15 16:28:33 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:28:33 user nova-compute[72849]:       <mac address="fa:16:3e:f4:f0:ec"/>
Aug 15 16:28:33 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:28:33 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:28:33 user nova-compute[72849]:       <target dev="tap65f4c47f-05"/>
Aug 15 16:28:33 user nova-compute[72849]:     </interface>
Aug 15 16:28:33 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:28:33 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c/console.log" append="off"/>
Aug 15 16:28:33 user nova-compute[72849]:     </serial>
Aug 15 16:28:33 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:28:33 user nova-compute[72849]:     <video>
Aug 15 16:28:33 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:28:33 user nova-compute[72849]:     </video>
Aug 15 16:28:33 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:28:33 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:28:33 user nova-compute[72849]:     </rng>
Aug 15 16:28:33 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:28:33 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:28:33 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:28:33 user nova-compute[72849]:     </memballoon>
Aug 15 16:28:33 user nova-compute[72849]:   </devices>
Aug 15 16:28:33 user nova-compute[72849]: </domain>
Aug 15 16:28:33 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-111188340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-111188340',id=28,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f51f800c0ca74e149a2f8ed9718b221f',ramdisk_id='',reservation_id='r-0c8a77eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:28:01Z,user_data=None,user_id='cd6279423b7f43c4aac7956aec43efdd',uuid=ea9d5a00-42db-41e4-bb81-b3875e84f16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "address": "fa:16:3e:f4:f0:ec", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f4c47f-05", "ovs_interfaceid": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converting VIF {"id": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "address": "fa:16:3e:f4:f0:ec", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f4c47f-05", "ovs_interfaceid": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:f0:ec,bridge_name='br-int',has_traffic_filtering=True,id=65f4c47f-0546-4a8a-bbe6-64a38fb5210b,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f4c47f-05') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG os_vif [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:f0:ec,bridge_name='br-int',has_traffic_filtering=True,id=65f4c47f-0546-4a8a-bbe6-64a38fb5210b,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f4c47f-05') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65f4c47f-05, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap65f4c47f-05, col_values=(('external_ids', {'iface-id': '65f4c47f-0546-4a8a-bbe6-64a38fb5210b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:f0:ec', 'vm-uuid': 'ea9d5a00-42db-41e4-bb81-b3875e84f16c'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:33 user nova-compute[72849]: INFO os_vif [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:f0:ec,bridge_name='br-int',has_traffic_filtering=True,id=65f4c47f-0546-4a8a-bbe6-64a38fb5210b,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f4c47f-05')
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:28:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] No VIF found with MAC fa:16:3e:f4:f0:ec, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Updating instance_info_cache with network_info: [{"id": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "address": "fa:16:3e:71:db:6d", "network": {"id": "8c8e3ae7-d19d-4b52-8a73-b63a569ab9b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-915203707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c15369c3d34f9d850252762620f9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap601b3faf-ad", "ovs_interfaceid": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Releasing lock "refresh_cache-306a1d17-459d-42cb-b575-fceae948fa79" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Instance network_info: |[{"id": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "address": "fa:16:3e:71:db:6d", "network": {"id": "8c8e3ae7-d19d-4b52-8a73-b63a569ab9b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-915203707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c15369c3d34f9d850252762620f9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap601b3faf-ad", "ovs_interfaceid": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Start _get_guest_xml network_info=[{"id": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "address": "fa:16:3e:71:db:6d", "network": {"id": "8c8e3ae7-d19d-4b52-8a73-b63a569ab9b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-915203707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c15369c3d34f9d850252762620f9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap601b3faf-ad", "ovs_interfaceid": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:28:34 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:28:34 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1829945229',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1829945229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1829945',id=31,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp+KN195dBCCoE9FSVVesdNHmJVNCAI4L0A74D4dyDvRyiEKc7xprFsP9t1BdhikFYk0gJpyWtH9WckhrEWmpoe3nduua6l9wRE03ZFgYSz6jJmixJxb/wPmoIgwubWWQ==',key_name='tempest-keypair-176102540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07c15369c3d34f9d850252762620f9ab',ramdisk_id='',reservation_id='r-9807vhz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1627285683',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:28:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52003946466941bcb8d5d55373c14eaa',uuid=306a1d17-459d-42cb-b575-fceae948fa79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "address": "fa:16:3e:71:db:6d", "network": {"id": "8c8e3ae7-d19d-4b52-8a73-b63a569ab9b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-915203707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c15369c3d34f9d850252762620f9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap601b3faf-ad", "ovs_interfaceid": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Converting VIF {"id": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "address": "fa:16:3e:71:db:6d", "network": {"id": "8c8e3ae7-d19d-4b52-8a73-b63a569ab9b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-915203707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c15369c3d34f9d850252762620f9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap601b3faf-ad", "ovs_interfaceid": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:db:6d,bridge_name='br-int',has_traffic_filtering=True,id=601b3faf-ad9f-4219-8f5c-bd7cca827303,network=Network(8c8e3ae7-d19d-4b52-8a73-b63a569ab9b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap601b3faf-ad') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.objects.instance [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lazy-loading 'pci_devices' on Instance uuid 306a1d17-459d-42cb-b575-fceae948fa79 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:28:34 user nova-compute[72849]:   <uuid>306a1d17-459d-42cb-b575-fceae948fa79</uuid>
Aug 15 16:28:34 user nova-compute[72849]:   <name>instance-0000001f</name>
Aug 15 16:28:34 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:28:34 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:28:34 user nova-compute[72849]:   <metadata>
Aug 15 16:28:34 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:28:34 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:28:34 user nova-compute[72849]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1829945229</nova:name>
Aug 15 16:28:34 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:28:34</nova:creationTime>
Aug 15 16:28:34 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:28:34 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:28:34 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:28:34 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:28:34 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:28:34 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:28:34 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:28:34 user nova-compute[72849]:       <nova:owner>
Aug 15 16:28:34 user nova-compute[72849]:         <nova:user uuid="52003946466941bcb8d5d55373c14eaa">tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member</nova:user>
Aug 15 16:28:34 user nova-compute[72849]:         <nova:project uuid="07c15369c3d34f9d850252762620f9ab">tempest-TestServerVolumeAttachScenarioOldVersion-1627285683</nova:project>
Aug 15 16:28:34 user nova-compute[72849]:       </nova:owner>
Aug 15 16:28:34 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:28:34 user nova-compute[72849]:       <nova:ports>
Aug 15 16:28:34 user nova-compute[72849]:         <nova:port uuid="601b3faf-ad9f-4219-8f5c-bd7cca827303">
Aug 15 16:28:34 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 16:28:34 user nova-compute[72849]:         </nova:port>
Aug 15 16:28:34 user nova-compute[72849]:       </nova:ports>
Aug 15 16:28:34 user nova-compute[72849]:     </nova:instance>
Aug 15 16:28:34 user nova-compute[72849]:   </metadata>
Aug 15 16:28:34 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:28:34 user nova-compute[72849]:     <system>
Aug 15 16:28:34 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:28:34 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:28:34 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:28:34 user nova-compute[72849]:       <entry name="serial">306a1d17-459d-42cb-b575-fceae948fa79</entry>
Aug 15 16:28:34 user nova-compute[72849]:       <entry name="uuid">306a1d17-459d-42cb-b575-fceae948fa79</entry>
Aug 15 16:28:34 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:28:34 user nova-compute[72849]:     </system>
Aug 15 16:28:34 user nova-compute[72849]:   </sysinfo>
Aug 15 16:28:34 user nova-compute[72849]:   <os>
Aug 15 16:28:34 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:28:34 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:28:34 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:28:34 user nova-compute[72849]:   </os>
Aug 15 16:28:34 user nova-compute[72849]:   <features>
Aug 15 16:28:34 user nova-compute[72849]:     <acpi/>
Aug 15 16:28:34 user nova-compute[72849]:     <apic/>
Aug 15 16:28:34 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:28:34 user nova-compute[72849]:   </features>
Aug 15 16:28:34 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:28:34 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:28:34 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:28:34 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:28:34 user nova-compute[72849]:   </clock>
Aug 15 16:28:34 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:28:34 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:28:34 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:28:34 user nova-compute[72849]:   </cpu>
Aug 15 16:28:34 user nova-compute[72849]:   <devices>
Aug 15 16:28:34 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:28:34 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:28:34 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk"/>
Aug 15 16:28:34 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:28:34 user nova-compute[72849]:     </disk>
Aug 15 16:28:34 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:28:34 user nova-compute[72849]:       <mac address="fa:16:3e:71:db:6d"/>
Aug 15 16:28:34 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:28:34 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:28:34 user nova-compute[72849]:       <target dev="tap601b3faf-ad"/>
Aug 15 16:28:34 user nova-compute[72849]:     </interface>
Aug 15 16:28:34 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:28:34 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/console.log" append="off"/>
Aug 15 16:28:34 user nova-compute[72849]:     </serial>
Aug 15 16:28:34 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:28:34 user nova-compute[72849]:     <video>
Aug 15 16:28:34 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:28:34 user nova-compute[72849]:     </video>
Aug 15 16:28:34 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:28:34 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:28:34 user nova-compute[72849]:     </rng>
Aug 15 16:28:34 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:28:34 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:28:34 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:28:34 user nova-compute[72849]:     </memballoon>
Aug 15 16:28:34 user nova-compute[72849]:   </devices>
Aug 15 16:28:34 user nova-compute[72849]: </domain>
Aug 15 16:28:34 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1829945229',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1829945229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1829945',id=31,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp+KN195dBCCoE9FSVVesdNHmJVNCAI4L0A74D4dyDvRyiEKc7xprFsP9t1BdhikFYk0gJpyWtH9WckhrEWmpoe3nduua6l9wRE03ZFgYSz6jJmixJxb/wPmoIgwubWWQ==',key_name='tempest-keypair-176102540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07c15369c3d34f9d850252762620f9ab',ramdisk_id='',reservation_id='r-9807vhz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1627285683',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:28:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52003946466941bcb8d5d55373c14eaa',uuid=306a1d17-459d-42cb-b575-fceae948fa79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "address": "fa:16:3e:71:db:6d", "network": {"id": "8c8e3ae7-d19d-4b52-8a73-b63a569ab9b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-915203707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c15369c3d34f9d850252762620f9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap601b3faf-ad", "ovs_interfaceid": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Converting VIF {"id": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "address": "fa:16:3e:71:db:6d", "network": {"id": "8c8e3ae7-d19d-4b52-8a73-b63a569ab9b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-915203707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c15369c3d34f9d850252762620f9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap601b3faf-ad", "ovs_interfaceid": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:db:6d,bridge_name='br-int',has_traffic_filtering=True,id=601b3faf-ad9f-4219-8f5c-bd7cca827303,network=Network(8c8e3ae7-d19d-4b52-8a73-b63a569ab9b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap601b3faf-ad') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG os_vif [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:db:6d,bridge_name='br-int',has_traffic_filtering=True,id=601b3faf-ad9f-4219-8f5c-bd7cca827303,network=Network(8c8e3ae7-d19d-4b52-8a73-b63a569ab9b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap601b3faf-ad') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap601b3faf-ad, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap601b3faf-ad, col_values=(('external_ids', {'iface-id': '601b3faf-ad9f-4219-8f5c-bd7cca827303', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:db:6d', 'vm-uuid': '306a1d17-459d-42cb-b575-fceae948fa79'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:34 user nova-compute[72849]: INFO os_vif [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:db:6d,bridge_name='br-int',has_traffic_filtering=True,id=601b3faf-ad9f-4219-8f5c-bd7cca827303,network=Network(8c8e3ae7-d19d-4b52-8a73-b63a569ab9b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap601b3faf-ad')
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] No VIF found with MAC fa:16:3e:71:db:6d, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:36 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:28:36 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=7363MB free_disk=25.16736602783203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc521d87-09aa-44ba-a87c-1cd5517b3707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 46f0aa43-e313-4aff-bacc-aa5290193b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance a3221960-e5ff-4185-a5dd-09f2cd293cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance d51623f1-6613-41d6-abcb-9e4e626a97af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f1da55ae-5150-476c-a229-f26ddfee7e9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 15aa3de5-baee-4d40-8610-1bd08249c837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0900e8d0-6e7f-40a3-9016-39851e697d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance ea9d5a00-42db-41e4-bb81-b3875e84f16c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 82f61128-3af4-4f82-ac4c-8ee746b5a829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 98358bbf-c7c1-4868-81ee-77bd229133fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 306a1d17-459d-42cb-b575-fceae948fa79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.manager [req-31ea9b43-9509-453f-a6a5-fab1fdf557d2 req-522145ff-557c-4992-b0c2-1b66c7222a3b service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received event network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-31ea9b43-9509-453f-a6a5-fab1fdf557d2 req-522145ff-557c-4992-b0c2-1b66c7222a3b service nova] Acquiring lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-31ea9b43-9509-453f-a6a5-fab1fdf557d2 req-522145ff-557c-4992-b0c2-1b66c7222a3b service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-31ea9b43-9509-453f-a6a5-fab1fdf557d2 req-522145ff-557c-4992-b0c2-1b66c7222a3b service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:36 user nova-compute[72849]: DEBUG nova.compute.manager [req-31ea9b43-9509-453f-a6a5-fab1fdf557d2 req-522145ff-557c-4992-b0c2-1b66c7222a3b service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] No waiting events found dispatching network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:28:36 user nova-compute[72849]: WARNING nova.compute.manager [req-31ea9b43-9509-453f-a6a5-fab1fdf557d2 req-522145ff-557c-4992-b0c2-1b66c7222a3b service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received unexpected event network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b for instance with vm_state building and task_state spawning.
Aug 15 16:28:37 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:28:37 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:28:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:28:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.701s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:37 user nova-compute[72849]: DEBUG nova.compute.manager [req-5e62cf43-4167-4324-96a2-eb707282b0e8 req-16905264-02d6-4904-97ce-ef14bb46beeb service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Received event network-vif-plugged-601b3faf-ad9f-4219-8f5c-bd7cca827303 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5e62cf43-4167-4324-96a2-eb707282b0e8 req-16905264-02d6-4904-97ce-ef14bb46beeb service nova] Acquiring lock "306a1d17-459d-42cb-b575-fceae948fa79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5e62cf43-4167-4324-96a2-eb707282b0e8 req-16905264-02d6-4904-97ce-ef14bb46beeb service nova] Lock "306a1d17-459d-42cb-b575-fceae948fa79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5e62cf43-4167-4324-96a2-eb707282b0e8 req-16905264-02d6-4904-97ce-ef14bb46beeb service nova] Lock "306a1d17-459d-42cb-b575-fceae948fa79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:37 user nova-compute[72849]: DEBUG nova.compute.manager [req-5e62cf43-4167-4324-96a2-eb707282b0e8 req-16905264-02d6-4904-97ce-ef14bb46beeb service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] No waiting events found dispatching network-vif-plugged-601b3faf-ad9f-4219-8f5c-bd7cca827303 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:28:37 user nova-compute[72849]: WARNING nova.compute.manager [req-5e62cf43-4167-4324-96a2-eb707282b0e8 req-16905264-02d6-4904-97ce-ef14bb46beeb service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Received unexpected event network-vif-plugged-601b3faf-ad9f-4219-8f5c-bd7cca827303 for instance with vm_state building and task_state spawning.
Aug 15 16:28:38 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:28:38 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:28:38 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:28:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-080d86d9-b557-4143-b8bd-e3a145662dfb req-48e5b65e-16f9-418d-8dd2-69f6fdde93de service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received event network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-080d86d9-b557-4143-b8bd-e3a145662dfb req-48e5b65e-16f9-418d-8dd2-69f6fdde93de service nova] Acquiring lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-080d86d9-b557-4143-b8bd-e3a145662dfb req-48e5b65e-16f9-418d-8dd2-69f6fdde93de service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-080d86d9-b557-4143-b8bd-e3a145662dfb req-48e5b65e-16f9-418d-8dd2-69f6fdde93de service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-080d86d9-b557-4143-b8bd-e3a145662dfb req-48e5b65e-16f9-418d-8dd2-69f6fdde93de service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] No waiting events found dispatching network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:28:39 user nova-compute[72849]: WARNING nova.compute.manager [req-080d86d9-b557-4143-b8bd-e3a145662dfb req-48e5b65e-16f9-418d-8dd2-69f6fdde93de service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received unexpected event network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b for instance with vm_state building and task_state spawning.
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-080d86d9-b557-4143-b8bd-e3a145662dfb req-48e5b65e-16f9-418d-8dd2-69f6fdde93de service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received event network-changed-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-080d86d9-b557-4143-b8bd-e3a145662dfb req-48e5b65e-16f9-418d-8dd2-69f6fdde93de service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Refreshing instance network info cache due to event network-changed-58268f65-6b08-4cdd-9ae3-b256ed150e60. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-080d86d9-b557-4143-b8bd-e3a145662dfb req-48e5b65e-16f9-418d-8dd2-69f6fdde93de service nova] Acquiring lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-080d86d9-b557-4143-b8bd-e3a145662dfb req-48e5b65e-16f9-418d-8dd2-69f6fdde93de service nova] Acquired lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-080d86d9-b557-4143-b8bd-e3a145662dfb req-48e5b65e-16f9-418d-8dd2-69f6fdde93de service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Refreshing network info cache for port 58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-080d86d9-b557-4143-b8bd-e3a145662dfb req-48e5b65e-16f9-418d-8dd2-69f6fdde93de service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Updated VIF entry in instance network info cache for port 58268f65-6b08-4cdd-9ae3-b256ed150e60. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-080d86d9-b557-4143-b8bd-e3a145662dfb req-48e5b65e-16f9-418d-8dd2-69f6fdde93de service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Updating instance_info_cache with network_info: [{"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-080d86d9-b557-4143-b8bd-e3a145662dfb req-48e5b65e-16f9-418d-8dd2-69f6fdde93de service nova] Releasing lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116919.8542402, ea9d5a00-42db-41e4-bb81-b3875e84f16c => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:28:39 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] VM Resumed (Lifecycle Event)
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:28:39 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Instance spawned successfully.
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-bdb350ba-5ab4-47c4-ad01-b3bbe96a5121 req-75340eda-fe3b-42ef-92e5-fdf405c68697 service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Received event network-vif-plugged-601b3faf-ad9f-4219-8f5c-bd7cca827303 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-bdb350ba-5ab4-47c4-ad01-b3bbe96a5121 req-75340eda-fe3b-42ef-92e5-fdf405c68697 service nova] Acquiring lock "306a1d17-459d-42cb-b575-fceae948fa79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-bdb350ba-5ab4-47c4-ad01-b3bbe96a5121 req-75340eda-fe3b-42ef-92e5-fdf405c68697 service nova] Lock "306a1d17-459d-42cb-b575-fceae948fa79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-bdb350ba-5ab4-47c4-ad01-b3bbe96a5121 req-75340eda-fe3b-42ef-92e5-fdf405c68697 service nova] Lock "306a1d17-459d-42cb-b575-fceae948fa79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-bdb350ba-5ab4-47c4-ad01-b3bbe96a5121 req-75340eda-fe3b-42ef-92e5-fdf405c68697 service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] No waiting events found dispatching network-vif-plugged-601b3faf-ad9f-4219-8f5c-bd7cca827303 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:28:39 user nova-compute[72849]: WARNING nova.compute.manager [req-bdb350ba-5ab4-47c4-ad01-b3bbe96a5121 req-75340eda-fe3b-42ef-92e5-fdf405c68697 service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Received unexpected event network-vif-plugged-601b3faf-ad9f-4219-8f5c-bd7cca827303 for instance with vm_state building and task_state spawning.
Aug 15 16:28:39 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116919.8558743, ea9d5a00-42db-41e4-bb81-b3875e84f16c => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:28:39 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] VM Started (Lifecycle Event)
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:28:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:28:40 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:28:40 user nova-compute[72849]: INFO nova.compute.manager [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Took 7.89 seconds to spawn the instance on the hypervisor.
Aug 15 16:28:40 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:28:40 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:28:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:28:40 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116920.113006, 306a1d17-459d-42cb-b575-fceae948fa79 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:28:40 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] VM Resumed (Lifecycle Event)
Aug 15 16:28:40 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Instance spawned successfully.
Aug 15 16:28:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:28:40 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:28:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:40 user nova-compute[72849]: INFO nova.compute.manager [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Took 39.37 seconds to build instance.
Aug 15 16:28:40 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:28:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2d293738-a35e-4ca4-b3da-0f98798c2248 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.479s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:40 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:28:40 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116920.119983, 306a1d17-459d-42cb-b575-fceae948fa79 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:28:40 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] VM Started (Lifecycle Event)
Aug 15 16:28:40 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:28:40 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:28:40 user nova-compute[72849]: INFO nova.compute.manager [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Took 8.84 seconds to spawn the instance on the hypervisor.
Aug 15 16:28:40 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:28:40 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:28:40 user nova-compute[72849]: INFO nova.compute.manager [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Took 9.93 seconds to build instance.
Aug 15 16:28:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a1cf8ed0-a07a-4b97-b5d4-fc60e5d2a648 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "306a1d17-459d-42cb-b575-fceae948fa79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.046s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "0900e8d0-6e7f-40a3-9016-39851e697d09" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:44 user nova-compute[72849]: INFO nova.compute.manager [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Shelving
Aug 15 16:28:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KiLprvgI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:28:44 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:28:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:28:44 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:28:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:28:44 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:28:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd67b0b1-5db3-4ee1-8500-fcc185a84d20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:28:44 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8dc145-3747-4d3b-8930-c20168fb9316]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf] added
Aug 15 16:28:44 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b90293-8842-4037-8aa9-1f93f8791001]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d922030-b66b-4fe1-b868-a970640f849f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KiLprvgI {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-70eb906d-dffa-46d0-b1a4-53502a9c614f req-7965e7bd-1d4d-40e6-bc94-58814111a3b7 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received event network-vif-unplugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-70eb906d-dffa-46d0-b1a4-53502a9c614f req-7965e7bd-1d4d-40e6-bc94-58814111a3b7 service nova] Acquiring lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-70eb906d-dffa-46d0-b1a4-53502a9c614f req-7965e7bd-1d4d-40e6-bc94-58814111a3b7 service nova] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-70eb906d-dffa-46d0-b1a4-53502a9c614f req-7965e7bd-1d4d-40e6-bc94-58814111a3b7 service nova] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-70eb906d-dffa-46d0-b1a4-53502a9c614f req-7965e7bd-1d4d-40e6-bc94-58814111a3b7 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] No waiting events found dispatching network-vif-unplugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:28:45 user nova-compute[72849]: WARNING nova.compute.manager [req-70eb906d-dffa-46d0-b1a4-53502a9c614f req-7965e7bd-1d4d-40e6-bc94-58814111a3b7 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received unexpected event network-vif-unplugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 for instance with vm_state active and task_state shelving.
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KiLprvgI" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f1f592-ff43-41c4-afa0-635b3052a2a1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KiLprvgI'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a752d075-4855-4b73-8ab2-8ab4a20f6c61]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1b6e64-5e0b-43e6-b9d3-ff9b2bb24046]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:28:45 user nova-compute[72849]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:28:45 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:28:45 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:28:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:28:45 user nova-compute[72849]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:28:45 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:28:45 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:28:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a267e86a-852b-47ac-8074-de36814e8085]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf, portal: 172.16.0.220,3260]
Aug 15 16:28:45 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf, portal: 172.16.0.220,3260] successful.
Aug 15 16:28:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3781102b-79eb-4df1-8878-77703d70ba30]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e692198d-85f8-4198-9e11-4d6d78c127c3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:28:45 user nova-compute[72849]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:28:45 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:28:45 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:28:45 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:28:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:28:45 user nova-compute[72849]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:28:45 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:28:45 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:28:45 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:28:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.424s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ece5de-eb01-475f-8cce-0e2d24d72257]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KiLprvgI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:28:45 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Instance destroyed successfully.
Aug 15 16:28:45 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Beginning cold snapshot process
Aug 15 16:28:45 user nova-compute[72849]: DEBUG nova.privsep.utils [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72849) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 16:28:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk /opt/stack/data/nova/instances/snapshots/tmpszf09qf5/a81bde06d82941aebfb19b61ddf270f3 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.484s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:28:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] <== connect_volume: return (1487ms) {'type': 'block', 'scsi_wwn': '23865366464326165', 'path': '/dev/sde'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:28:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865366464326165', 'path': '/dev/sde'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:28:46 user nova-compute[72849]: DEBUG nova.objects.instance [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'flavor' on Instance uuid 15aa3de5-baee-4d40-8610-1bd08249c837 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:28:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:28:46 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:28:46 user nova-compute[72849]:   <source dev="/dev/sde"/>
Aug 15 16:28:46 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:28:46 user nova-compute[72849]:   <serial>21306e05-cf9e-4c6e-abc4-af9433f700cf</serial>
Aug 15 16:28:46 user nova-compute[72849]: </disk>
Aug 15 16:28:46 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:28:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk /opt/stack/data/nova/instances/snapshots/tmpszf09qf5/a81bde06d82941aebfb19b61ddf270f3" returned: 0 in 0.895s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:46 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Snapshot extracted, beginning image upload
Aug 15 16:28:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:28:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:28:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] No VIF found with MAC fa:16:3e:e3:8c:d7, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:28:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2ebe9504-51c5-4117-94d6-1a8b1b0cda59 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "15aa3de5-baee-4d40-8610-1bd08249c837" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.881s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:47 user nova-compute[72849]: DEBUG nova.compute.manager [req-2a3a52b7-3551-4800-aea8-c14f5d130aa3 req-0415141f-2a2e-48e4-b596-305d68c519b2 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received event network-vif-plugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2a3a52b7-3551-4800-aea8-c14f5d130aa3 req-0415141f-2a2e-48e4-b596-305d68c519b2 service nova] Acquiring lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2a3a52b7-3551-4800-aea8-c14f5d130aa3 req-0415141f-2a2e-48e4-b596-305d68c519b2 service nova] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2a3a52b7-3551-4800-aea8-c14f5d130aa3 req-0415141f-2a2e-48e4-b596-305d68c519b2 service nova] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:47 user nova-compute[72849]: DEBUG nova.compute.manager [req-2a3a52b7-3551-4800-aea8-c14f5d130aa3 req-0415141f-2a2e-48e4-b596-305d68c519b2 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] No waiting events found dispatching network-vif-plugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:28:47 user nova-compute[72849]: WARNING nova.compute.manager [req-2a3a52b7-3551-4800-aea8-c14f5d130aa3 req-0415141f-2a2e-48e4-b596-305d68c519b2 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received unexpected event network-vif-plugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 16:28:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:49 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Snapshot image upload complete
Aug 15 16:28:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:28:49 user nova-compute[72849]: INFO nova.compute.manager [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Shelve offloading
Aug 15 16:28:49 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Instance destroyed successfully.
Aug 15 16:28:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:28:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:28:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquired lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:28:49 user nova-compute[72849]: DEBUG nova.network.neutron [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:28:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:50 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:28:50 user nova-compute[72849]: DEBUG nova.network.neutron [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Updating instance_info_cache with network_info: [{"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:28:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Releasing lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:28:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:50 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:28:50 user nova-compute[72849]: INFO nova.compute.claims [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Claim successful on node user
Aug 15 16:28:50 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:28:50 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG nova.network.neutron [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:28:51 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:28:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:28:51 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Creating image(s)
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "/opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "/opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "/opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG nova.policy [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e99eefba54014b9ea83f1611b02efaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ddd223976e4b13a3b6a5638846f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.187s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:51 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Instance destroyed successfully.
Aug 15 16:28:51 user nova-compute[72849]: DEBUG nova.objects.instance [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'resources' on Instance uuid 0900e8d0-6e7f-40a3-9016-39851e697d09 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG nova.compute.manager [req-ac06907a-4be1-4360-9fcf-534c00097228 req-1943313f-623f-4fc7-8a8e-7ce664416098 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received event network-changed-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG nova.compute.manager [req-ac06907a-4be1-4360-9fcf-534c00097228 req-1943313f-623f-4fc7-8a8e-7ce664416098 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Refreshing instance network info cache due to event network-changed-58268f65-6b08-4cdd-9ae3-b256ed150e60. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ac06907a-4be1-4360-9fcf-534c00097228 req-1943313f-623f-4fc7-8a8e-7ce664416098 service nova] Acquiring lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ac06907a-4be1-4360-9fcf-534c00097228 req-1943313f-623f-4fc7-8a8e-7ce664416098 service nova] Acquired lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG nova.network.neutron [req-ac06907a-4be1-4360-9fcf-534c00097228 req-1943313f-623f-4fc7-8a8e-7ce664416098 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Refreshing network info cache for port 58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:26:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1356134043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1356134043',id=27,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFI/WYqNgdhrW6ev+SXUzc863+su95TT4W3Vt1HMyWURKe/jZziC6ZzGxo7ZQjy5wAZn1VasI3e3uGWKduWt4WYUmvmETmO7289jUPX5hc72NdFOqpXF4ziM1kL0kqT9CQ==',key_name='tempest-keypair-1318766870',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:26:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1bb636c3c71c479d90cf2e170db941e1',ramdisk_id='',reservation_id='r-ik1in1jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1263463439',owner_user_name='tempest-AttachVolumeShelveTestJSON-1263463439-project-member',shelved_at='2023-08-15T16:28:49.373659',shelved_host='user',shelved_image_id='55b05045-695a-40fe-b6d6-f0e655728485'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:28:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867f247fc90437899a13a7451a3249a',uuid=0900e8d0-6e7f-40a3-9016-39851e697d09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converting VIF {"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:64:c5,bridge_name='br-int',has_traffic_filtering=True,id=58268f65-6b08-4cdd-9ae3-b256ed150e60,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58268f65-6b') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG os_vif [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:64:c5,bridge_name='br-int',has_traffic_filtering=True,id=58268f65-6b08-4cdd-9ae3-b256ed150e60,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58268f65-6b') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58268f65-6b, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:51 user nova-compute[72849]: INFO os_vif [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:64:c5,bridge_name='br-int',has_traffic_filtering=True,id=58268f65-6b08-4cdd-9ae3-b256ed150e60,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58268f65-6b')
Aug 15 16:28:51 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Deleting instance files /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09_del
Aug 15 16:28:51 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Deletion of /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09_del complete
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.191s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/disk 1073741824" returned: 0 in 0.056s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:51 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Deleted allocations for instance 0900e8d0-6e7f-40a3-9016-39851e697d09
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG nova.objects.instance [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'numa_topology' on Instance uuid 0900e8d0-6e7f-40a3-9016-39851e697d09 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.219s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:28:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:28:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:28:52 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Cannot resize image /opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:28:52 user nova-compute[72849]: DEBUG nova.objects.instance [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'migration_context' on Instance uuid 98bcb43e-a0d9-41f1-9976-01c9e8084ae6 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:28:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:28:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Ensure instance console log exists: /opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:28:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:52 user nova-compute[72849]: DEBUG nova.network.neutron [req-ac06907a-4be1-4360-9fcf-534c00097228 req-1943313f-623f-4fc7-8a8e-7ce664416098 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Updated VIF entry in instance network info cache for port 58268f65-6b08-4cdd-9ae3-b256ed150e60. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:28:52 user nova-compute[72849]: DEBUG nova.network.neutron [req-ac06907a-4be1-4360-9fcf-534c00097228 req-1943313f-623f-4fc7-8a8e-7ce664416098 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Updating instance_info_cache with network_info: [{"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap58268f65-6b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:28:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ac06907a-4be1-4360-9fcf-534c00097228 req-1943313f-623f-4fc7-8a8e-7ce664416098 service nova] Releasing lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:28:52 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:28:52 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:28:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:52 user nova-compute[72849]: DEBUG nova.network.neutron [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Successfully created port: 2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:28:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1f128129-0d1c-4dc0-bb03-a7b9c470c8ae tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.947s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.network.neutron [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Successfully updated port: 2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "refresh_cache-98bcb43e-a0d9-41f1-9976-01c9e8084ae6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquired lock "refresh_cache-98bcb43e-a0d9-41f1-9976-01c9e8084ae6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.network.neutron [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.network.neutron [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.network.neutron [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Updating instance_info_cache with network_info: [{"id": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "address": "fa:16:3e:ec:02:90", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dccbc88-ff", "ovs_interfaceid": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-4586194a-f0f9-4f88-9521-3121ead8bdea req-967f8dde-60d1-47e6-9e37-edc83900348e service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received event network-changed-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-4586194a-f0f9-4f88-9521-3121ead8bdea req-967f8dde-60d1-47e6-9e37-edc83900348e service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Refreshing instance network info cache due to event network-changed-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4586194a-f0f9-4f88-9521-3121ead8bdea req-967f8dde-60d1-47e6-9e37-edc83900348e service nova] Acquiring lock "refresh_cache-98bcb43e-a0d9-41f1-9976-01c9e8084ae6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Releasing lock "refresh_cache-98bcb43e-a0d9-41f1-9976-01c9e8084ae6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Instance network_info: |[{"id": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "address": "fa:16:3e:ec:02:90", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dccbc88-ff", "ovs_interfaceid": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4586194a-f0f9-4f88-9521-3121ead8bdea req-967f8dde-60d1-47e6-9e37-edc83900348e service nova] Acquired lock "refresh_cache-98bcb43e-a0d9-41f1-9976-01c9e8084ae6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.network.neutron [req-4586194a-f0f9-4f88-9521-3121ead8bdea req-967f8dde-60d1-47e6-9e37-edc83900348e service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Refreshing network info cache for port 2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Start _get_guest_xml network_info=[{"id": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "address": "fa:16:3e:ec:02:90", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dccbc88-ff", "ovs_interfaceid": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:28:53 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:28:53 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-918812091',display_name='tempest-AttachVolumeNegativeTest-server-918812091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-918812091',id=32,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyGLsm6yzY1zNlYqVryoJWRUN1PvWpKrg1furcT1TR3do/V13JeUQnnR5Yks5f5ozG9E8YResqnY1fMBd0IH1a1OE+Q0iKYnxoOrBtBMDe4wN94JzSNL2WOSAjBQ+Ierg==',key_name='tempest-keypair-1464382446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0ddd223976e4b13a3b6a5638846f83a',ramdisk_id='',reservation_id='r-s8dr0bcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-693282259',owner_user_name='tempest-AttachVolumeNegativeTest-693282259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:28:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e99eefba54014b9ea83f1611b02efaad',uuid=98bcb43e-a0d9-41f1-9976-01c9e8084ae6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "address": "fa:16:3e:ec:02:90", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dccbc88-ff", "ovs_interfaceid": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converting VIF {"id": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "address": "fa:16:3e:ec:02:90", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dccbc88-ff", "ovs_interfaceid": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:02:90,bridge_name='br-int',has_traffic_filtering=True,id=2dccbc88-ff38-4ce9-b8e2-e1441cd2d005,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dccbc88-ff') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.objects.instance [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'pci_devices' on Instance uuid 98bcb43e-a0d9-41f1-9976-01c9e8084ae6 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:28:53 user nova-compute[72849]:   <uuid>98bcb43e-a0d9-41f1-9976-01c9e8084ae6</uuid>
Aug 15 16:28:53 user nova-compute[72849]:   <name>instance-00000020</name>
Aug 15 16:28:53 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:28:53 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:28:53 user nova-compute[72849]:   <metadata>
Aug 15 16:28:53 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:28:53 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:28:53 user nova-compute[72849]:       <nova:name>tempest-AttachVolumeNegativeTest-server-918812091</nova:name>
Aug 15 16:28:53 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:28:53</nova:creationTime>
Aug 15 16:28:53 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:28:53 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:28:53 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:28:53 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:28:53 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:28:53 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:28:53 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:28:53 user nova-compute[72849]:       <nova:owner>
Aug 15 16:28:53 user nova-compute[72849]:         <nova:user uuid="e99eefba54014b9ea83f1611b02efaad">tempest-AttachVolumeNegativeTest-693282259-project-member</nova:user>
Aug 15 16:28:53 user nova-compute[72849]:         <nova:project uuid="d0ddd223976e4b13a3b6a5638846f83a">tempest-AttachVolumeNegativeTest-693282259</nova:project>
Aug 15 16:28:53 user nova-compute[72849]:       </nova:owner>
Aug 15 16:28:53 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:28:53 user nova-compute[72849]:       <nova:ports>
Aug 15 16:28:53 user nova-compute[72849]:         <nova:port uuid="2dccbc88-ff38-4ce9-b8e2-e1441cd2d005">
Aug 15 16:28:53 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:28:53 user nova-compute[72849]:         </nova:port>
Aug 15 16:28:53 user nova-compute[72849]:       </nova:ports>
Aug 15 16:28:53 user nova-compute[72849]:     </nova:instance>
Aug 15 16:28:53 user nova-compute[72849]:   </metadata>
Aug 15 16:28:53 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:28:53 user nova-compute[72849]:     <system>
Aug 15 16:28:53 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:28:53 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:28:53 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:28:53 user nova-compute[72849]:       <entry name="serial">98bcb43e-a0d9-41f1-9976-01c9e8084ae6</entry>
Aug 15 16:28:53 user nova-compute[72849]:       <entry name="uuid">98bcb43e-a0d9-41f1-9976-01c9e8084ae6</entry>
Aug 15 16:28:53 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:28:53 user nova-compute[72849]:     </system>
Aug 15 16:28:53 user nova-compute[72849]:   </sysinfo>
Aug 15 16:28:53 user nova-compute[72849]:   <os>
Aug 15 16:28:53 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:28:53 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:28:53 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:28:53 user nova-compute[72849]:   </os>
Aug 15 16:28:53 user nova-compute[72849]:   <features>
Aug 15 16:28:53 user nova-compute[72849]:     <acpi/>
Aug 15 16:28:53 user nova-compute[72849]:     <apic/>
Aug 15 16:28:53 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:28:53 user nova-compute[72849]:   </features>
Aug 15 16:28:53 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:28:53 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:28:53 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:28:53 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:28:53 user nova-compute[72849]:   </clock>
Aug 15 16:28:53 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:28:53 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:28:53 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:28:53 user nova-compute[72849]:   </cpu>
Aug 15 16:28:53 user nova-compute[72849]:   <devices>
Aug 15 16:28:53 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:28:53 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:28:53 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/disk"/>
Aug 15 16:28:53 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:28:53 user nova-compute[72849]:     </disk>
Aug 15 16:28:53 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:28:53 user nova-compute[72849]:       <mac address="fa:16:3e:ec:02:90"/>
Aug 15 16:28:53 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:28:53 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:28:53 user nova-compute[72849]:       <target dev="tap2dccbc88-ff"/>
Aug 15 16:28:53 user nova-compute[72849]:     </interface>
Aug 15 16:28:53 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:28:53 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/console.log" append="off"/>
Aug 15 16:28:53 user nova-compute[72849]:     </serial>
Aug 15 16:28:53 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:28:53 user nova-compute[72849]:     <video>
Aug 15 16:28:53 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:28:53 user nova-compute[72849]:     </video>
Aug 15 16:28:53 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:28:53 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:28:53 user nova-compute[72849]:     </rng>
Aug 15 16:28:53 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:28:53 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:28:53 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:28:53 user nova-compute[72849]:     </memballoon>
Aug 15 16:28:53 user nova-compute[72849]:   </devices>
Aug 15 16:28:53 user nova-compute[72849]: </domain>
Aug 15 16:28:53 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-918812091',display_name='tempest-AttachVolumeNegativeTest-server-918812091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-918812091',id=32,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyGLsm6yzY1zNlYqVryoJWRUN1PvWpKrg1furcT1TR3do/V13JeUQnnR5Yks5f5ozG9E8YResqnY1fMBd0IH1a1OE+Q0iKYnxoOrBtBMDe4wN94JzSNL2WOSAjBQ+Ierg==',key_name='tempest-keypair-1464382446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0ddd223976e4b13a3b6a5638846f83a',ramdisk_id='',reservation_id='r-s8dr0bcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-693282259',owner_user_name='tempest-AttachVolumeNegativeTest-693282259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:28:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e99eefba54014b9ea83f1611b02efaad',uuid=98bcb43e-a0d9-41f1-9976-01c9e8084ae6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "address": "fa:16:3e:ec:02:90", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dccbc88-ff", "ovs_interfaceid": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converting VIF {"id": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "address": "fa:16:3e:ec:02:90", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dccbc88-ff", "ovs_interfaceid": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:02:90,bridge_name='br-int',has_traffic_filtering=True,id=2dccbc88-ff38-4ce9-b8e2-e1441cd2d005,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dccbc88-ff') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG os_vif [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:02:90,bridge_name='br-int',has_traffic_filtering=True,id=2dccbc88-ff38-4ce9-b8e2-e1441cd2d005,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dccbc88-ff') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dccbc88-ff, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2dccbc88-ff, col_values=(('external_ids', {'iface-id': '2dccbc88-ff38-4ce9-b8e2-e1441cd2d005', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:02:90', 'vm-uuid': '98bcb43e-a0d9-41f1-9976-01c9e8084ae6'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:28:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:53 user nova-compute[72849]: INFO os_vif [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:02:90,bridge_name='br-int',has_traffic_filtering=True,id=2dccbc88-ff38-4ce9-b8e2-e1441cd2d005,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dccbc88-ff')
Aug 15 16:28:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:28:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] No VIF found with MAC fa:16:3e:ec:02:90, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:28:54 user nova-compute[72849]: DEBUG nova.network.neutron [req-4586194a-f0f9-4f88-9521-3121ead8bdea req-967f8dde-60d1-47e6-9e37-edc83900348e service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Updated VIF entry in instance network info cache for port 2dccbc88-ff38-4ce9-b8e2-e1441cd2d005. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:28:54 user nova-compute[72849]: DEBUG nova.network.neutron [req-4586194a-f0f9-4f88-9521-3121ead8bdea req-967f8dde-60d1-47e6-9e37-edc83900348e service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Updating instance_info_cache with network_info: [{"id": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "address": "fa:16:3e:ec:02:90", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dccbc88-ff", "ovs_interfaceid": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:28:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4586194a-f0f9-4f88-9521-3121ead8bdea req-967f8dde-60d1-47e6-9e37-edc83900348e service nova] Releasing lock "refresh_cache-98bcb43e-a0d9-41f1-9976-01c9e8084ae6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:28:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-b21feae5-04fa-46e0-9d4b-2a0b6154c490 req-e5850e57-b2d2-4bba-a3cf-6fe59b0ff24d service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received event network-vif-plugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b21feae5-04fa-46e0-9d4b-2a0b6154c490 req-e5850e57-b2d2-4bba-a3cf-6fe59b0ff24d service nova] Acquiring lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b21feae5-04fa-46e0-9d4b-2a0b6154c490 req-e5850e57-b2d2-4bba-a3cf-6fe59b0ff24d service nova] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b21feae5-04fa-46e0-9d4b-2a0b6154c490 req-e5850e57-b2d2-4bba-a3cf-6fe59b0ff24d service nova] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-b21feae5-04fa-46e0-9d4b-2a0b6154c490 req-e5850e57-b2d2-4bba-a3cf-6fe59b0ff24d service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] No waiting events found dispatching network-vif-plugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:28:55 user nova-compute[72849]: WARNING nova.compute.manager [req-b21feae5-04fa-46e0-9d4b-2a0b6154c490 req-e5850e57-b2d2-4bba-a3cf-6fe59b0ff24d service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received unexpected event network-vif-plugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 for instance with vm_state building and task_state spawning.
Aug 15 16:28:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:57 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116937.7587655, 98bcb43e-a0d9-41f1-9976-01c9e8084ae6 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:28:57 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] VM Resumed (Lifecycle Event)
Aug 15 16:28:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:28:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:28:57 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Instance spawned successfully.
Aug 15 16:28:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:28:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:28:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:28:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:28:57 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:28:57 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116937.760162, 98bcb43e-a0d9-41f1-9976-01c9e8084ae6 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:28:57 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] VM Started (Lifecycle Event)
Aug 15 16:28:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:28:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:28:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-1a4fa921-f7b2-49de-b796-d4f0561f8424 req-55f020af-0c02-4ce2-b291-9ee3c11d2661 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received event network-vif-plugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:28:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1a4fa921-f7b2-49de-b796-d4f0561f8424 req-55f020af-0c02-4ce2-b291-9ee3c11d2661 service nova] Acquiring lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:28:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1a4fa921-f7b2-49de-b796-d4f0561f8424 req-55f020af-0c02-4ce2-b291-9ee3c11d2661 service nova] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:28:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1a4fa921-f7b2-49de-b796-d4f0561f8424 req-55f020af-0c02-4ce2-b291-9ee3c11d2661 service nova] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-1a4fa921-f7b2-49de-b796-d4f0561f8424 req-55f020af-0c02-4ce2-b291-9ee3c11d2661 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] No waiting events found dispatching network-vif-plugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:28:57 user nova-compute[72849]: WARNING nova.compute.manager [req-1a4fa921-f7b2-49de-b796-d4f0561f8424 req-55f020af-0c02-4ce2-b291-9ee3c11d2661 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received unexpected event network-vif-plugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 for instance with vm_state building and task_state spawning.
Aug 15 16:28:57 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:28:57 user nova-compute[72849]: INFO nova.compute.manager [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Took 6.63 seconds to spawn the instance on the hypervisor.
Aug 15 16:28:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:28:57 user nova-compute[72849]: INFO nova.compute.manager [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Took 7.52 seconds to build instance.
Aug 15 16:28:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5bca5414-0f8b-4f15-b76f-f4981c74957b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.618s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:28:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:28:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:00 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692116925.4207609, 0900e8d0-6e7f-40a3-9016-39851e697d09 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:29:00 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] VM Stopped (Lifecycle Event)
Aug 15 16:29:00 user nova-compute[72849]: DEBUG nova.compute.manager [None req-97b2e1aa-d091-4806-9656-2f589ba2de47 None None] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:29:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:29:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:11 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:29:11 user nova-compute[72849]: INFO nova.compute.claims [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Claim successful on node user
Aug 15 16:29:12 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:29:12 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:29:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG nova.policy [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6bc0fd1358a42debf05e9bc43b8e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fff6abd55f4552b56b7f80f3b19990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:29:12 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Creating image(s)
Aug 15 16:29:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "/opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "/opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "/opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.177s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk 1073741824" returned: 0 in 0.057s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Successfully created port: b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.223s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Cannot resize image /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG nova.objects.instance [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'migration_context' on Instance uuid b15c5692-8c0c-4bf0-a79f-b7813e71de9a {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Ensure instance console log exists: /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Successfully updated port: b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquired lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-fca01652-86a4-4cbd-9887-ab5399769622 req-9fa82d6f-1b8d-41c1-bf09-162433b9de55 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received event network-changed-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-fca01652-86a4-4cbd-9887-ab5399769622 req-9fa82d6f-1b8d-41c1-bf09-162433b9de55 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Refreshing instance network info cache due to event network-changed-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fca01652-86a4-4cbd-9887-ab5399769622 req-9fa82d6f-1b8d-41c1-bf09-162433b9de55 service nova] Acquiring lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:29:13 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Updating instance_info_cache with network_info: [{"id": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "address": "fa:16:3e:8a:41:62", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183f8f-93", "ovs_interfaceid": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Releasing lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Instance network_info: |[{"id": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "address": "fa:16:3e:8a:41:62", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183f8f-93", "ovs_interfaceid": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fca01652-86a4-4cbd-9887-ab5399769622 req-9fa82d6f-1b8d-41c1-bf09-162433b9de55 service nova] Acquired lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.network.neutron [req-fca01652-86a4-4cbd-9887-ab5399769622 req-9fa82d6f-1b8d-41c1-bf09-162433b9de55 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Refreshing network info cache for port b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Start _get_guest_xml network_info=[{"id": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "address": "fa:16:3e:8a:41:62", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183f8f-93", "ovs_interfaceid": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:29:14 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:29:14 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1766183368',display_name='tempest-ServerRescueNegativeTestJSON-server-1766183368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1766183368',id=33,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZDWB8vYJ27BLEDjq1jEjY2KBJTj8cjBkEkfTH18cdJZ7J3D5uI+izIwW8NIAiqaP6OwefzK28im3ocei5k8arru3mLNz50MNQwsuj3glrLSKYBFwn1qRB4crV/gOKF0w==',key_name='tempest-keypair-357165589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63fff6abd55f4552b56b7f80f3b19990',ramdisk_id='',reservation_id='r-7uw01kyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-817230683',owner_user_name='tempest-ServerRescueNegativeTestJSON-817230683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:29:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6bc0fd1358a42debf05e9bc43b8e329',uuid=b15c5692-8c0c-4bf0-a79f-b7813e71de9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "address": "fa:16:3e:8a:41:62", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183f8f-93", "ovs_interfaceid": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converting VIF {"id": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "address": "fa:16:3e:8a:41:62", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183f8f-93", "ovs_interfaceid": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:41:62,bridge_name='br-int',has_traffic_filtering=True,id=b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0183f8f-93') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.objects.instance [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'pci_devices' on Instance uuid b15c5692-8c0c-4bf0-a79f-b7813e71de9a {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:29:14 user nova-compute[72849]:   <uuid>b15c5692-8c0c-4bf0-a79f-b7813e71de9a</uuid>
Aug 15 16:29:14 user nova-compute[72849]:   <name>instance-00000021</name>
Aug 15 16:29:14 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:29:14 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:29:14 user nova-compute[72849]:   <metadata>
Aug 15 16:29:14 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:29:14 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:29:14 user nova-compute[72849]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1766183368</nova:name>
Aug 15 16:29:14 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:29:14</nova:creationTime>
Aug 15 16:29:14 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:29:14 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:29:14 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:29:14 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:29:14 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:29:14 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:29:14 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:29:14 user nova-compute[72849]:       <nova:owner>
Aug 15 16:29:14 user nova-compute[72849]:         <nova:user uuid="a6bc0fd1358a42debf05e9bc43b8e329">tempest-ServerRescueNegativeTestJSON-817230683-project-member</nova:user>
Aug 15 16:29:14 user nova-compute[72849]:         <nova:project uuid="63fff6abd55f4552b56b7f80f3b19990">tempest-ServerRescueNegativeTestJSON-817230683</nova:project>
Aug 15 16:29:14 user nova-compute[72849]:       </nova:owner>
Aug 15 16:29:14 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:29:14 user nova-compute[72849]:       <nova:ports>
Aug 15 16:29:14 user nova-compute[72849]:         <nova:port uuid="b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9">
Aug 15 16:29:14 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 16:29:14 user nova-compute[72849]:         </nova:port>
Aug 15 16:29:14 user nova-compute[72849]:       </nova:ports>
Aug 15 16:29:14 user nova-compute[72849]:     </nova:instance>
Aug 15 16:29:14 user nova-compute[72849]:   </metadata>
Aug 15 16:29:14 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:29:14 user nova-compute[72849]:     <system>
Aug 15 16:29:14 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:29:14 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:29:14 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:29:14 user nova-compute[72849]:       <entry name="serial">b15c5692-8c0c-4bf0-a79f-b7813e71de9a</entry>
Aug 15 16:29:14 user nova-compute[72849]:       <entry name="uuid">b15c5692-8c0c-4bf0-a79f-b7813e71de9a</entry>
Aug 15 16:29:14 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:29:14 user nova-compute[72849]:     </system>
Aug 15 16:29:14 user nova-compute[72849]:   </sysinfo>
Aug 15 16:29:14 user nova-compute[72849]:   <os>
Aug 15 16:29:14 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:29:14 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:29:14 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:29:14 user nova-compute[72849]:   </os>
Aug 15 16:29:14 user nova-compute[72849]:   <features>
Aug 15 16:29:14 user nova-compute[72849]:     <acpi/>
Aug 15 16:29:14 user nova-compute[72849]:     <apic/>
Aug 15 16:29:14 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:29:14 user nova-compute[72849]:   </features>
Aug 15 16:29:14 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:29:14 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:29:14 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:29:14 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:29:14 user nova-compute[72849]:   </clock>
Aug 15 16:29:14 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:29:14 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:29:14 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:29:14 user nova-compute[72849]:   </cpu>
Aug 15 16:29:14 user nova-compute[72849]:   <devices>
Aug 15 16:29:14 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:29:14 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:29:14 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk"/>
Aug 15 16:29:14 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:29:14 user nova-compute[72849]:     </disk>
Aug 15 16:29:14 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:29:14 user nova-compute[72849]:       <mac address="fa:16:3e:8a:41:62"/>
Aug 15 16:29:14 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:29:14 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:29:14 user nova-compute[72849]:       <target dev="tapb0183f8f-93"/>
Aug 15 16:29:14 user nova-compute[72849]:     </interface>
Aug 15 16:29:14 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:29:14 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/console.log" append="off"/>
Aug 15 16:29:14 user nova-compute[72849]:     </serial>
Aug 15 16:29:14 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:29:14 user nova-compute[72849]:     <video>
Aug 15 16:29:14 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:29:14 user nova-compute[72849]:     </video>
Aug 15 16:29:14 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:29:14 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:29:14 user nova-compute[72849]:     </rng>
Aug 15 16:29:14 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:29:14 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:29:14 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:29:14 user nova-compute[72849]:     </memballoon>
Aug 15 16:29:14 user nova-compute[72849]:   </devices>
Aug 15 16:29:14 user nova-compute[72849]: </domain>
Aug 15 16:29:14 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1766183368',display_name='tempest-ServerRescueNegativeTestJSON-server-1766183368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1766183368',id=33,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZDWB8vYJ27BLEDjq1jEjY2KBJTj8cjBkEkfTH18cdJZ7J3D5uI+izIwW8NIAiqaP6OwefzK28im3ocei5k8arru3mLNz50MNQwsuj3glrLSKYBFwn1qRB4crV/gOKF0w==',key_name='tempest-keypair-357165589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63fff6abd55f4552b56b7f80f3b19990',ramdisk_id='',reservation_id='r-7uw01kyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-817230683',owner_user_name='tempest-ServerRescueNegativeTestJSON-817230683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:29:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6bc0fd1358a42debf05e9bc43b8e329',uuid=b15c5692-8c0c-4bf0-a79f-b7813e71de9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "address": "fa:16:3e:8a:41:62", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183f8f-93", "ovs_interfaceid": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converting VIF {"id": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "address": "fa:16:3e:8a:41:62", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183f8f-93", "ovs_interfaceid": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:41:62,bridge_name='br-int',has_traffic_filtering=True,id=b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0183f8f-93') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG os_vif [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:41:62,bridge_name='br-int',has_traffic_filtering=True,id=b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0183f8f-93') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0183f8f-93, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb0183f8f-93, col_values=(('external_ids', {'iface-id': 'b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:41:62', 'vm-uuid': 'b15c5692-8c0c-4bf0-a79f-b7813e71de9a'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:14 user nova-compute[72849]: INFO os_vif [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:41:62,bridge_name='br-int',has_traffic_filtering=True,id=b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0183f8f-93')
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] No VIF found with MAC fa:16:3e:8a:41:62, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.network.neutron [req-fca01652-86a4-4cbd-9887-ab5399769622 req-9fa82d6f-1b8d-41c1-bf09-162433b9de55 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Updated VIF entry in instance network info cache for port b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG nova.network.neutron [req-fca01652-86a4-4cbd-9887-ab5399769622 req-9fa82d6f-1b8d-41c1-bf09-162433b9de55 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Updating instance_info_cache with network_info: [{"id": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "address": "fa:16:3e:8a:41:62", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183f8f-93", "ovs_interfaceid": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:29:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fca01652-86a4-4cbd-9887-ab5399769622 req-9fa82d6f-1b8d-41c1-bf09-162433b9de55 service nova] Releasing lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:29:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-bbdd7f2b-f30a-4adc-aa5c-da6b9d27202b req-beb060d5-33d6-4d1f-af11-338bd9b337f2 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received event network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:29:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-bbdd7f2b-f30a-4adc-aa5c-da6b9d27202b req-beb060d5-33d6-4d1f-af11-338bd9b337f2 service nova] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-bbdd7f2b-f30a-4adc-aa5c-da6b9d27202b req-beb060d5-33d6-4d1f-af11-338bd9b337f2 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-bbdd7f2b-f30a-4adc-aa5c-da6b9d27202b req-beb060d5-33d6-4d1f-af11-338bd9b337f2 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-bbdd7f2b-f30a-4adc-aa5c-da6b9d27202b req-beb060d5-33d6-4d1f-af11-338bd9b337f2 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] No waiting events found dispatching network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:29:15 user nova-compute[72849]: WARNING nova.compute.manager [req-bbdd7f2b-f30a-4adc-aa5c-da6b9d27202b req-beb060d5-33d6-4d1f-af11-338bd9b337f2 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received unexpected event network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 for instance with vm_state building and task_state spawning.
Aug 15 16:29:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:17 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116957.8314826, b15c5692-8c0c-4bf0-a79f-b7813e71de9a => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:29:17 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] VM Resumed (Lifecycle Event)
Aug 15 16:29:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:29:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:29:17 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Instance spawned successfully.
Aug 15 16:29:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:29:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:29:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:29:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:29:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:29:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:29:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:29:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:29:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:29:17 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:29:17 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116957.8347456, b15c5692-8c0c-4bf0-a79f-b7813e71de9a => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:29:17 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] VM Started (Lifecycle Event)
Aug 15 16:29:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:29:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:29:17 user nova-compute[72849]: INFO nova.compute.manager [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Took 5.58 seconds to spawn the instance on the hypervisor.
Aug 15 16:29:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:29:17 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:29:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-4d3c06bd-b4d5-4025-9ebb-d47ac0460d44 req-e62d6d8b-d27c-4ec6-a458-4fc7b93312b7 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received event network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:29:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4d3c06bd-b4d5-4025-9ebb-d47ac0460d44 req-e62d6d8b-d27c-4ec6-a458-4fc7b93312b7 service nova] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4d3c06bd-b4d5-4025-9ebb-d47ac0460d44 req-e62d6d8b-d27c-4ec6-a458-4fc7b93312b7 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4d3c06bd-b4d5-4025-9ebb-d47ac0460d44 req-e62d6d8b-d27c-4ec6-a458-4fc7b93312b7 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-4d3c06bd-b4d5-4025-9ebb-d47ac0460d44 req-e62d6d8b-d27c-4ec6-a458-4fc7b93312b7 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] No waiting events found dispatching network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:29:17 user nova-compute[72849]: WARNING nova.compute.manager [req-4d3c06bd-b4d5-4025-9ebb-d47ac0460d44 req-e62d6d8b-d27c-4ec6-a458-4fc7b93312b7 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received unexpected event network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 for instance with vm_state building and task_state spawning.
Aug 15 16:29:18 user nova-compute[72849]: INFO nova.compute.manager [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Took 6.37 seconds to build instance.
Aug 15 16:29:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a8146d5c-ed4d-47e0-9d4e-21949054f0ee tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.481s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:19 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'flavor' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:29:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "refresh_cache-f1da55ae-5150-476c-a229-f26ddfee7e9e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:29:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquired lock "refresh_cache-f1da55ae-5150-476c-a229-f26ddfee7e9e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:29:19 user nova-compute[72849]: DEBUG nova.network.neutron [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:29:19 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'info_cache' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:29:19 user nova-compute[72849]: DEBUG nova.network.neutron [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Updating instance_info_cache with network_info: [{"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:29:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Releasing lock "refresh_cache-f1da55ae-5150-476c-a229-f26ddfee7e9e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:29:20 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Instance destroyed successfully.
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'resources' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:25:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1450170250',display_name='tempest-AttachVolumeTestJSON-server-1450170250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1450170250',id=25,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbHBCrfJdjyvvfHVCDAyVY3pxTMcpwjUaUui51i7UWK+4o1OUXo/LN4XWDmXW8h8aEFw/JKcC9Dwq6+Cbh0MQQ2dswuJTGFHVpH2lAWXJOXrjs0Yd41UjVwgxvzDZT+WQ==',key_name='tempest-keypair-1527966259',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='607d6d3506de49549888f16d06829c89',ramdisk_id='',reservation_id='r-vfgrreq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1114163063',owner_user_name='tempest-AttachVolumeTestJSON-1114163063-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abdcfedce2124d86a0df67571fdfcde9',uuid=f1da55ae-5150-476c-a229-f26ddfee7e9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converting VIF {"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_vif [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71bc55dc-c0, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:20 user nova-compute[72849]: INFO os_vif [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0')
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIrUsVkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:29:20 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf0857a-f9b1-4bb8-9d16-1c42854a327b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b89cc2-026d-484e-88c7-c8ee45250094]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:29:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:29:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc385fb5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f408bf3d-b068-40fe-a477-634a09cb257a]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2abe233-17d3-4220-a2fa-37355b6dedb6]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b720bc2a-a47a-4606-bac8-7802e695cc07]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9480be7e-586a-4229-bf56-05600b2e95ae]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b3b338-564b-4b94-8d63-e39757db1299]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c31e9e4-390f-4f42-98fe-3c927032b16a]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f, portal: 172.16.0.220,3260]
Aug 15 16:29:20 user nova-compute[72849]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f, portal: 172.16.0.220,3260] successful.
Aug 15 16:29:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7922e0a5-8b16-47a4-a0f6-6dfe855deb0a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] <== disconnect_volume: return (352ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Start _get_guest_xml network_info=[{"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIrUsVkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f1da55ae-5150-476c-a229-f26ddfee7e9e', 'attached_at': '', 'detached_at': '', 'volume_id': '72ab3753-6199-4221-ad21-89c5e58a022f', 'serial': '72ab3753-6199-4221-ad21-89c5e58a022f'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'ea78ae01-6579-4784-b260-e879b09c323d', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'numa_topology' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:29:20 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:29:20 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'vcpu_model' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIrUsVkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:29:20 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:29:20 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:29:20 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[410dfa76-65dd-49b7-90c7-a696b5f8ee68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:29:20 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ec93e4-f9af-48bb-9df2-50ccd5e7ff1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f] added
Aug 15 16:29:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51b3eb8-36fd-48b5-949f-28781eff6377]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d360ff47-26d1-41c7-9c5c-85f0548c3c56]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QIrUsVkZ {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QIrUsVkZ" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[845c5e40-af57-4986-822a-3e8c19995f26]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QIrUsVkZ'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[73125c87-5df5-4f9a-8141-f0377f1aa1fe]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba71014-13c8-40d9-a315-e36ffb6a1ea2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:29:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:29:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b9082d-b468-4e92-a467-de3e03cf4339]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f, portal: 172.16.0.220,3260]
Aug 15 16:29:20 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f, portal: 172.16.0.220,3260] successful.
Aug 15 16:29:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd8b263-eac6-4a8b-bc6a-f21a6e8d7a14]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a29b76-0e27-46ce-a325-f178b4a95932]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:29:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:29:20 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:29:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6b5a7e-a413-4521-bf11-97270ef6d9d7]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: None {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:29:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:29:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIrUsVkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:29:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:29:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23862663831353238', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:29:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862663831353238', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:29:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:25:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1450170250',display_name='tempest-AttachVolumeTestJSON-server-1450170250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1450170250',id=25,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbHBCrfJdjyvvfHVCDAyVY3pxTMcpwjUaUui51i7UWK+4o1OUXo/LN4XWDmXW8h8aEFw/JKcC9Dwq6+Cbh0MQQ2dswuJTGFHVpH2lAWXJOXrjs0Yd41UjVwgxvzDZT+WQ==',key_name='tempest-keypair-1527966259',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='607d6d3506de49549888f16d06829c89',ramdisk_id='',reservation_id='r-vfgrreq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1114163063',owner_user_name='tempest-AttachVolumeTestJSON-1114163063-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abdcfedce2124d86a0df67571fdfcde9',uuid=f1da55ae-5150-476c-a229-f26ddfee7e9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:29:21 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converting VIF {"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:29:21 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:29:21 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'pci_devices' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:29:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:29:21 user nova-compute[72849]:   <uuid>f1da55ae-5150-476c-a229-f26ddfee7e9e</uuid>
Aug 15 16:29:21 user nova-compute[72849]:   <name>instance-00000019</name>
Aug 15 16:29:21 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:29:21 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:29:21 user nova-compute[72849]:   <metadata>
Aug 15 16:29:21 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:29:21 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:29:21 user nova-compute[72849]:       <nova:name>tempest-AttachVolumeTestJSON-server-1450170250</nova:name>
Aug 15 16:29:21 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:29:20</nova:creationTime>
Aug 15 16:29:21 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:29:21 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:29:21 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:29:21 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:29:21 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:29:21 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:29:21 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:29:21 user nova-compute[72849]:       <nova:owner>
Aug 15 16:29:21 user nova-compute[72849]:         <nova:user uuid="abdcfedce2124d86a0df67571fdfcde9">tempest-AttachVolumeTestJSON-1114163063-project-member</nova:user>
Aug 15 16:29:21 user nova-compute[72849]:         <nova:project uuid="607d6d3506de49549888f16d06829c89">tempest-AttachVolumeTestJSON-1114163063</nova:project>
Aug 15 16:29:21 user nova-compute[72849]:       </nova:owner>
Aug 15 16:29:21 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:29:21 user nova-compute[72849]:       <nova:ports>
Aug 15 16:29:21 user nova-compute[72849]:         <nova:port uuid="71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba">
Aug 15 16:29:21 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 16:29:21 user nova-compute[72849]:         </nova:port>
Aug 15 16:29:21 user nova-compute[72849]:       </nova:ports>
Aug 15 16:29:21 user nova-compute[72849]:     </nova:instance>
Aug 15 16:29:21 user nova-compute[72849]:   </metadata>
Aug 15 16:29:21 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:29:21 user nova-compute[72849]:     <system>
Aug 15 16:29:21 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:29:21 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:29:21 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:29:21 user nova-compute[72849]:       <entry name="serial">f1da55ae-5150-476c-a229-f26ddfee7e9e</entry>
Aug 15 16:29:21 user nova-compute[72849]:       <entry name="uuid">f1da55ae-5150-476c-a229-f26ddfee7e9e</entry>
Aug 15 16:29:21 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:29:21 user nova-compute[72849]:     </system>
Aug 15 16:29:21 user nova-compute[72849]:   </sysinfo>
Aug 15 16:29:21 user nova-compute[72849]:   <os>
Aug 15 16:29:21 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:29:21 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:29:21 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:29:21 user nova-compute[72849]:   </os>
Aug 15 16:29:21 user nova-compute[72849]:   <features>
Aug 15 16:29:21 user nova-compute[72849]:     <acpi/>
Aug 15 16:29:21 user nova-compute[72849]:     <apic/>
Aug 15 16:29:21 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:29:21 user nova-compute[72849]:   </features>
Aug 15 16:29:21 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:29:21 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:29:21 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:29:21 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:29:21 user nova-compute[72849]:   </clock>
Aug 15 16:29:21 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:29:21 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:29:21 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:29:21 user nova-compute[72849]:   </cpu>
Aug 15 16:29:21 user nova-compute[72849]:   <devices>
Aug 15 16:29:21 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:29:21 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:29:21 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk"/>
Aug 15 16:29:21 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:29:21 user nova-compute[72849]:     </disk>
Aug 15 16:29:21 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:29:21 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:29:21 user nova-compute[72849]:       <source dev="/dev/sdb"/>
Aug 15 16:29:21 user nova-compute[72849]:       <target dev="vdb" bus="virtio"/>
Aug 15 16:29:21 user nova-compute[72849]:       <serial>72ab3753-6199-4221-ad21-89c5e58a022f</serial>
Aug 15 16:29:21 user nova-compute[72849]:     </disk>
Aug 15 16:29:21 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:29:21 user nova-compute[72849]:       <mac address="fa:16:3e:62:d6:3e"/>
Aug 15 16:29:21 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:29:21 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:29:21 user nova-compute[72849]:       <target dev="tap71bc55dc-c0"/>
Aug 15 16:29:21 user nova-compute[72849]:     </interface>
Aug 15 16:29:21 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:29:21 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/console.log" append="off"/>
Aug 15 16:29:21 user nova-compute[72849]:     </serial>
Aug 15 16:29:21 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:29:21 user nova-compute[72849]:     <video>
Aug 15 16:29:21 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:29:21 user nova-compute[72849]:     </video>
Aug 15 16:29:21 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:29:21 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:29:21 user nova-compute[72849]:     </rng>
Aug 15 16:29:21 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:29:21 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:29:21 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:29:21 user nova-compute[72849]:     </memballoon>
Aug 15 16:29:21 user nova-compute[72849]:   </devices>
Aug 15 16:29:21 user nova-compute[72849]: </domain>
Aug 15 16:29:21 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:29:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'trusted_certs' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.200s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Cannot resize image /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'migration_context' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:25:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1450170250',display_name='tempest-AttachVolumeTestJSON-server-1450170250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1450170250',id=25,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbHBCrfJdjyvvfHVCDAyVY3pxTMcpwjUaUui51i7UWK+4o1OUXo/LN4XWDmXW8h8aEFw/JKcC9Dwq6+Cbh0MQQ2dswuJTGFHVpH2lAWXJOXrjs0Yd41UjVwgxvzDZT+WQ==',key_name='tempest-keypair-1527966259',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='607d6d3506de49549888f16d06829c89',ramdisk_id='',reservation_id='r-vfgrreq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1114163063',owner_user_name='tempest-AttachVolumeTestJSON-1114163063-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abdcfedce2124d86a0df67571fdfcde9',uuid=f1da55ae-5150-476c-a229-f26ddfee7e9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converting VIF {"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG os_vif [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71bc55dc-c0, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71bc55dc-c0, col_values=(('external_ids', {'iface-id': '71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:d6:3e', 'vm-uuid': 'f1da55ae-5150-476c-a229-f26ddfee7e9e'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:29:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:22 user nova-compute[72849]: INFO os_vif [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0')
Aug 15 16:29:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-3d2e2965-e18a-4a7e-a541-0cf008ca3bbe req-290102bd-028f-470f-a6c7-89ea929fc6a4 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received event network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:29:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3d2e2965-e18a-4a7e-a541-0cf008ca3bbe req-290102bd-028f-470f-a6c7-89ea929fc6a4 service nova] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3d2e2965-e18a-4a7e-a541-0cf008ca3bbe req-290102bd-028f-470f-a6c7-89ea929fc6a4 service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3d2e2965-e18a-4a7e-a541-0cf008ca3bbe req-290102bd-028f-470f-a6c7-89ea929fc6a4 service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-3d2e2965-e18a-4a7e-a541-0cf008ca3bbe req-290102bd-028f-470f-a6c7-89ea929fc6a4 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] No waiting events found dispatching network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:29:24 user nova-compute[72849]: WARNING nova.compute.manager [req-3d2e2965-e18a-4a7e-a541-0cf008ca3bbe req-290102bd-028f-470f-a6c7-89ea929fc6a4 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received unexpected event network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba for instance with vm_state stopped and task_state powering-on.
Aug 15 16:29:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:25 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:29:26 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116966.5099144, f1da55ae-5150-476c-a229-f26ddfee7e9e => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:29:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] VM Resumed (Lifecycle Event)
Aug 15 16:29:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:29:26 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Instance rebooted successfully.
Aug 15 16:29:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ff8d9b0c-a8d4-4aeb-816d-dbefdb843777 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:29:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-10174ff5-1c2d-451d-a23f-647d8cad306a req-fb8982fb-44ab-4c14-953a-d70cdc1e2d6f service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received event network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:29:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-10174ff5-1c2d-451d-a23f-647d8cad306a req-fb8982fb-44ab-4c14-953a-d70cdc1e2d6f service nova] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-10174ff5-1c2d-451d-a23f-647d8cad306a req-fb8982fb-44ab-4c14-953a-d70cdc1e2d6f service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-10174ff5-1c2d-451d-a23f-647d8cad306a req-fb8982fb-44ab-4c14-953a-d70cdc1e2d6f service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-10174ff5-1c2d-451d-a23f-647d8cad306a req-fb8982fb-44ab-4c14-953a-d70cdc1e2d6f service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] No waiting events found dispatching network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:29:26 user nova-compute[72849]: WARNING nova.compute.manager [req-10174ff5-1c2d-451d-a23f-647d8cad306a req-fb8982fb-44ab-4c14-953a-d70cdc1e2d6f service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received unexpected event network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba for instance with vm_state stopped and task_state powering-on.
Aug 15 16:29:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:29:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:29:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 16:29:26 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116966.5210814, f1da55ae-5150-476c-a229-f26ddfee7e9e => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:29:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] VM Started (Lifecycle Event)
Aug 15 16:29:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:29:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:29:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 16:29:27 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:29:27 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:29:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-a3221960-e5ff-4185-a5dd-09f2cd293cb1" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:29:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-a3221960-e5ff-4185-a5dd-09f2cd293cb1" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:29:27 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:29:27 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Updating instance_info_cache with network_info: [{"id": "a1bba244-632e-4030-963f-55b89cbb736d", "address": "fa:16:3e:a8:49:ac", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1bba244-63", "ovs_interfaceid": "a1bba244-632e-4030-963f-55b89cbb736d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:29:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-a3221960-e5ff-4185-a5dd-09f2cd293cb1" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:29:27 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:29:28 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:29:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:30 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:29:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:29:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:31 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:29:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:31 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:29:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:29:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:29:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:29:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:29:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:29:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Acquiring lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:29:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:36 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:29:36 user nova-compute[72849]: INFO nova.compute.claims [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Claim successful on node user
Aug 15 16:29:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:37 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:29:37 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=6605MB free_disk=25.048789978027344GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.019s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.327s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.network.neutron [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:29:37 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc521d87-09aa-44ba-a87c-1cd5517b3707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 46f0aa43-e313-4aff-bacc-aa5290193b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance a3221960-e5ff-4185-a5dd-09f2cd293cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance d51623f1-6613-41d6-abcb-9e4e626a97af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f1da55ae-5150-476c-a229-f26ddfee7e9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 15aa3de5-baee-4d40-8610-1bd08249c837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance ea9d5a00-42db-41e4-bb81-b3875e84f16c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 82f61128-3af4-4f82-ac4c-8ee746b5a829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 98358bbf-c7c1-4868-81ee-77bd229133fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 306a1d17-459d-42cb-b575-fceae948fa79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 98bcb43e-a0d9-41f1-9976-01c9e8084ae6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b15c5692-8c0c-4bf0-a79f-b7813e71de9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 966c2c1f-fa7a-4cea-a007-254562c6fc3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:29:37 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Creating image(s)
Aug 15 16:29:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Acquiring lock "/opt/stack/data/nova/instances/966c2c1f-fa7a-4cea-a007-254562c6fc3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lock "/opt/stack/data/nova/instances/966c2c1f-fa7a-4cea-a007-254562c6fc3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lock "/opt/stack/data/nova/instances/966c2c1f-fa7a-4cea-a007-254562c6fc3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG nova.policy [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8087ed1f734c494ca72ddc378d418d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c72094710f46ecad01481a58dd05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.190s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.212s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/966c2c1f-fa7a-4cea-a007-254562c6fc3b/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/966c2c1f-fa7a-4cea-a007-254562c6fc3b/disk 1073741824" returned: 0 in 0.057s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.885s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.202s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Checking if we can resize image /opt/stack/data/nova/instances/966c2c1f-fa7a-4cea-a007-254562c6fc3b/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966c2c1f-fa7a-4cea-a007-254562c6fc3b/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG nova.network.neutron [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Successfully created port: 6a067af9-827f-49c1-9a52-abed7efff8a2 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966c2c1f-fa7a-4cea-a007-254562c6fc3b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Cannot resize image /opt/stack/data/nova/instances/966c2c1f-fa7a-4cea-a007-254562c6fc3b/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lazy-loading 'migration_context' on Instance uuid 966c2c1f-fa7a-4cea-a007-254562c6fc3b {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Ensure instance console log exists: /opt/stack/data/nova/instances/966c2c1f-fa7a-4cea-a007-254562c6fc3b/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.network.neutron [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Successfully updated port: 6a067af9-827f-49c1-9a52-abed7efff8a2 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Acquiring lock "refresh_cache-966c2c1f-fa7a-4cea-a007-254562c6fc3b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Acquired lock "refresh_cache-966c2c1f-fa7a-4cea-a007-254562c6fc3b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.network.neutron [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-80f6d479-48ec-4fcf-83da-21f47884fd34 req-f8f0627f-ee3e-4c20-b354-19512fab0729 service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Received event network-changed-6a067af9-827f-49c1-9a52-abed7efff8a2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-80f6d479-48ec-4fcf-83da-21f47884fd34 req-f8f0627f-ee3e-4c20-b354-19512fab0729 service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Refreshing instance network info cache due to event network-changed-6a067af9-827f-49c1-9a52-abed7efff8a2. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-80f6d479-48ec-4fcf-83da-21f47884fd34 req-f8f0627f-ee3e-4c20-b354-19512fab0729 service nova] Acquiring lock "refresh_cache-966c2c1f-fa7a-4cea-a007-254562c6fc3b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.network.neutron [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.network.neutron [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Updating instance_info_cache with network_info: [{"id": "6a067af9-827f-49c1-9a52-abed7efff8a2", "address": "fa:16:3e:96:7a:68", "network": {"id": "c3c65f7e-b26b-449c-99f8-6ecd2d4dec46", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ba67b7353904433812452ec00d567e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a067af9-82", "ovs_interfaceid": "6a067af9-827f-49c1-9a52-abed7efff8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Releasing lock "refresh_cache-966c2c1f-fa7a-4cea-a007-254562c6fc3b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Instance network_info: |[{"id": "6a067af9-827f-49c1-9a52-abed7efff8a2", "address": "fa:16:3e:96:7a:68", "network": {"id": "c3c65f7e-b26b-449c-99f8-6ecd2d4dec46", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ba67b7353904433812452ec00d567e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a067af9-82", "ovs_interfaceid": "6a067af9-827f-49c1-9a52-abed7efff8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-80f6d479-48ec-4fcf-83da-21f47884fd34 req-f8f0627f-ee3e-4c20-b354-19512fab0729 service nova] Acquired lock "refresh_cache-966c2c1f-fa7a-4cea-a007-254562c6fc3b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-80f6d479-48ec-4fcf-83da-21f47884fd34 req-f8f0627f-ee3e-4c20-b354-19512fab0729 service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Refreshing network info cache for port 6a067af9-827f-49c1-9a52-abed7efff8a2 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Start _get_guest_xml network_info=[{"id": "6a067af9-827f-49c1-9a52-abed7efff8a2", "address": "fa:16:3e:96:7a:68", "network": {"id": "c3c65f7e-b26b-449c-99f8-6ecd2d4dec46", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ba67b7353904433812452ec00d567e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a067af9-82", "ovs_interfaceid": "6a067af9-827f-49c1-9a52-abed7efff8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:29:39 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:29:39 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:29:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-622982065',display_name='tempest-VolumesNegativeTest-instance-622982065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-622982065',id=34,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5c72094710f46ecad01481a58dd05f4',ramdisk_id='',reservation_id='r-7prpqj70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-100923298',owner_user_name='tempest-VolumesNegativeTest-100923298-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:29:38Z,user_data=None,user_id='8087ed1f734c494ca72ddc378d418d72',uuid=966c2c1f-fa7a-4cea-a007-254562c6fc3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a067af9-827f-49c1-9a52-abed7efff8a2", "address": "fa:16:3e:96:7a:68", "network": {"id": "c3c65f7e-b26b-449c-99f8-6ecd2d4dec46", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ba67b7353904433812452ec00d567e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a067af9-82", "ovs_interfaceid": "6a067af9-827f-49c1-9a52-abed7efff8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Converting VIF {"id": "6a067af9-827f-49c1-9a52-abed7efff8a2", "address": "fa:16:3e:96:7a:68", "network": {"id": "c3c65f7e-b26b-449c-99f8-6ecd2d4dec46", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ba67b7353904433812452ec00d567e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a067af9-82", "ovs_interfaceid": "6a067af9-827f-49c1-9a52-abed7efff8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:7a:68,bridge_name='br-int',has_traffic_filtering=True,id=6a067af9-827f-49c1-9a52-abed7efff8a2,network=Network(c3c65f7e-b26b-449c-99f8-6ecd2d4dec46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a067af9-82') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lazy-loading 'pci_devices' on Instance uuid 966c2c1f-fa7a-4cea-a007-254562c6fc3b {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:29:39 user nova-compute[72849]:   <uuid>966c2c1f-fa7a-4cea-a007-254562c6fc3b</uuid>
Aug 15 16:29:39 user nova-compute[72849]:   <name>instance-00000022</name>
Aug 15 16:29:39 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:29:39 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:29:39 user nova-compute[72849]:   <metadata>
Aug 15 16:29:39 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:29:39 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:29:39 user nova-compute[72849]:       <nova:name>tempest-VolumesNegativeTest-instance-622982065</nova:name>
Aug 15 16:29:39 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:29:39</nova:creationTime>
Aug 15 16:29:39 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:29:39 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:29:39 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:29:39 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:29:39 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:29:39 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:29:39 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:29:39 user nova-compute[72849]:       <nova:owner>
Aug 15 16:29:39 user nova-compute[72849]:         <nova:user uuid="8087ed1f734c494ca72ddc378d418d72">tempest-VolumesNegativeTest-100923298-project-member</nova:user>
Aug 15 16:29:39 user nova-compute[72849]:         <nova:project uuid="c5c72094710f46ecad01481a58dd05f4">tempest-VolumesNegativeTest-100923298</nova:project>
Aug 15 16:29:39 user nova-compute[72849]:       </nova:owner>
Aug 15 16:29:39 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:29:39 user nova-compute[72849]:       <nova:ports>
Aug 15 16:29:39 user nova-compute[72849]:         <nova:port uuid="6a067af9-827f-49c1-9a52-abed7efff8a2">
Aug 15 16:29:39 user nova-compute[72849]:           <nova:ip type="fixed" address="192.168.233.226" ipVersion="4"/>
Aug 15 16:29:39 user nova-compute[72849]:         </nova:port>
Aug 15 16:29:39 user nova-compute[72849]:       </nova:ports>
Aug 15 16:29:39 user nova-compute[72849]:     </nova:instance>
Aug 15 16:29:39 user nova-compute[72849]:   </metadata>
Aug 15 16:29:39 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:29:39 user nova-compute[72849]:     <system>
Aug 15 16:29:39 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:29:39 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:29:39 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:29:39 user nova-compute[72849]:       <entry name="serial">966c2c1f-fa7a-4cea-a007-254562c6fc3b</entry>
Aug 15 16:29:39 user nova-compute[72849]:       <entry name="uuid">966c2c1f-fa7a-4cea-a007-254562c6fc3b</entry>
Aug 15 16:29:39 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:29:39 user nova-compute[72849]:     </system>
Aug 15 16:29:39 user nova-compute[72849]:   </sysinfo>
Aug 15 16:29:39 user nova-compute[72849]:   <os>
Aug 15 16:29:39 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:29:39 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:29:39 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:29:39 user nova-compute[72849]:   </os>
Aug 15 16:29:39 user nova-compute[72849]:   <features>
Aug 15 16:29:39 user nova-compute[72849]:     <acpi/>
Aug 15 16:29:39 user nova-compute[72849]:     <apic/>
Aug 15 16:29:39 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:29:39 user nova-compute[72849]:   </features>
Aug 15 16:29:39 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:29:39 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:29:39 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:29:39 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:29:39 user nova-compute[72849]:   </clock>
Aug 15 16:29:39 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:29:39 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:29:39 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:29:39 user nova-compute[72849]:   </cpu>
Aug 15 16:29:39 user nova-compute[72849]:   <devices>
Aug 15 16:29:39 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:29:39 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:29:39 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/966c2c1f-fa7a-4cea-a007-254562c6fc3b/disk"/>
Aug 15 16:29:39 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:29:39 user nova-compute[72849]:     </disk>
Aug 15 16:29:39 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:29:39 user nova-compute[72849]:       <mac address="fa:16:3e:96:7a:68"/>
Aug 15 16:29:39 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:29:39 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:29:39 user nova-compute[72849]:       <target dev="tap6a067af9-82"/>
Aug 15 16:29:39 user nova-compute[72849]:     </interface>
Aug 15 16:29:39 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:29:39 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/966c2c1f-fa7a-4cea-a007-254562c6fc3b/console.log" append="off"/>
Aug 15 16:29:39 user nova-compute[72849]:     </serial>
Aug 15 16:29:39 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:29:39 user nova-compute[72849]:     <video>
Aug 15 16:29:39 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:29:39 user nova-compute[72849]:     </video>
Aug 15 16:29:39 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:29:39 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:29:39 user nova-compute[72849]:     </rng>
Aug 15 16:29:39 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:29:39 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:29:39 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:29:39 user nova-compute[72849]:     </memballoon>
Aug 15 16:29:39 user nova-compute[72849]:   </devices>
Aug 15 16:29:39 user nova-compute[72849]: </domain>
Aug 15 16:29:39 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:29:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-622982065',display_name='tempest-VolumesNegativeTest-instance-622982065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-622982065',id=34,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5c72094710f46ecad01481a58dd05f4',ramdisk_id='',reservation_id='r-7prpqj70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-100923298',owner_user_name='tempest-VolumesNegativeTest-100923298-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:29:38Z,user_data=None,user_id='8087ed1f734c494ca72ddc378d418d72',uuid=966c2c1f-fa7a-4cea-a007-254562c6fc3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a067af9-827f-49c1-9a52-abed7efff8a2", "address": "fa:16:3e:96:7a:68", "network": {"id": "c3c65f7e-b26b-449c-99f8-6ecd2d4dec46", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ba67b7353904433812452ec00d567e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a067af9-82", "ovs_interfaceid": "6a067af9-827f-49c1-9a52-abed7efff8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Converting VIF {"id": "6a067af9-827f-49c1-9a52-abed7efff8a2", "address": "fa:16:3e:96:7a:68", "network": {"id": "c3c65f7e-b26b-449c-99f8-6ecd2d4dec46", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ba67b7353904433812452ec00d567e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a067af9-82", "ovs_interfaceid": "6a067af9-827f-49c1-9a52-abed7efff8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:7a:68,bridge_name='br-int',has_traffic_filtering=True,id=6a067af9-827f-49c1-9a52-abed7efff8a2,network=Network(c3c65f7e-b26b-449c-99f8-6ecd2d4dec46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a067af9-82') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG os_vif [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:7a:68,bridge_name='br-int',has_traffic_filtering=True,id=6a067af9-827f-49c1-9a52-abed7efff8a2,network=Network(c3c65f7e-b26b-449c-99f8-6ecd2d4dec46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a067af9-82') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a067af9-82, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a067af9-82, col_values=(('external_ids', {'iface-id': '6a067af9-827f-49c1-9a52-abed7efff8a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:7a:68', 'vm-uuid': '966c2c1f-fa7a-4cea-a007-254562c6fc3b'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:29:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:39 user nova-compute[72849]: INFO os_vif [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:7a:68,bridge_name='br-int',has_traffic_filtering=True,id=6a067af9-827f-49c1-9a52-abed7efff8a2,network=Network(c3c65f7e-b26b-449c-99f8-6ecd2d4dec46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a067af9-82')
Aug 15 16:29:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:29:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] No VIF found with MAC fa:16:3e:96:7a:68, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:29:40 user nova-compute[72849]: DEBUG nova.network.neutron [req-80f6d479-48ec-4fcf-83da-21f47884fd34 req-f8f0627f-ee3e-4c20-b354-19512fab0729 service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Updated VIF entry in instance network info cache for port 6a067af9-827f-49c1-9a52-abed7efff8a2. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:29:40 user nova-compute[72849]: DEBUG nova.network.neutron [req-80f6d479-48ec-4fcf-83da-21f47884fd34 req-f8f0627f-ee3e-4c20-b354-19512fab0729 service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Updating instance_info_cache with network_info: [{"id": "6a067af9-827f-49c1-9a52-abed7efff8a2", "address": "fa:16:3e:96:7a:68", "network": {"id": "c3c65f7e-b26b-449c-99f8-6ecd2d4dec46", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ba67b7353904433812452ec00d567e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a067af9-82", "ovs_interfaceid": "6a067af9-827f-49c1-9a52-abed7efff8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:29:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-80f6d479-48ec-4fcf-83da-21f47884fd34 req-f8f0627f-ee3e-4c20-b354-19512fab0729 service nova] Releasing lock "refresh_cache-966c2c1f-fa7a-4cea-a007-254562c6fc3b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:29:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-89d7dd10-fea1-4a7b-b8b7-c12891cb5c34 req-de811a91-0000-4ab7-ae3e-537518ab2875 service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Received event network-vif-plugged-6a067af9-827f-49c1-9a52-abed7efff8a2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:29:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-89d7dd10-fea1-4a7b-b8b7-c12891cb5c34 req-de811a91-0000-4ab7-ae3e-537518ab2875 service nova] Acquiring lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-89d7dd10-fea1-4a7b-b8b7-c12891cb5c34 req-de811a91-0000-4ab7-ae3e-537518ab2875 service nova] Lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-89d7dd10-fea1-4a7b-b8b7-c12891cb5c34 req-de811a91-0000-4ab7-ae3e-537518ab2875 service nova] Lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-89d7dd10-fea1-4a7b-b8b7-c12891cb5c34 req-de811a91-0000-4ab7-ae3e-537518ab2875 service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] No waiting events found dispatching network-vif-plugged-6a067af9-827f-49c1-9a52-abed7efff8a2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:29:41 user nova-compute[72849]: WARNING nova.compute.manager [req-89d7dd10-fea1-4a7b-b8b7-c12891cb5c34 req-de811a91-0000-4ab7-ae3e-537518ab2875 service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Received unexpected event network-vif-plugged-6a067af9-827f-49c1-9a52-abed7efff8a2 for instance with vm_state building and task_state spawning.
Aug 15 16:29:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:43 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116983.6353817, 966c2c1f-fa7a-4cea-a007-254562c6fc3b => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:29:43 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] VM Resumed (Lifecycle Event)
Aug 15 16:29:43 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:29:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:29:43 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Instance spawned successfully.
Aug 15 16:29:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:29:43 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:29:43 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:29:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:29:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:29:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:29:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:29:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:29:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:29:43 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:29:43 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116983.636689, 966c2c1f-fa7a-4cea-a007-254562c6fc3b => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:29:43 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] VM Started (Lifecycle Event)
Aug 15 16:29:43 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:29:43 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:29:43 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:29:43 user nova-compute[72849]: INFO nova.compute.manager [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 15 16:29:43 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:29:43 user nova-compute[72849]: INFO nova.compute.manager [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Took 7.21 seconds to build instance.
Aug 15 16:29:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7fb1ada9-18ad-4740-a735-b2533330e853 tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.354s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-166ce71d-1477-462e-8037-2e67eb3faa33 req-82e65dd1-28b5-41a1-b11a-6ce58213daa5 service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Received event network-vif-plugged-6a067af9-827f-49c1-9a52-abed7efff8a2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:29:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-166ce71d-1477-462e-8037-2e67eb3faa33 req-82e65dd1-28b5-41a1-b11a-6ce58213daa5 service nova] Acquiring lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-166ce71d-1477-462e-8037-2e67eb3faa33 req-82e65dd1-28b5-41a1-b11a-6ce58213daa5 service nova] Lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-166ce71d-1477-462e-8037-2e67eb3faa33 req-82e65dd1-28b5-41a1-b11a-6ce58213daa5 service nova] Lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-166ce71d-1477-462e-8037-2e67eb3faa33 req-82e65dd1-28b5-41a1-b11a-6ce58213daa5 service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] No waiting events found dispatching network-vif-plugged-6a067af9-827f-49c1-9a52-abed7efff8a2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:29:43 user nova-compute[72849]: WARNING nova.compute.manager [req-166ce71d-1477-462e-8037-2e67eb3faa33 req-82e65dd1-28b5-41a1-b11a-6ce58213daa5 service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Received unexpected event network-vif-plugged-6a067af9-827f-49c1-9a52-abed7efff8a2 for instance with vm_state active and task_state None.
Aug 15 16:29:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:51 user nova-compute[72849]: INFO nova.compute.manager [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Rescuing
Aug 15 16:29:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "refresh_cache-ea9d5a00-42db-41e4-bb81-b3875e84f16c" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:29:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquired lock "refresh_cache-ea9d5a00-42db-41e4-bb81-b3875e84f16c" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:29:51 user nova-compute[72849]: DEBUG nova.network.neutron [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:29:52 user nova-compute[72849]: DEBUG nova.network.neutron [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Updating instance_info_cache with network_info: [{"id": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "address": "fa:16:3e:f4:f0:ec", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f4c47f-05", "ovs_interfaceid": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:29:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Releasing lock "refresh_cache-ea9d5a00-42db-41e4-bb81-b3875e84f16c" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:29:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-58b63a61-5f8d-4405-95ce-700822609965 req-9bc0c26a-dd43-460a-b077-015b41eccc4d service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received event network-vif-unplugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:29:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-58b63a61-5f8d-4405-95ce-700822609965 req-9bc0c26a-dd43-460a-b077-015b41eccc4d service nova] Acquiring lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-58b63a61-5f8d-4405-95ce-700822609965 req-9bc0c26a-dd43-460a-b077-015b41eccc4d service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-58b63a61-5f8d-4405-95ce-700822609965 req-9bc0c26a-dd43-460a-b077-015b41eccc4d service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-58b63a61-5f8d-4405-95ce-700822609965 req-9bc0c26a-dd43-460a-b077-015b41eccc4d service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] No waiting events found dispatching network-vif-unplugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:29:52 user nova-compute[72849]: WARNING nova.compute.manager [req-58b63a61-5f8d-4405-95ce-700822609965 req-9bc0c26a-dd43-460a-b077-015b41eccc4d service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received unexpected event network-vif-unplugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b for instance with vm_state active and task_state rescuing.
Aug 15 16:29:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:52 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Instance destroyed successfully.
Aug 15 16:29:52 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Attempting a stable device rescue
Aug 15 16:29:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72849) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 16:29:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Instance directory exists: not creating {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 16:29:52 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Creating image(s)
Aug 15 16:29:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "/opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "/opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:52 user nova-compute[72849]: DEBUG nova.objects.instance [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'trusted_certs' on Instance uuid ea9d5a00-42db-41e4-bb81-b3875e84f16c {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:29:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "a07cfa6a47a4b2823c50414f94d807dba68d324a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "a07cfa6a47a4b2823c50414f94d807dba68d324a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a07cfa6a47a4b2823c50414f94d807dba68d324a.part --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a07cfa6a47a4b2823c50414f94d807dba68d324a.part --force-share --output=json" returned: 0 in 0.196s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.images [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] ac63273b-9de7-48b8-8ad5-b38dac90099f was qcow2, converting to raw {{(pid=72849) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.privsep.utils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72849) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a07cfa6a47a4b2823c50414f94d807dba68d324a.part /opt/stack/data/nova/instances/_base/a07cfa6a47a4b2823c50414f94d807dba68d324a.converted {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a07cfa6a47a4b2823c50414f94d807dba68d324a.part /opt/stack/data/nova/instances/_base/a07cfa6a47a4b2823c50414f94d807dba68d324a.converted" returned: 0 in 0.289s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a07cfa6a47a4b2823c50414f94d807dba68d324a.converted --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-8a5d1f81-72ab-4a9d-9304-363bd2a44c6d req-39c2b382-78c3-4fad-881f-28b213e4ea0a service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received event network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8a5d1f81-72ab-4a9d-9304-363bd2a44c6d req-39c2b382-78c3-4fad-881f-28b213e4ea0a service nova] Acquiring lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8a5d1f81-72ab-4a9d-9304-363bd2a44c6d req-39c2b382-78c3-4fad-881f-28b213e4ea0a service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8a5d1f81-72ab-4a9d-9304-363bd2a44c6d req-39c2b382-78c3-4fad-881f-28b213e4ea0a service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-8a5d1f81-72ab-4a9d-9304-363bd2a44c6d req-39c2b382-78c3-4fad-881f-28b213e4ea0a service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] No waiting events found dispatching network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:29:54 user nova-compute[72849]: WARNING nova.compute.manager [req-8a5d1f81-72ab-4a9d-9304-363bd2a44c6d req-39c2b382-78c3-4fad-881f-28b213e4ea0a service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received unexpected event network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b for instance with vm_state active and task_state rescuing.
Aug 15 16:29:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a07cfa6a47a4b2823c50414f94d807dba68d324a.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "a07cfa6a47a4b2823c50414f94d807dba68d324a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.704s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "a07cfa6a47a4b2823c50414f94d807dba68d324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "a07cfa6a47a4b2823c50414f94d807dba68d324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a07cfa6a47a4b2823c50414f94d807dba68d324a --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a07cfa6a47a4b2823c50414f94d807dba68d324a --force-share --output=json" returned: 0 in 0.174s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a07cfa6a47a4b2823c50414f94d807dba68d324a,backing_fmt=raw /opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c/disk.rescue {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a07cfa6a47a4b2823c50414f94d807dba68d324a,backing_fmt=raw /opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c/disk.rescue" returned: 0 in 0.053s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "a07cfa6a47a4b2823c50414f94d807dba68d324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.objects.instance [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'migration_context' on Instance uuid ea9d5a00-42db-41e4-bb81-b3875e84f16c {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Start _get_guest_xml network_info=[{"id": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "address": "fa:16:3e:f4:f0:ec", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "vif_mac": "fa:16:3e:f4:f0:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f4c47f-05", "ovs_interfaceid": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ac63273b-9de7-48b8-8ad5-b38dac90099f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZvYJlWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'ea9d5a00-42db-41e4-bb81-b3875e84f16c', 'attached_at': '', 'detached_at': '', 'volume_id': '23f99289-8881-40a2-9fe0-dee320c8131a', 'serial': '23f99289-8881-40a2-9fe0-dee320c8131a'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '2de9c3e8-ffb2-49e8-ba5a-2ae066b9d2d4', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.objects.instance [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'resources' on Instance uuid ea9d5a00-42db-41e4-bb81-b3875e84f16c {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.objects.instance [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'numa_topology' on Instance uuid ea9d5a00-42db-41e4-bb81-b3875e84f16c {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:29:54 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:29:54 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.objects.instance [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'vcpu_model' on Instance uuid ea9d5a00-42db-41e4-bb81-b3875e84f16c {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:29:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZvYJlWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:29:55 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:29:55 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:29:55 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:29:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8ffbae-1728-4881-8932-81c2ca51fb5d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BZvYJlWR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 16:29:55 user nova-compute[72849]: node.name = iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a
Aug 15 16:29:55 user nova-compute[72849]: node.tpgt = -1
Aug 15 16:29:55 user nova-compute[72849]: node.startup = automatic
Aug 15 16:29:55 user nova-compute[72849]: node.leading_login = No
Aug 15 16:29:55 user nova-compute[72849]: iface.iscsi_ifacename = default
Aug 15 16:29:55 user nova-compute[72849]: iface.net_ifacename = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.ipaddress = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.prefix_len = 0
Aug 15 16:29:55 user nova-compute[72849]: iface.hwaddress = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.transport_name = tcp
Aug 15 16:29:55 user nova-compute[72849]: iface.initiatorname = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.state = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.vlan_id = 0
Aug 15 16:29:55 user nova-compute[72849]: iface.vlan_priority = 0
Aug 15 16:29:55 user nova-compute[72849]: iface.vlan_state = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.iface_num = 0
Aug 15 16:29:55 user nova-compute[72849]: iface.mtu = 0
Aug 15 16:29:55 user nova-compute[72849]: iface.port = 0
Aug 15 16:29:55 user nova-compute[72849]: iface.bootproto = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.subnet_mask = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.gateway = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.dhcp_alt_client_id = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.dhcp_dns = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.dhcp_learn_iqn = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.dhcp_vendor_id_state = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.dhcp_vendor_id = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.dhcp_slp_da = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.fragmentation = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.gratuitous_arp = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.incoming_forwarding = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.tos_state = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.tos = 0
Aug 15 16:29:55 user nova-compute[72849]: iface.ttl = 0
Aug 15 16:29:55 user nova-compute[72849]: iface.delayed_ack = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.tcp_nagle = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.tcp_wsf_state = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.tcp_wsf = 0
Aug 15 16:29:55 user nova-compute[72849]: iface.tcp_timer_scale = 0
Aug 15 16:29:55 user nova-compute[72849]: iface.tcp_timestamp = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.redirect = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.def_task_mgmt_timeout = 0
Aug 15 16:29:55 user nova-compute[72849]: iface.header_digest = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.data_digest = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.immediate_data = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.initial_r2t = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.data_seq_inorder = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.data_pdu_inorder = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.erl = 0
Aug 15 16:29:55 user nova-compute[72849]: iface.max_receive_data_len = 0
Aug 15 16:29:55 user nova-compute[72849]: iface.first_burst_len = 0
Aug 15 16:29:55 user nova-compute[72849]: iface.max_outstanding_r2t = 0
Aug 15 16:29:55 user nova-compute[72849]: iface.max_burst_len = 0
Aug 15 16:29:55 user nova-compute[72849]: iface.chap_auth = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.bidi_chap = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.strict_login_compliance = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.discovery_auth = <empty>
Aug 15 16:29:55 user nova-compute[72849]: iface.discovery_logout = <empty>
Aug 15 16:29:55 user nova-compute[72849]: node.discovery_address = <empty>
Aug 15 16:29:55 user nova-compute[72849]: node.discovery_port = 0
Aug 15 16:29:55 user nova-compute[72849]: node.discovery_type = static
Aug 15 16:29:55 user nova-compute[72849]: node.session.initial_cmdsn = 0
Aug 15 16:29:55 user nova-compute[72849]: node.session.initial_login_retry_max = 8
Aug 15 16:29:55 user nova-compute[72849]: node.session.xmit_thread_priority = -20
Aug 15 16:29:55 user nova-compute[72849]: node.session.cmds_max = 128
Aug 15 16:29:55 user nova-compute[72849]: node.session.queue_depth = 32
Aug 15 16:29:55 user nova-compute[72849]: node.session.nr_sessions = 1
Aug 15 16:29:55 user nova-compute[72849]: node.session.auth.authmethod = CHAP
Aug 15 16:29:55 user nova-compute[72849]: node.session.auth.username = BZvYJlWR
Aug 15 16:29:55 user nova-compute[72849]: node.session.auth.password = ***
Aug 15 16:29:55 user nova-compute[72849]: node.session.auth.username_in = <empty>
Aug 15 16:29:55 user nova-compute[72849]: node.session.auth.password_in = <empty>
Aug 15 16:29:55 user nova-compute[72849]: node.session.auth.chap_algs = MD5
Aug 15 16:29:55 user nova-compute[72849]: node.session.timeo.replacement_timeout = 120
Aug 15 16:29:55 user nova-compute[72849]: node.session.err_timeo.abort_timeout = 15
Aug 15 16:29:55 user nova-compute[72849]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 16:29:55 user nova-compute[72849]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 16:29:55 user nova-compute[72849]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 16:29:55 user nova-compute[72849]: node.session.iscsi.FastAbort = Yes
Aug 15 16:29:55 user nova-compute[72849]: node.session.iscsi.InitialR2T = No
Aug 15 16:29:55 user nova-compute[72849]: node.session.iscsi.ImmediateData = Yes
Aug 15 16:29:55 user nova-compute[72849]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 16:29:55 user nova-compute[72849]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 16:29:55 user nova-compute[72849]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 16:29:55 user nova-compute[72849]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 16:29:55 user nova-compute[72849]: node.session.iscsi.MaxConnections = 1
Aug 15 16:29:55 user nova-compute[72849]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 16:29:55 user nova-compute[72849]: node.session.iscsi.ERL = 0
Aug 15 16:29:55 user nova-compute[72849]: node.session.scan = manual
Aug 15 16:29:55 user nova-compute[72849]: node.session.reopen_max = 0
Aug 15 16:29:55 user nova-compute[72849]: node.conn[0].address = 172.16.0.220
Aug 15 16:29:55 user nova-compute[72849]: node.conn[0].port = 3260
Aug 15 16:29:55 user nova-compute[72849]: node.conn[0].startup = manual
Aug 15 16:29:55 user nova-compute[72849]: node.conn[0].tcp.window_size = 524288
Aug 15 16:29:55 user nova-compute[72849]: node.conn[0].tcp.type_of_service = 0
Aug 15 16:29:55 user nova-compute[72849]: node.conn[0].timeo.logout_timeout = 15
Aug 15 16:29:55 user nova-compute[72849]: node.conn[0].timeo.login_timeout = 15
Aug 15 16:29:55 user nova-compute[72849]: node.conn[0].timeo.auth_timeout = 45
Aug 15 16:29:55 user nova-compute[72849]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 16:29:55 user nova-compute[72849]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 16:29:55 user nova-compute[72849]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 16:29:55 user nova-compute[72849]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 16:29:55 user nova-compute[72849]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 16:29:55 user nova-compute[72849]: node.conn[0].iscsi.DataDigest = None
Aug 15 16:29:55 user nova-compute[72849]: node.conn[0].iscsi.IFMarker = No
Aug 15 16:29:55 user nova-compute[72849]: node.conn[0].iscsi.OFMarker = No
Aug 15 16:29:55 user nova-compute[72849]: # END RECORD
Aug 15 16:29:55 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab38b19-7877-4dd1-9ec1-25ac35255b90]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[83538f2f-04d7-4ef4-aeb4-ee8dbe617903]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZvYJlWR {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZvYJlWR" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7b2de0-c1f9-4a1f-9452-97c044e27e14]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BZvYJlWR'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63272c6-ac2b-4ac2-b49c-c5b28a10ac5f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58ada12-b287-42aa-b76b-689b23b38126]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:29:55 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:29:55 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:29:55 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:29:55 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:29:55 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:29:55 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:29:55 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:29:55 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:29:55 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:29:55 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.162s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] HCTL ('35', '0', '0', 0) found on session 29 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f445187a-e97b-4fdb-97ad-bf30e29049de]: (4, ('0 0 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Searching for a device in session 29 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZvYJlWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.188s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] <== connect_volume: return (190ms) {'type': 'block', 'scsi_wwn': '23131353136303961', 'path': '/dev/sdd'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131353136303961', 'path': '/dev/sdd'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-111188340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-111188340',id=28,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:28:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f51f800c0ca74e149a2f8ed9718b221f',ramdisk_id='',reservation_id='r-0c8a77eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:28:40Z,user_data=None,user_id='cd6279423b7f43c4aac7956aec43efdd',uuid=ea9d5a00-42db-41e4-bb81-b3875e84f16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "address": "fa:16:3e:f4:f0:ec", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "vif_mac": "fa:16:3e:f4:f0:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f4c47f-05", "ovs_interfaceid": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converting VIF {"id": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "address": "fa:16:3e:f4:f0:ec", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "vif_mac": "fa:16:3e:f4:f0:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f4c47f-05", "ovs_interfaceid": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:f0:ec,bridge_name='br-int',has_traffic_filtering=True,id=65f4c47f-0546-4a8a-bbe6-64a38fb5210b,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f4c47f-05') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG nova.objects.instance [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'pci_devices' on Instance uuid ea9d5a00-42db-41e4-bb81-b3875e84f16c {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:29:55 user nova-compute[72849]:   <uuid>ea9d5a00-42db-41e4-bb81-b3875e84f16c</uuid>
Aug 15 16:29:55 user nova-compute[72849]:   <name>instance-0000001c</name>
Aug 15 16:29:55 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:29:55 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:29:55 user nova-compute[72849]:   <metadata>
Aug 15 16:29:55 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:29:55 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:29:55 user nova-compute[72849]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-111188340</nova:name>
Aug 15 16:29:55 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:29:54</nova:creationTime>
Aug 15 16:29:55 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:29:55 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:29:55 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:29:55 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:29:55 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:29:55 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:29:55 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:29:55 user nova-compute[72849]:       <nova:owner>
Aug 15 16:29:55 user nova-compute[72849]:         <nova:user uuid="cd6279423b7f43c4aac7956aec43efdd">tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member</nova:user>
Aug 15 16:29:55 user nova-compute[72849]:         <nova:project uuid="f51f800c0ca74e149a2f8ed9718b221f">tempest-ServerBootFromVolumeStableRescueTest-1207284584</nova:project>
Aug 15 16:29:55 user nova-compute[72849]:       </nova:owner>
Aug 15 16:29:55 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:29:55 user nova-compute[72849]:       <nova:ports>
Aug 15 16:29:55 user nova-compute[72849]:         <nova:port uuid="65f4c47f-0546-4a8a-bbe6-64a38fb5210b">
Aug 15 16:29:55 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 16:29:55 user nova-compute[72849]:         </nova:port>
Aug 15 16:29:55 user nova-compute[72849]:       </nova:ports>
Aug 15 16:29:55 user nova-compute[72849]:     </nova:instance>
Aug 15 16:29:55 user nova-compute[72849]:   </metadata>
Aug 15 16:29:55 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:29:55 user nova-compute[72849]:     <system>
Aug 15 16:29:55 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:29:55 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:29:55 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:29:55 user nova-compute[72849]:       <entry name="serial">ea9d5a00-42db-41e4-bb81-b3875e84f16c</entry>
Aug 15 16:29:55 user nova-compute[72849]:       <entry name="uuid">ea9d5a00-42db-41e4-bb81-b3875e84f16c</entry>
Aug 15 16:29:55 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:29:55 user nova-compute[72849]:     </system>
Aug 15 16:29:55 user nova-compute[72849]:   </sysinfo>
Aug 15 16:29:55 user nova-compute[72849]:   <os>
Aug 15 16:29:55 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:29:55 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:29:55 user nova-compute[72849]:   </os>
Aug 15 16:29:55 user nova-compute[72849]:   <features>
Aug 15 16:29:55 user nova-compute[72849]:     <acpi/>
Aug 15 16:29:55 user nova-compute[72849]:     <apic/>
Aug 15 16:29:55 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:29:55 user nova-compute[72849]:   </features>
Aug 15 16:29:55 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:29:55 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:29:55 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:29:55 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:29:55 user nova-compute[72849]:   </clock>
Aug 15 16:29:55 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:29:55 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:29:55 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:29:55 user nova-compute[72849]:   </cpu>
Aug 15 16:29:55 user nova-compute[72849]:   <devices>
Aug 15 16:29:55 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:29:55 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:29:55 user nova-compute[72849]:       <source dev="/dev/sdd"/>
Aug 15 16:29:55 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:29:55 user nova-compute[72849]:       <serial>23f99289-8881-40a2-9fe0-dee320c8131a</serial>
Aug 15 16:29:55 user nova-compute[72849]:     </disk>
Aug 15 16:29:55 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:29:55 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:29:55 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c/disk.rescue"/>
Aug 15 16:29:55 user nova-compute[72849]:       <target dev="vdb" bus="virtio"/>
Aug 15 16:29:55 user nova-compute[72849]:       <boot order="1"/>
Aug 15 16:29:55 user nova-compute[72849]:     </disk>
Aug 15 16:29:55 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:29:55 user nova-compute[72849]:       <mac address="fa:16:3e:f4:f0:ec"/>
Aug 15 16:29:55 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:29:55 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:29:55 user nova-compute[72849]:       <target dev="tap65f4c47f-05"/>
Aug 15 16:29:55 user nova-compute[72849]:     </interface>
Aug 15 16:29:55 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:29:55 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c/console.log" append="off"/>
Aug 15 16:29:55 user nova-compute[72849]:     </serial>
Aug 15 16:29:55 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:29:55 user nova-compute[72849]:     <video>
Aug 15 16:29:55 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:29:55 user nova-compute[72849]:     </video>
Aug 15 16:29:55 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:29:55 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:29:55 user nova-compute[72849]:     </rng>
Aug 15 16:29:55 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:29:55 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:29:55 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:29:55 user nova-compute[72849]:     </memballoon>
Aug 15 16:29:55 user nova-compute[72849]:   </devices>
Aug 15 16:29:55 user nova-compute[72849]: </domain>
Aug 15 16:29:55 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:29:55 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Instance destroyed successfully.
Aug 15 16:29:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:29:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] No VIF found with MAC fa:16:3e:f4:f0:ec, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:29:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:56 user nova-compute[72849]: DEBUG nova.compute.manager [req-eb328880-6339-4542-a960-4f55732c8d3c req-ee79044f-f986-4a71-9205-186b2b3f0ef4 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received event network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:29:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eb328880-6339-4542-a960-4f55732c8d3c req-ee79044f-f986-4a71-9205-186b2b3f0ef4 service nova] Acquiring lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eb328880-6339-4542-a960-4f55732c8d3c req-ee79044f-f986-4a71-9205-186b2b3f0ef4 service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eb328880-6339-4542-a960-4f55732c8d3c req-ee79044f-f986-4a71-9205-186b2b3f0ef4 service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:56 user nova-compute[72849]: DEBUG nova.compute.manager [req-eb328880-6339-4542-a960-4f55732c8d3c req-ee79044f-f986-4a71-9205-186b2b3f0ef4 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] No waiting events found dispatching network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:29:56 user nova-compute[72849]: WARNING nova.compute.manager [req-eb328880-6339-4542-a960-4f55732c8d3c req-ee79044f-f986-4a71-9205-186b2b3f0ef4 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received unexpected event network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b for instance with vm_state active and task_state rescuing.
Aug 15 16:29:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:29:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Removed pending event for ea9d5a00-42db-41e4-bb81-b3875e84f16c due to event {{(pid=72849) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 16:29:58 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116998.8355944, ea9d5a00-42db-41e4-bb81-b3875e84f16c => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:29:58 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] VM Resumed (Lifecycle Event)
Aug 15 16:29:58 user nova-compute[72849]: DEBUG nova.compute.manager [None req-af8a3005-a54d-4b18-bb97-8ad04bf062ac tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:29:58 user nova-compute[72849]: DEBUG nova.compute.manager [req-4e8e5ed0-e8de-4fda-896c-a926480c0161 req-c30ea6fc-cf2e-4952-abc7-595dd2cc209c service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received event network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:29:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4e8e5ed0-e8de-4fda-896c-a926480c0161 req-c30ea6fc-cf2e-4952-abc7-595dd2cc209c service nova] Acquiring lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:29:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4e8e5ed0-e8de-4fda-896c-a926480c0161 req-c30ea6fc-cf2e-4952-abc7-595dd2cc209c service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:29:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4e8e5ed0-e8de-4fda-896c-a926480c0161 req-c30ea6fc-cf2e-4952-abc7-595dd2cc209c service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:29:58 user nova-compute[72849]: DEBUG nova.compute.manager [req-4e8e5ed0-e8de-4fda-896c-a926480c0161 req-c30ea6fc-cf2e-4952-abc7-595dd2cc209c service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] No waiting events found dispatching network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:29:58 user nova-compute[72849]: WARNING nova.compute.manager [req-4e8e5ed0-e8de-4fda-896c-a926480c0161 req-c30ea6fc-cf2e-4952-abc7-595dd2cc209c service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received unexpected event network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b for instance with vm_state active and task_state rescuing.
Aug 15 16:29:58 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:29:58 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:29:58 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 16:29:58 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692116998.836005, ea9d5a00-42db-41e4-bb81-b3875e84f16c => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:29:58 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] VM Started (Lifecycle Event)
Aug 15 16:29:58 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:29:58 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:30:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:00 user nova-compute[72849]: DEBUG nova.objects.instance [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lazy-loading 'flavor' on Instance uuid 82f61128-3af4-4f82-ac4c-8ee746b5a829 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:30:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:01 user nova-compute[72849]: INFO nova.compute.manager [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Attaching volume b8e27685-4cd0-42b1-b8f7-38a7746db2f2 to /dev/vdb
Aug 15 16:30:01 user nova-compute[72849]: DEBUG os_brick.utils [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2554bcb-e52d-463b-823a-dcb5861d3099]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a8ab34-44ca-490f-a148-9af4aaf86278]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff20438-f906-45b6-99d2-3bc3780f0a73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[248789b7-6fef-4cbf-b9dc-7ddf73117149]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:30:01 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:30:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b73a66e-76eb-4f6b-bd45-a87c184c3fe6]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG os_brick.utils [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:30:01 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Updating existing volume attachment record: 394b1c1b-a38d-4306-8026-99d4e2cebc0d {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:30:02 user nova-compute[72849]: DEBUG nova.compute.manager [req-a62f2d97-f50c-4cb2-862f-c4281516fc0f req-11dea847-cce9-4034-844b-3c9ee8ccbe5b service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received event network-changed-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:02 user nova-compute[72849]: DEBUG nova.compute.manager [req-a62f2d97-f50c-4cb2-862f-c4281516fc0f req-11dea847-cce9-4034-844b-3c9ee8ccbe5b service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Refreshing instance network info cache due to event network-changed-1b0d74bc-a28a-4a88-80b2-377fc19f2c30. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:30:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a62f2d97-f50c-4cb2-862f-c4281516fc0f req-11dea847-cce9-4034-844b-3c9ee8ccbe5b service nova] Acquiring lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:30:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a62f2d97-f50c-4cb2-862f-c4281516fc0f req-11dea847-cce9-4034-844b-3c9ee8ccbe5b service nova] Acquired lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:30:02 user nova-compute[72849]: DEBUG nova.network.neutron [req-a62f2d97-f50c-4cb2-862f-c4281516fc0f req-11dea847-cce9-4034-844b-3c9ee8ccbe5b service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Refreshing network info cache for port 1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:30:02 user nova-compute[72849]: DEBUG nova.network.neutron [req-a62f2d97-f50c-4cb2-862f-c4281516fc0f req-11dea847-cce9-4034-844b-3c9ee8ccbe5b service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Updated VIF entry in instance network info cache for port 1b0d74bc-a28a-4a88-80b2-377fc19f2c30. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:30:02 user nova-compute[72849]: DEBUG nova.network.neutron [req-a62f2d97-f50c-4cb2-862f-c4281516fc0f req-11dea847-cce9-4034-844b-3c9ee8ccbe5b service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Updating instance_info_cache with network_info: [{"id": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "address": "fa:16:3e:15:be:6e", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d74bc-a2", "ovs_interfaceid": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:30:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a62f2d97-f50c-4cb2-862f-c4281516fc0f req-11dea847-cce9-4034-844b-3c9ee8ccbe5b service nova] Releasing lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:30:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:03 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Stashing vm_state: active {{(pid=72849) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 15 16:30:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:03 user nova-compute[72849]: DEBUG nova.objects.instance [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'pci_requests' on Instance uuid 98358bbf-c7c1-4868-81ee-77bd229133fd {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:30:03 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:30:03 user nova-compute[72849]: INFO nova.compute.claims [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Claim successful on node user
Aug 15 16:30:03 user nova-compute[72849]: DEBUG nova.objects.instance [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'resources' on Instance uuid 98358bbf-c7c1-4868-81ee-77bd229133fd {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:30:03 user nova-compute[72849]: DEBUG nova.objects.instance [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'pci_devices' on Instance uuid 98358bbf-c7c1-4868-81ee-77bd229133fd {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:30:04 user nova-compute[72849]: INFO nova.compute.resource_tracker [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Updating resource usage from migration 86b2553f-a993-4cd4-b9e1-b03bf07e7682
Aug 15 16:30:04 user nova-compute[72849]: DEBUG nova.compute.manager [req-b0a7260a-3e34-40b5-842d-0ae0b9ba17c1 req-46ca6c95-161f-490d-a777-9e9dd3199db6 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received event network-changed-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:04 user nova-compute[72849]: DEBUG nova.compute.manager [req-b0a7260a-3e34-40b5-842d-0ae0b9ba17c1 req-46ca6c95-161f-490d-a777-9e9dd3199db6 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Refreshing instance network info cache due to event network-changed-f6196531-f18f-4440-8a72-27835267e702. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:30:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b0a7260a-3e34-40b5-842d-0ae0b9ba17c1 req-46ca6c95-161f-490d-a777-9e9dd3199db6 service nova] Acquiring lock "refresh_cache-98358bbf-c7c1-4868-81ee-77bd229133fd" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:30:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b0a7260a-3e34-40b5-842d-0ae0b9ba17c1 req-46ca6c95-161f-490d-a777-9e9dd3199db6 service nova] Acquired lock "refresh_cache-98358bbf-c7c1-4868-81ee-77bd229133fd" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:30:04 user nova-compute[72849]: DEBUG nova.network.neutron [req-b0a7260a-3e34-40b5-842d-0ae0b9ba17c1 req-46ca6c95-161f-490d-a777-9e9dd3199db6 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Refreshing network info cache for port f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:30:04 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:30:04 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:30:04 user nova-compute[72849]: DEBUG nova.network.neutron [req-b0a7260a-3e34-40b5-842d-0ae0b9ba17c1 req-46ca6c95-161f-490d-a777-9e9dd3199db6 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Updated VIF entry in instance network info cache for port f6196531-f18f-4440-8a72-27835267e702. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:30:04 user nova-compute[72849]: DEBUG nova.network.neutron [req-b0a7260a-3e34-40b5-842d-0ae0b9ba17c1 req-46ca6c95-161f-490d-a777-9e9dd3199db6 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Updating instance_info_cache with network_info: [{"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:30:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.654s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:04 user nova-compute[72849]: INFO nova.compute.manager [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Migrating
Aug 15 16:30:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b0a7260a-3e34-40b5-842d-0ae0b9ba17c1 req-46ca6c95-161f-490d-a777-9e9dd3199db6 service nova] Releasing lock "refresh_cache-98358bbf-c7c1-4868-81ee-77bd229133fd" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:30:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "refresh_cache-98358bbf-c7c1-4868-81ee-77bd229133fd" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:30:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquired lock "refresh_cache-98358bbf-c7c1-4868-81ee-77bd229133fd" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:30:04 user nova-compute[72849]: DEBUG nova.network.neutron [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:30:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:05 user nova-compute[72849]: DEBUG nova.network.neutron [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Updating instance_info_cache with network_info: [{"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:30:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Releasing lock "refresh_cache-98358bbf-c7c1-4868-81ee-77bd229133fd" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:30:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Starting migrate_disk_and_power_off {{(pid=72849) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 15 16:30:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-d971d46c-13dd-4681-a834-fa9bec9e1cc5 req-107527a1-dc86-4f23-bbe0-f029ad0c9f64 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received event network-vif-unplugged-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d971d46c-13dd-4681-a834-fa9bec9e1cc5 req-107527a1-dc86-4f23-bbe0-f029ad0c9f64 service nova] Acquiring lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d971d46c-13dd-4681-a834-fa9bec9e1cc5 req-107527a1-dc86-4f23-bbe0-f029ad0c9f64 service nova] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d971d46c-13dd-4681-a834-fa9bec9e1cc5 req-107527a1-dc86-4f23-bbe0-f029ad0c9f64 service nova] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-d971d46c-13dd-4681-a834-fa9bec9e1cc5 req-107527a1-dc86-4f23-bbe0-f029ad0c9f64 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] No waiting events found dispatching network-vif-unplugged-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:30:05 user nova-compute[72849]: WARNING nova.compute.manager [req-d971d46c-13dd-4681-a834-fa9bec9e1cc5 req-107527a1-dc86-4f23-bbe0-f029ad0c9f64 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received unexpected event network-vif-unplugged-f6196531-f18f-4440-8a72-27835267e702 for instance with vm_state active and task_state resize_migrating.
Aug 15 16:30:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:06 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Instance destroyed successfully.
Aug 15 16:30:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2006001136',display_name='tempest-ServerActionsTestOtherA-server-2006001136',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2006001136',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFz77lNADA9bIEqsG+/0pmqytVknVJgn2QYVHLyikCb7OZcHj5oDk3lRMMWld0kQEG++u8j1QCo1UgVUz17EVZQY5cNigvtxWp2mZweLxgKV8OVoFjr81Ihq1bC8gLICA==',key_name='tempest-keypair-669870558',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:28:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='33a3a3412c95451db4dd0edc27f361cc',ramdisk_id='',reservation_id='r-hj2o5jsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-514064593',owner_user_name='tempest-ServerActionsTestOtherA-514064593-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60cbe30799ad4438b84251a254691b70',uuid=98358bbf-c7c1-4868-81ee-77bd229133fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1826635397-network", "vif_mac": "fa:16:3e:81:b9:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converting VIF {"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1826635397-network", "vif_mac": "fa:16:3e:81:b9:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:b9:08,bridge_name='br-int',has_traffic_filtering=True,id=f6196531-f18f-4440-8a72-27835267e702,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6196531-f1') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_vif [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:b9:08,bridge_name='br-int',has_traffic_filtering=True,id=f6196531-f18f-4440-8a72-27835267e702,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6196531-f1') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6196531-f1, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:30:06 user nova-compute[72849]: INFO os_vif [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:b9:08,bridge_name='br-int',has_traffic_filtering=True,id=f6196531-f18f-4440-8a72-27835267e702,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6196531-f1')
Aug 15 16:30:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzMGVaDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:30:06 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[777d972e-380c-4448-aa1c-de5f5cca0d53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cf2836-9f7a-4acf-9f03-e1b5062a7629]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:06 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:30:06 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:06 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:06 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:06 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:06 user nova-compute[72849]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:30:06 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:06 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:06 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:06 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc37832f010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792'): ({'sdc'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Removing single pathed devices sdc {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f24898-3a7a-4714-982d-1b9eb0243ce1]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3291ccf1-977e-42ec-a8ee-787fc84e4b25]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Flushing IO for device /dev/sdc {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[048c30da-69ed-4494-b4ad-d35ce3e96f0f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[623f0a71-e81d-4292-b03d-62bfaf98fab1]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[946d9f78-cf88-43ed-bdff-803b1e152a53]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9c7f2b-21f9-4523-9b10-5c2b5dd8febe]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792, portal: 172.16.0.220,3260]
Aug 15 16:30:06 user nova-compute[72849]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792, portal: 172.16.0.220,3260] successful.
Aug 15 16:30:06 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ce947e-0b87-4aa0-bfe9-32c72acd89c8]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] <== disconnect_volume: return (350ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:30:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:30:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-48624087-0db4-4a43-8595-52ae8256c8a6 req-29a8643d-9aba-40fb-b044-2a7551331f60 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received event network-vif-plugged-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48624087-0db4-4a43-8595-52ae8256c8a6 req-29a8643d-9aba-40fb-b044-2a7551331f60 service nova] Acquiring lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48624087-0db4-4a43-8595-52ae8256c8a6 req-29a8643d-9aba-40fb-b044-2a7551331f60 service nova] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-48624087-0db4-4a43-8595-52ae8256c8a6 req-29a8643d-9aba-40fb-b044-2a7551331f60 service nova] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-48624087-0db4-4a43-8595-52ae8256c8a6 req-29a8643d-9aba-40fb-b044-2a7551331f60 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] No waiting events found dispatching network-vif-plugged-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:30:07 user nova-compute[72849]: WARNING nova.compute.manager [req-48624087-0db4-4a43-8595-52ae8256c8a6 req-29a8643d-9aba-40fb-b044-2a7551331f60 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received unexpected event network-vif-plugged-f6196531-f18f-4440-8a72-27835267e702 for instance with vm_state active and task_state resize_migrating.
Aug 15 16:30:07 user nova-compute[72849]: DEBUG nova.network.neutron [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Port f6196531-f18f-4440-8a72-27835267e702 binding to destination host user is already ACTIVE {{(pid=72849) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 16:30:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "refresh_cache-98358bbf-c7c1-4868-81ee-77bd229133fd" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquired lock "refresh_cache-98358bbf-c7c1-4868-81ee-77bd229133fd" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG nova.network.neutron [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG nova.network.neutron [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Updating instance_info_cache with network_info: [{"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Releasing lock "refresh_cache-98358bbf-c7c1-4868-81ee-77bd229133fd" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG os_brick.utils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[375ddb4f-b08f-4721-8797-91e08d65b89c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.044s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0904e29-b94c-4865-9715-7037db6022ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbacd56-f35e-45c9-af7f-5c89d688daf4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[113216cd-42d6-41c7-b50e-af37c339e1e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:30:08 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:30:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b94f6c3-4bb1-49ed-8899-f7391176170a]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:30:08 user nova-compute[72849]: DEBUG os_brick.utils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VywRcJMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:30:11 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:30:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:30:11 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:30:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:30:11 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d799ba8f-5e28-472e-9004-3516b1245e4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:30:11 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca6a689-4efc-4e3f-b815-a2304a18712c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2] added
Aug 15 16:30:11 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[19455326-3c13-40ac-b5a8-de22ad8053a5]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.166s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b13433-2991-4f84-861d-06ccf5b6c7a3]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VywRcJMS {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VywRcJMS" returned: 0 in 0.122s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[61202320-fc60-4d1a-88a1-f9c869805caa]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VywRcJMS'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[875d6397-17c9-4a9b-b160-45bb2f3d9bdd]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a05d9f8-6951-4e0c-ab42-c490c46332fd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:11 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:11 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:11 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:11 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:11 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:11 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:11 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:11 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccd4daf-4a58-4061-b499-cfa97b03e7d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2, portal: 172.16.0.220,3260]
Aug 15 16:30:11 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2, portal: 172.16.0.220,3260] successful.
Aug 15 16:30:11 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[005d6e9a-ae01-4520-bdca-ad2eac1e0175]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c13269-12d2-47e2-9f18-f7d8d1f3543e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:12 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:12 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:12 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:12 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:30:12 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:30:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:12 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:12 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:12 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:12 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:30:12 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:30:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.549s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:30:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:30:12 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:30:12 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:30:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deefa73-8aff-4c4d-b170-09ef26322c16]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:12 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:30:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VywRcJMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:30:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.581s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:30:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] <== connect_volume: return (1583ms) {'type': 'block', 'scsi_wwn': '26531616164663435', 'path': '/dev/sdc'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:30:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531616164663435', 'path': '/dev/sdc'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:30:13 user nova-compute[72849]: DEBUG nova.objects.instance [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lazy-loading 'flavor' on Instance uuid 82f61128-3af4-4f82-ac4c-8ee746b5a829 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:30:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:30:13 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:30:13 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:30:13 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:30:13 user nova-compute[72849]:   <serial>b8e27685-4cd0-42b1-b8f7-38a7746db2f2</serial>
Aug 15 16:30:13 user nova-compute[72849]: </disk>
Aug 15 16:30:13 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:30:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:30:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:30:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] No VIF found with MAC fa:16:3e:ca:59:78, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:30:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5d2acdb2-57a1-4eb5-add6-cbff4233307b tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.839s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:16 user nova-compute[72849]: DEBUG nova.compute.manager [req-1d4d0772-c48f-4a64-bbbc-fef63047e581 req-09d19ce2-f365-4fd2-a93b-89986ca302dd service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received event network-changed-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:16 user nova-compute[72849]: DEBUG nova.compute.manager [req-1d4d0772-c48f-4a64-bbbc-fef63047e581 req-09d19ce2-f365-4fd2-a93b-89986ca302dd service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Refreshing instance network info cache due to event network-changed-1ef6b77c-2391-485e-ad7f-851bfac1b315. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:30:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1d4d0772-c48f-4a64-bbbc-fef63047e581 req-09d19ce2-f365-4fd2-a93b-89986ca302dd service nova] Acquiring lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:30:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1d4d0772-c48f-4a64-bbbc-fef63047e581 req-09d19ce2-f365-4fd2-a93b-89986ca302dd service nova] Acquired lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:30:16 user nova-compute[72849]: DEBUG nova.network.neutron [req-1d4d0772-c48f-4a64-bbbc-fef63047e581 req-09d19ce2-f365-4fd2-a93b-89986ca302dd service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Refreshing network info cache for port 1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:30:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:16 user nova-compute[72849]: DEBUG nova.network.neutron [req-1d4d0772-c48f-4a64-bbbc-fef63047e581 req-09d19ce2-f365-4fd2-a93b-89986ca302dd service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Updated VIF entry in instance network info cache for port 1ef6b77c-2391-485e-ad7f-851bfac1b315. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:30:16 user nova-compute[72849]: DEBUG nova.network.neutron [req-1d4d0772-c48f-4a64-bbbc-fef63047e581 req-09d19ce2-f365-4fd2-a93b-89986ca302dd service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Updating instance_info_cache with network_info: [{"id": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "address": "fa:16:3e:ca:59:78", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef6b77c-23", "ovs_interfaceid": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:30:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1d4d0772-c48f-4a64-bbbc-fef63047e581 req-09d19ce2-f365-4fd2-a93b-89986ca302dd service nova] Releasing lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:30:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-a2964d37-2b97-4387-9d21-b982704a48c7 req-adb51bd6-0a54-4f4b-93cf-2e2810f0ee90 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received event network-changed-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-a2964d37-2b97-4387-9d21-b982704a48c7 req-adb51bd6-0a54-4f4b-93cf-2e2810f0ee90 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Refreshing instance network info cache due to event network-changed-1ef6b77c-2391-485e-ad7f-851bfac1b315. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:30:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a2964d37-2b97-4387-9d21-b982704a48c7 req-adb51bd6-0a54-4f4b-93cf-2e2810f0ee90 service nova] Acquiring lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:30:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a2964d37-2b97-4387-9d21-b982704a48c7 req-adb51bd6-0a54-4f4b-93cf-2e2810f0ee90 service nova] Acquired lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:30:17 user nova-compute[72849]: DEBUG nova.network.neutron [req-a2964d37-2b97-4387-9d21-b982704a48c7 req-adb51bd6-0a54-4f4b-93cf-2e2810f0ee90 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Refreshing network info cache for port 1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.network.neutron [req-a2964d37-2b97-4387-9d21-b982704a48c7 req-adb51bd6-0a54-4f4b-93cf-2e2810f0ee90 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Updated VIF entry in instance network info cache for port 1ef6b77c-2391-485e-ad7f-851bfac1b315. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.network.neutron [req-a2964d37-2b97-4387-9d21-b982704a48c7 req-adb51bd6-0a54-4f4b-93cf-2e2810f0ee90 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Updating instance_info_cache with network_info: [{"id": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "address": "fa:16:3e:ca:59:78", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef6b77c-23", "ovs_interfaceid": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a2964d37-2b97-4387-9d21-b982704a48c7 req-adb51bd6-0a54-4f4b-93cf-2e2810f0ee90 service nova] Releasing lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-78c0d077-cc03-4f5a-ba0c-8f37ed47fb88 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-78c0d077-cc03-4f5a-ba0c-8f37ed47fb88 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:18 user nova-compute[72849]: INFO nova.compute.manager [None req-78c0d077-cc03-4f5a-ba0c-8f37ed47fb88 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Rebooting instance
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-78c0d077-cc03-4f5a-ba0c-8f37ed47fb88 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-78c0d077-cc03-4f5a-ba0c-8f37ed47fb88 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquired lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.network.neutron [None req-78c0d077-cc03-4f5a-ba0c-8f37ed47fb88 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Starting finish_migration {{(pid=72849) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Instance directory exists: not creating {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 16:30:18 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Creating image(s)
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Did not create local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Ensure instance console log exists: /opt/stack/data/nova/instances/98358bbf-c7c1-4868-81ee-77bd229133fd/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Start _get_guest_xml network_info=[{"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1826635397-network", "vif_mac": "fa:16:3e:81:b9:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzMGVaDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '98358bbf-c7c1-4868-81ee-77bd229133fd', 'attached_at': '2023-08-15T16:30:19.000000', 'detached_at': '', 'volume_id': '5f4a35b3-572d-4c8f-b4bd-f97d7d15b792', 'serial': '5f4a35b3-572d-4c8f-b4bd-f97d7d15b792'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '661b6ecd-0f12-4008-8506-7d7635cb4498', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:30:18 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:30:18 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.objects.instance [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'vcpu_model' on Instance uuid 98358bbf-c7c1-4868-81ee-77bd229133fd {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzMGVaDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:30:18 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:30:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:30:18 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:30:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:30:18 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dd1bfa-fabd-4f5b-9620-e1fd2fe49f8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:30:18 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a96e09-45dc-48c3-9c07-f1b6d2640113]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792] added
Aug 15 16:30:18 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a936e6e5-061a-4508-8de8-54400342834f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[885b60c6-1245-4565-b706-6be168a4e812]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UzMGVaDy {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.network.neutron [None req-78c0d077-cc03-4f5a-ba0c-8f37ed47fb88 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Updating instance_info_cache with network_info: [{"id": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "address": "fa:16:3e:ca:59:78", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef6b77c-23", "ovs_interfaceid": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UzMGVaDy" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae894a1a-8173-4e57-a4e0-37374f0ca8d8]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UzMGVaDy'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-78c0d077-cc03-4f5a-ba0c-8f37ed47fb88 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Releasing lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG nova.compute.manager [None req-78c0d077-cc03-4f5a-ba0c-8f37ed47fb88 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb857d5-741b-4263-9bc9-6c2f6f644a61]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53fe5c8-7fc5-4f10-ba2b-b77ce44af9f7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:19 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:19 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:19 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:19 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:30:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:19 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:19 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:19 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:19 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:30:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[92def0d7-8cdf-4b0d-8253-5b08bfd30310]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792, portal: 172.16.0.220,3260]
Aug 15 16:30:19 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792, portal: 172.16.0.220,3260] successful.
Aug 15 16:30:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ef71cc-fb92-43ac-939d-e17269534a59]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cb69a5-0b71-4489-b4fe-b35984be1d54]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:19 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:19 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:19 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:19 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:30:19 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:30:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:19 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:19 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:19 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:19 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:30:19 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:30:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fedff1-5540-4a27-828e-47a849683dfc]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:30:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzMGVaDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23739653363653031', 'path': '/dev/sdg'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739653363653031', 'path': '/dev/sdg'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2006001136',display_name='tempest-ServerActionsTestOtherA-server-2006001136',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2006001136',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFz77lNADA9bIEqsG+/0pmqytVknVJgn2QYVHLyikCb7OZcHj5oDk3lRMMWld0kQEG++u8j1QCo1UgVUz17EVZQY5cNigvtxWp2mZweLxgKV8OVoFjr81Ihq1bC8gLICA==',key_name='tempest-keypair-669870558',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:28:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='33a3a3412c95451db4dd0edc27f361cc',ramdisk_id='',reservation_id='r-hj2o5jsg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-514064593',owner_user_name='tempest-ServerActionsTestOtherA-514064593-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:30:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60cbe30799ad4438b84251a254691b70',uuid=98358bbf-c7c1-4868-81ee-77bd229133fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1826635397-network", "vif_mac": "fa:16:3e:81:b9:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converting VIF {"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1826635397-network", "vif_mac": "fa:16:3e:81:b9:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:b9:08,bridge_name='br-int',has_traffic_filtering=True,id=f6196531-f18f-4440-8a72-27835267e702,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6196531-f1') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:30:20 user nova-compute[72849]:   <uuid>98358bbf-c7c1-4868-81ee-77bd229133fd</uuid>
Aug 15 16:30:20 user nova-compute[72849]:   <name>instance-0000001e</name>
Aug 15 16:30:20 user nova-compute[72849]:   <memory>2097152</memory>
Aug 15 16:30:20 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:30:20 user nova-compute[72849]:   <metadata>
Aug 15 16:30:20 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:30:20 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:30:20 user nova-compute[72849]:       <nova:name>tempest-ServerActionsTestOtherA-server-2006001136</nova:name>
Aug 15 16:30:20 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:30:18</nova:creationTime>
Aug 15 16:30:20 user nova-compute[72849]:       <nova:flavor name="m1.small">
Aug 15 16:30:20 user nova-compute[72849]:         <nova:memory>2048</nova:memory>
Aug 15 16:30:20 user nova-compute[72849]:         <nova:disk>20</nova:disk>
Aug 15 16:30:20 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:30:20 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:30:20 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:30:20 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:30:20 user nova-compute[72849]:       <nova:owner>
Aug 15 16:30:20 user nova-compute[72849]:         <nova:user uuid="60cbe30799ad4438b84251a254691b70">tempest-ServerActionsTestOtherA-514064593-project-member</nova:user>
Aug 15 16:30:20 user nova-compute[72849]:         <nova:project uuid="33a3a3412c95451db4dd0edc27f361cc">tempest-ServerActionsTestOtherA-514064593</nova:project>
Aug 15 16:30:20 user nova-compute[72849]:       </nova:owner>
Aug 15 16:30:20 user nova-compute[72849]:       <nova:ports>
Aug 15 16:30:20 user nova-compute[72849]:         <nova:port uuid="f6196531-f18f-4440-8a72-27835267e702">
Aug 15 16:30:20 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 16:30:20 user nova-compute[72849]:         </nova:port>
Aug 15 16:30:20 user nova-compute[72849]:       </nova:ports>
Aug 15 16:30:20 user nova-compute[72849]:     </nova:instance>
Aug 15 16:30:20 user nova-compute[72849]:   </metadata>
Aug 15 16:30:20 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:30:20 user nova-compute[72849]:     <system>
Aug 15 16:30:20 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:30:20 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:30:20 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:30:20 user nova-compute[72849]:       <entry name="serial">98358bbf-c7c1-4868-81ee-77bd229133fd</entry>
Aug 15 16:30:20 user nova-compute[72849]:       <entry name="uuid">98358bbf-c7c1-4868-81ee-77bd229133fd</entry>
Aug 15 16:30:20 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:30:20 user nova-compute[72849]:     </system>
Aug 15 16:30:20 user nova-compute[72849]:   </sysinfo>
Aug 15 16:30:20 user nova-compute[72849]:   <os>
Aug 15 16:30:20 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:30:20 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:30:20 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:30:20 user nova-compute[72849]:   </os>
Aug 15 16:30:20 user nova-compute[72849]:   <features>
Aug 15 16:30:20 user nova-compute[72849]:     <acpi/>
Aug 15 16:30:20 user nova-compute[72849]:     <apic/>
Aug 15 16:30:20 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:30:20 user nova-compute[72849]:   </features>
Aug 15 16:30:20 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:30:20 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:30:20 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:30:20 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:30:20 user nova-compute[72849]:   </clock>
Aug 15 16:30:20 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:30:20 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:30:20 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:30:20 user nova-compute[72849]:   </cpu>
Aug 15 16:30:20 user nova-compute[72849]:   <devices>
Aug 15 16:30:20 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:30:20 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:30:20 user nova-compute[72849]:       <source dev="/dev/sdg"/>
Aug 15 16:30:20 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:30:20 user nova-compute[72849]:       <serial>5f4a35b3-572d-4c8f-b4bd-f97d7d15b792</serial>
Aug 15 16:30:20 user nova-compute[72849]:     </disk>
Aug 15 16:30:20 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:30:20 user nova-compute[72849]:       <mac address="fa:16:3e:81:b9:08"/>
Aug 15 16:30:20 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:30:20 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:30:20 user nova-compute[72849]:       <target dev="tapf6196531-f1"/>
Aug 15 16:30:20 user nova-compute[72849]:     </interface>
Aug 15 16:30:20 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:30:20 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/98358bbf-c7c1-4868-81ee-77bd229133fd/console.log" append="off"/>
Aug 15 16:30:20 user nova-compute[72849]:     </serial>
Aug 15 16:30:20 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:30:20 user nova-compute[72849]:     <video>
Aug 15 16:30:20 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:30:20 user nova-compute[72849]:     </video>
Aug 15 16:30:20 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:30:20 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:30:20 user nova-compute[72849]:     </rng>
Aug 15 16:30:20 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:30:20 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:30:20 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:30:20 user nova-compute[72849]:     </memballoon>
Aug 15 16:30:20 user nova-compute[72849]:   </devices>
Aug 15 16:30:20 user nova-compute[72849]: </domain>
Aug 15 16:30:20 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2006001136',display_name='tempest-ServerActionsTestOtherA-server-2006001136',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2006001136',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFz77lNADA9bIEqsG+/0pmqytVknVJgn2QYVHLyikCb7OZcHj5oDk3lRMMWld0kQEG++u8j1QCo1UgVUz17EVZQY5cNigvtxWp2mZweLxgKV8OVoFjr81Ihq1bC8gLICA==',key_name='tempest-keypair-669870558',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:28:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='33a3a3412c95451db4dd0edc27f361cc',ramdisk_id='',reservation_id='r-hj2o5jsg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-514064593',owner_user_name='tempest-ServerActionsTestOtherA-514064593-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:30:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60cbe30799ad4438b84251a254691b70',uuid=98358bbf-c7c1-4868-81ee-77bd229133fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1826635397-network", "vif_mac": "fa:16:3e:81:b9:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converting VIF {"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1826635397-network", "vif_mac": "fa:16:3e:81:b9:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:b9:08,bridge_name='br-int',has_traffic_filtering=True,id=f6196531-f18f-4440-8a72-27835267e702,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6196531-f1') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG os_vif [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:b9:08,bridge_name='br-int',has_traffic_filtering=True,id=f6196531-f18f-4440-8a72-27835267e702,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6196531-f1') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6196531-f1, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf6196531-f1, col_values=(('external_ids', {'iface-id': 'f6196531-f18f-4440-8a72-27835267e702', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:b9:08', 'vm-uuid': '98358bbf-c7c1-4868-81ee-77bd229133fd'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:20 user nova-compute[72849]: INFO os_vif [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:b9:08,bridge_name='br-int',has_traffic_filtering=True,id=f6196531-f18f-4440-8a72-27835267e702,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6196531-f1')
Aug 15 16:30:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:30:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] No VIF found with MAC fa:16:3e:81:b9:08, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117006.150818, 98358bbf-c7c1-4868-81ee-77bd229133fd => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:30:21 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] VM Stopped (Lifecycle Event)
Aug 15 16:30:21 user nova-compute[72849]: DEBUG nova.compute.manager [None req-fb2c3f42-26dd-4de1-9a8d-13241638cd0c None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-9df32405-d4df-40be-bafb-046b21c03990 req-7d319c0a-8870-44f5-8f99-3007eb012882 service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Received event network-changed-601b3faf-ad9f-4219-8f5c-bd7cca827303 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-9df32405-d4df-40be-bafb-046b21c03990 req-7d319c0a-8870-44f5-8f99-3007eb012882 service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Refreshing instance network info cache due to event network-changed-601b3faf-ad9f-4219-8f5c-bd7cca827303. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9df32405-d4df-40be-bafb-046b21c03990 req-7d319c0a-8870-44f5-8f99-3007eb012882 service nova] Acquiring lock "refresh_cache-306a1d17-459d-42cb-b575-fceae948fa79" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9df32405-d4df-40be-bafb-046b21c03990 req-7d319c0a-8870-44f5-8f99-3007eb012882 service nova] Acquired lock "refresh_cache-306a1d17-459d-42cb-b575-fceae948fa79" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG nova.network.neutron [req-9df32405-d4df-40be-bafb-046b21c03990 req-7d319c0a-8870-44f5-8f99-3007eb012882 service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Refreshing network info cache for port 601b3faf-ad9f-4219-8f5c-bd7cca827303 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-a9f2ae65-cb0c-45fe-9730-93405119ecb8 req-53b5d9f0-3fb5-43e0-b6a7-0d17650b88cd service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received event network-vif-unplugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a9f2ae65-cb0c-45fe-9730-93405119ecb8 req-53b5d9f0-3fb5-43e0-b6a7-0d17650b88cd service nova] Acquiring lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a9f2ae65-cb0c-45fe-9730-93405119ecb8 req-53b5d9f0-3fb5-43e0-b6a7-0d17650b88cd service nova] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a9f2ae65-cb0c-45fe-9730-93405119ecb8 req-53b5d9f0-3fb5-43e0-b6a7-0d17650b88cd service nova] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-a9f2ae65-cb0c-45fe-9730-93405119ecb8 req-53b5d9f0-3fb5-43e0-b6a7-0d17650b88cd service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] No waiting events found dispatching network-vif-unplugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:30:21 user nova-compute[72849]: WARNING nova.compute.manager [req-a9f2ae65-cb0c-45fe-9730-93405119ecb8 req-53b5d9f0-3fb5-43e0-b6a7-0d17650b88cd service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received unexpected event network-vif-unplugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 for instance with vm_state active and task_state reboot_started.
Aug 15 16:30:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-c8627679-679a-4d6f-a0a2-bd35c9e1dc9c req-78f099d1-8c0b-4165-befc-746e34a1c4eb service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received event network-vif-plugged-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c8627679-679a-4d6f-a0a2-bd35c9e1dc9c req-78f099d1-8c0b-4165-befc-746e34a1c4eb service nova] Acquiring lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c8627679-679a-4d6f-a0a2-bd35c9e1dc9c req-78f099d1-8c0b-4165-befc-746e34a1c4eb service nova] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c8627679-679a-4d6f-a0a2-bd35c9e1dc9c req-78f099d1-8c0b-4165-befc-746e34a1c4eb service nova] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-c8627679-679a-4d6f-a0a2-bd35c9e1dc9c req-78f099d1-8c0b-4165-befc-746e34a1c4eb service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] No waiting events found dispatching network-vif-plugged-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:30:22 user nova-compute[72849]: WARNING nova.compute.manager [req-c8627679-679a-4d6f-a0a2-bd35c9e1dc9c req-78f099d1-8c0b-4165-befc-746e34a1c4eb service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received unexpected event network-vif-plugged-f6196531-f18f-4440-8a72-27835267e702 for instance with vm_state active and task_state resize_finish.
Aug 15 16:30:22 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-78c0d077-cc03-4f5a-ba0c-8f37ed47fb88 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Instance shutdown successfully.
Aug 15 16:30:22 user nova-compute[72849]: DEBUG nova.network.neutron [req-9df32405-d4df-40be-bafb-046b21c03990 req-7d319c0a-8870-44f5-8f99-3007eb012882 service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Updated VIF entry in instance network info cache for port 601b3faf-ad9f-4219-8f5c-bd7cca827303. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:30:22 user nova-compute[72849]: DEBUG nova.network.neutron [req-9df32405-d4df-40be-bafb-046b21c03990 req-7d319c0a-8870-44f5-8f99-3007eb012882 service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Updating instance_info_cache with network_info: [{"id": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "address": "fa:16:3e:71:db:6d", "network": {"id": "8c8e3ae7-d19d-4b52-8a73-b63a569ab9b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-915203707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c15369c3d34f9d850252762620f9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap601b3faf-ad", "ovs_interfaceid": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:30:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9df32405-d4df-40be-bafb-046b21c03990 req-7d319c0a-8870-44f5-8f99-3007eb012882 service nova] Releasing lock "refresh_cache-306a1d17-459d-42cb-b575-fceae948fa79" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:30:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:23 user nova-compute[72849]: DEBUG nova.compute.manager [req-ead6f51d-7288-42b5-b2a8-48a8d7d2b853 req-49d22fd0-fbb1-4bc5-ac55-6aa9634c0755 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received event network-vif-plugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ead6f51d-7288-42b5-b2a8-48a8d7d2b853 req-49d22fd0-fbb1-4bc5-ac55-6aa9634c0755 service nova] Acquiring lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ead6f51d-7288-42b5-b2a8-48a8d7d2b853 req-49d22fd0-fbb1-4bc5-ac55-6aa9634c0755 service nova] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ead6f51d-7288-42b5-b2a8-48a8d7d2b853 req-49d22fd0-fbb1-4bc5-ac55-6aa9634c0755 service nova] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:23 user nova-compute[72849]: DEBUG nova.compute.manager [req-ead6f51d-7288-42b5-b2a8-48a8d7d2b853 req-49d22fd0-fbb1-4bc5-ac55-6aa9634c0755 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] No waiting events found dispatching network-vif-plugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:30:23 user nova-compute[72849]: WARNING nova.compute.manager [req-ead6f51d-7288-42b5-b2a8-48a8d7d2b853 req-49d22fd0-fbb1-4bc5-ac55-6aa9634c0755 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received unexpected event network-vif-plugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 for instance with vm_state active and task_state reboot_started.
Aug 15 16:30:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-5597e0a5-45db-487f-a7bd-5c3b8187d139 req-9fecb550-a16c-438d-b396-6436bfa5e9f9 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received event network-vif-plugged-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5597e0a5-45db-487f-a7bd-5c3b8187d139 req-9fecb550-a16c-438d-b396-6436bfa5e9f9 service nova] Acquiring lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5597e0a5-45db-487f-a7bd-5c3b8187d139 req-9fecb550-a16c-438d-b396-6436bfa5e9f9 service nova] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5597e0a5-45db-487f-a7bd-5c3b8187d139 req-9fecb550-a16c-438d-b396-6436bfa5e9f9 service nova] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-5597e0a5-45db-487f-a7bd-5c3b8187d139 req-9fecb550-a16c-438d-b396-6436bfa5e9f9 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] No waiting events found dispatching network-vif-plugged-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:30:24 user nova-compute[72849]: WARNING nova.compute.manager [req-5597e0a5-45db-487f-a7bd-5c3b8187d139 req-9fecb550-a16c-438d-b396-6436bfa5e9f9 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received unexpected event network-vif-plugged-f6196531-f18f-4440-8a72-27835267e702 for instance with vm_state active and task_state resize_finish.
Aug 15 16:30:24 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117024.306731, 98358bbf-c7c1-4868-81ee-77bd229133fd => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:30:24 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] VM Resumed (Lifecycle Event)
Aug 15 16:30:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:30:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:24 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Instance running successfully.
Aug 15 16:30:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Failed to set time: agent not configured {{(pid=72849) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 15 16:30:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3944d8ae-6d43-4f9a-85f6-c0269ee944d5 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] finish_migration finished successfully. {{(pid=72849) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 15 16:30:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:30:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:30:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:24 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 16:30:24 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117024.3082647, 98358bbf-c7c1-4868-81ee-77bd229133fd => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:30:24 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] VM Started (Lifecycle Event)
Aug 15 16:30:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:30:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:30:24 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 16:30:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-d7a4c4b6-0013-49de-b869-fe161d00d0ac req-4664635b-5ea7-48f4-9f61-8b823e72b38e service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received event network-vif-plugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d7a4c4b6-0013-49de-b869-fe161d00d0ac req-4664635b-5ea7-48f4-9f61-8b823e72b38e service nova] Acquiring lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d7a4c4b6-0013-49de-b869-fe161d00d0ac req-4664635b-5ea7-48f4-9f61-8b823e72b38e service nova] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d7a4c4b6-0013-49de-b869-fe161d00d0ac req-4664635b-5ea7-48f4-9f61-8b823e72b38e service nova] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-d7a4c4b6-0013-49de-b869-fe161d00d0ac req-4664635b-5ea7-48f4-9f61-8b823e72b38e service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] No waiting events found dispatching network-vif-plugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:30:25 user nova-compute[72849]: WARNING nova.compute.manager [req-d7a4c4b6-0013-49de-b869-fe161d00d0ac req-4664635b-5ea7-48f4-9f61-8b823e72b38e service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received unexpected event network-vif-plugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 for instance with vm_state active and task_state reboot_started.
Aug 15 16:30:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-d7a4c4b6-0013-49de-b869-fe161d00d0ac req-4664635b-5ea7-48f4-9f61-8b823e72b38e service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received event network-vif-plugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d7a4c4b6-0013-49de-b869-fe161d00d0ac req-4664635b-5ea7-48f4-9f61-8b823e72b38e service nova] Acquiring lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d7a4c4b6-0013-49de-b869-fe161d00d0ac req-4664635b-5ea7-48f4-9f61-8b823e72b38e service nova] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d7a4c4b6-0013-49de-b869-fe161d00d0ac req-4664635b-5ea7-48f4-9f61-8b823e72b38e service nova] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-d7a4c4b6-0013-49de-b869-fe161d00d0ac req-4664635b-5ea7-48f4-9f61-8b823e72b38e service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] No waiting events found dispatching network-vif-plugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:30:25 user nova-compute[72849]: WARNING nova.compute.manager [req-d7a4c4b6-0013-49de-b869-fe161d00d0ac req-4664635b-5ea7-48f4-9f61-8b823e72b38e service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received unexpected event network-vif-plugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 for instance with vm_state active and task_state reboot_started.
Aug 15 16:30:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Removed pending event for 82f61128-3af4-4f82-ac4c-8ee746b5a829 due to event {{(pid=72849) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 16:30:26 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117026.0758493, 82f61128-3af4-4f82-ac4c-8ee746b5a829 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:30:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] VM Resumed (Lifecycle Event)
Aug 15 16:30:26 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Instance running successfully.
Aug 15 16:30:26 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-78c0d077-cc03-4f5a-ba0c-8f37ed47fb88 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Instance soft rebooted successfully.
Aug 15 16:30:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-78c0d077-cc03-4f5a-ba0c-8f37ed47fb88 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:30:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:30:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:30:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 15 16:30:26 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117026.0769155, 82f61128-3af4-4f82-ac4c-8ee746b5a829 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:30:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] VM Started (Lifecycle Event)
Aug 15 16:30:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:30:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-78c0d077-cc03-4f5a-ba0c-8f37ed47fb88 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.758s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:30:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Acquiring lock "306a1d17-459d-42cb-b575-fceae948fa79" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "306a1d17-459d-42cb-b575-fceae948fa79" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:26 user nova-compute[72849]: DEBUG nova.objects.instance [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lazy-loading 'flavor' on Instance uuid 306a1d17-459d-42cb-b575-fceae948fa79 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:30:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "306a1d17-459d-42cb-b575-fceae948fa79" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Acquiring lock "306a1d17-459d-42cb-b575-fceae948fa79" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "306a1d17-459d-42cb-b575-fceae948fa79" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:27 user nova-compute[72849]: INFO nova.compute.manager [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Attaching volume 61322d9a-d6f1-4ad5-99bc-161453081843 to /dev/vdb
Aug 15 16:30:27 user nova-compute[72849]: DEBUG os_brick.utils [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[190ea898-92da-4458-b2df-c56fa53be181]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd4cf59-164c-43e2-b049-25cbed145eef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca85199-5a7e-475d-b404-ab0661d2380b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c07090-8970-412f-a759-bcf75c2dbba4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:30:27 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:30:27 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e65250b-4294-4983-b1a6-16a2bd67b376]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG os_brick.utils [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:30:27 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Updating existing volume attachment record: 1600665b-b5a5-4e99-967c-c48531f441f6 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:30:28 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:30:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:29 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:30:29 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:30:29 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Didn't find any instances for network info cache update. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 16:30:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:32 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:30:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:30:32 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:30:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:32 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:30:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:30:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:30:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:30:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966c2c1f-fa7a-4cea-a007-254562c6fc3b/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "0900e8d0-6e7f-40a3-9016-39851e697d09" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:37 user nova-compute[72849]: INFO nova.compute.manager [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Unshelving
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966c2c1f-fa7a-4cea-a007-254562c6fc3b/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966c2c1f-fa7a-4cea-a007-254562c6fc3b/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:37 user nova-compute[72849]: INFO nova.virt.block_device [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Booting with volume 01844056-f830-4161-b587-6dd5728c9605 at /dev/vdc
Aug 15 16:30:37 user nova-compute[72849]: DEBUG os_brick.utils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GQrwPNeO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:30:37 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:30:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:30:37 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:30:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:30:37 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0025748-fda3-4698-b156-11c099775e12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966c2c1f-fa7a-4cea-a007-254562c6fc3b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f1c904-8ba4-4f11-929e-1fb91418fee1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbd89a2-7110-4d9c-b5ce-aeafab2e5767]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:30:37 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fc6ce7-7865-47a3-8311-3dbe51aa45f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b5a2d4-032a-49f1-9011-05a626046b3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6657e99c-4998-466a-82a0-5c6c4cf716dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843] added
Aug 15 16:30:37 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:30:37 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8abe3cd-2060-4cd9-83ec-a9cfb2736be9]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG os_brick.utils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Updating existing volume attachment record: 0dee56cc-fe20-4314-aa72-9957fa881d96 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.048s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d433579-dc5a-4473-87e3-2519e78d8506]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74bf657-d277-4618-8749-825c1fbeb151]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GQrwPNeO {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GQrwPNeO" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf43e65-0783-4b9a-a51a-863ca0e2c3bc]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GQrwPNeO'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[25559693-aef8-4b36-8494-eb7bbf750c5a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5b828b-7d82-4e08-b8ae-66049dbbc1bb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:30:38 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:30:38 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[30888bb0-219f-4131-86d8-999e0ddf913b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843, portal: 172.16.0.220,3260]
Aug 15 16:30:38 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843, portal: 172.16.0.220,3260] successful.
Aug 15 16:30:38 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5807f01-053e-4128-9106-b9a2b5ee3cb1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fddc680-3fce-41fe-b3b8-2ddc0c0082ab]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 (non-flash)
Aug 15 16:30:38 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:30:38 user nova-compute[72849]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 (non-flash)
Aug 15 16:30:38 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.507s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] HCTL ('39', '-', '-', 0) found on session 34 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2440e4-4f58-46d4-b148-98ef80a36bb2]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Searching for a device in session 34 and hctl ['39', '*', '*', 0] yield: None {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:39 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:30:39 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=6598MB free_disk=24.91714859008789GB free_vcpus=-4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Applying migration context for instance 98358bbf-c7c1-4868-81ee-77bd229133fd as it has an incoming, in-progress migration 86b2553f-a993-4cd4-b9e1-b03bf07e7682. Migration status is finished {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 16:30:39 user nova-compute[72849]: INFO nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Updating resource usage from migration 86b2553f-a993-4cd4-b9e1-b03bf07e7682
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc521d87-09aa-44ba-a87c-1cd5517b3707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 46f0aa43-e313-4aff-bacc-aa5290193b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance a3221960-e5ff-4185-a5dd-09f2cd293cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance d51623f1-6613-41d6-abcb-9e4e626a97af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f1da55ae-5150-476c-a229-f26ddfee7e9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 15aa3de5-baee-4d40-8610-1bd08249c837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance ea9d5a00-42db-41e4-bb81-b3875e84f16c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 82f61128-3af4-4f82-ac4c-8ee746b5a829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 306a1d17-459d-42cb-b575-fceae948fa79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 98bcb43e-a0d9-41f1-9976-01c9e8084ae6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b15c5692-8c0c-4bf0-a79f-b7813e71de9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 966c2c1f-fa7a-4cea-a007-254562c6fc3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Migration 86b2553f-a993-4cd4-b9e1-b03bf07e7682 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 98358bbf-c7c1-4868-81ee-77bd229133fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0900e8d0-6e7f-40a3-9016-39851e697d09 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 17 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=10752MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=17 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Searching for a device in session 34 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GQrwPNeO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.538s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] <== connect_volume: return (1540ms) {'type': 'block', 'scsi_wwn': '23863386563656632', 'path': '/dev/sdh'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863386563656632', 'path': '/dev/sdh'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.objects.instance [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lazy-loading 'flavor' on Instance uuid 306a1d17-459d-42cb-b575-fceae948fa79 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:30:39 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:30:39 user nova-compute[72849]:   <source dev="/dev/sdh"/>
Aug 15 16:30:39 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:30:39 user nova-compute[72849]:   <serial>61322d9a-d6f1-4ad5-99bc-161453081843</serial>
Aug 15 16:30:39 user nova-compute[72849]: </disk>
Aug 15 16:30:39 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.756s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] No VIF found with MAC fa:16:3e:71:db:6d, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:30:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-aa5ad880-751c-4315-8acd-bc4b47c046a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "306a1d17-459d-42cb-b575-fceae948fa79" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.798s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:40 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:30:40 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:30:40 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:30:40 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:30:40 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:30:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-ae486dd9-1c70-427e-93bb-d29e34a5d589 req-9c99515e-0dd0-4fb0-9186-99db9000b379 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received event network-changed-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-ae486dd9-1c70-427e-93bb-d29e34a5d589 req-9c99515e-0dd0-4fb0-9186-99db9000b379 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Refreshing instance network info cache due to event network-changed-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:30:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ae486dd9-1c70-427e-93bb-d29e34a5d589 req-9c99515e-0dd0-4fb0-9186-99db9000b379 service nova] Acquiring lock "refresh_cache-98bcb43e-a0d9-41f1-9976-01c9e8084ae6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:30:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ae486dd9-1c70-427e-93bb-d29e34a5d589 req-9c99515e-0dd0-4fb0-9186-99db9000b379 service nova] Acquired lock "refresh_cache-98bcb43e-a0d9-41f1-9976-01c9e8084ae6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:30:41 user nova-compute[72849]: DEBUG nova.network.neutron [req-ae486dd9-1c70-427e-93bb-d29e34a5d589 req-9c99515e-0dd0-4fb0-9186-99db9000b379 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Refreshing network info cache for port 2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:30:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:41 user nova-compute[72849]: INFO nova.compute.manager [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Terminating instance
Aug 15 16:30:41 user nova-compute[72849]: DEBUG nova.compute.manager [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:30:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG nova.network.neutron [req-ae486dd9-1c70-427e-93bb-d29e34a5d589 req-9c99515e-0dd0-4fb0-9186-99db9000b379 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Updated VIF entry in instance network info cache for port 2dccbc88-ff38-4ce9-b8e2-e1441cd2d005. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG nova.network.neutron [req-ae486dd9-1c70-427e-93bb-d29e34a5d589 req-9c99515e-0dd0-4fb0-9186-99db9000b379 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Updating instance_info_cache with network_info: [{"id": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "address": "fa:16:3e:ec:02:90", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dccbc88-ff", "ovs_interfaceid": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Acquiring lock "306a1d17-459d-42cb-b575-fceae948fa79" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "306a1d17-459d-42cb-b575-fceae948fa79" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:42 user nova-compute[72849]: INFO nova.compute.manager [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Detaching volume 61322d9a-d6f1-4ad5-99bc-161453081843
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ae486dd9-1c70-427e-93bb-d29e34a5d589 req-9c99515e-0dd0-4fb0-9186-99db9000b379 service nova] Releasing lock "refresh_cache-98bcb43e-a0d9-41f1-9976-01c9e8084ae6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG nova.compute.manager [req-30db4893-19d1-4fbe-b052-c4fdcbcd7cd0 req-2db65ba0-ee6e-432f-94a6-504fabc467ed service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received event network-vif-unplugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-30db4893-19d1-4fbe-b052-c4fdcbcd7cd0 req-2db65ba0-ee6e-432f-94a6-504fabc467ed service nova] Acquiring lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-30db4893-19d1-4fbe-b052-c4fdcbcd7cd0 req-2db65ba0-ee6e-432f-94a6-504fabc467ed service nova] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-30db4893-19d1-4fbe-b052-c4fdcbcd7cd0 req-2db65ba0-ee6e-432f-94a6-504fabc467ed service nova] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG nova.compute.manager [req-30db4893-19d1-4fbe-b052-c4fdcbcd7cd0 req-2db65ba0-ee6e-432f-94a6-504fabc467ed service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] No waiting events found dispatching network-vif-unplugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG nova.compute.manager [req-30db4893-19d1-4fbe-b052-c4fdcbcd7cd0 req-2db65ba0-ee6e-432f-94a6-504fabc467ed service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received event network-vif-unplugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:42 user nova-compute[72849]: INFO nova.virt.block_device [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Attempting to driver detach volume 61322d9a-d6f1-4ad5-99bc-161453081843 from mountpoint /dev/vdb
Aug 15 16:30:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Attempting to detach device vdb from instance 306a1d17-459d-42cb-b575-fceae948fa79 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:30:42 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:30:42 user nova-compute[72849]:   <source dev="/dev/sdh"/>
Aug 15 16:30:42 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:30:42 user nova-compute[72849]:   <serial>61322d9a-d6f1-4ad5-99bc-161453081843</serial>
Aug 15 16:30:42 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:30:42 user nova-compute[72849]: </disk>
Aug 15 16:30:42 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:30:42 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Successfully detached device vdb from instance 306a1d17-459d-42cb-b575-fceae948fa79 from the persistent domain config.
Aug 15 16:30:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 306a1d17-459d-42cb-b575-fceae948fa79 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:30:42 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:30:42 user nova-compute[72849]:   <source dev="/dev/sdh"/>
Aug 15 16:30:42 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:30:42 user nova-compute[72849]:   <serial>61322d9a-d6f1-4ad5-99bc-161453081843</serial>
Aug 15 16:30:42 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:30:42 user nova-compute[72849]: </disk>
Aug 15 16:30:42 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692117042.7556038, 306a1d17-459d-42cb-b575-fceae948fa79 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 306a1d17-459d-42cb-b575-fceae948fa79 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:30:42 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Successfully detached device vdb from instance 306a1d17-459d-42cb-b575-fceae948fa79 from the live domain config.
Aug 15 16:30:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GQrwPNeO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:30:42 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:30:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:42 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Instance destroyed successfully.
Aug 15 16:30:42 user nova-compute[72849]: DEBUG nova.objects.instance [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'resources' on Instance uuid 98bcb43e-a0d9-41f1-9976-01c9e8084ae6 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-918812091',display_name='tempest-AttachVolumeNegativeTest-server-918812091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-918812091',id=32,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyGLsm6yzY1zNlYqVryoJWRUN1PvWpKrg1furcT1TR3do/V13JeUQnnR5Yks5f5ozG9E8YResqnY1fMBd0IH1a1OE+Q0iKYnxoOrBtBMDe4wN94JzSNL2WOSAjBQ+Ierg==',key_name='tempest-keypair-1464382446',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:28:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0ddd223976e4b13a3b6a5638846f83a',ramdisk_id='',reservation_id='r-s8dr0bcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-693282259',owner_user_name='tempest-AttachVolumeNegativeTest-693282259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:28:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e99eefba54014b9ea83f1611b02efaad',uuid=98bcb43e-a0d9-41f1-9976-01c9e8084ae6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "address": "fa:16:3e:ec:02:90", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dccbc88-ff", "ovs_interfaceid": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converting VIF {"id": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "address": "fa:16:3e:ec:02:90", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dccbc88-ff", "ovs_interfaceid": "2dccbc88-ff38-4ce9-b8e2-e1441cd2d005", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:02:90,bridge_name='br-int',has_traffic_filtering=True,id=2dccbc88-ff38-4ce9-b8e2-e1441cd2d005,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dccbc88-ff') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG os_vif [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:02:90,bridge_name='br-int',has_traffic_filtering=True,id=2dccbc88-ff38-4ce9-b8e2-e1441cd2d005,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dccbc88-ff') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ca0492-edd8-481f-986b-74ecdc93760a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dccbc88-ff, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:30:42 user nova-compute[72849]: INFO os_vif [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:02:90,bridge_name='br-int',has_traffic_filtering=True,id=2dccbc88-ff38-4ce9-b8e2-e1441cd2d005,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dccbc88-ff')
Aug 15 16:30:42 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Deleting instance files /opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6_del
Aug 15 16:30:42 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Deletion of /opt/stack/data/nova/instances/98bcb43e-a0d9-41f1-9976-01c9e8084ae6_del complete
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ecabe6-361e-43be-87cc-b49219f9531c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:42 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:42 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:42 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:42 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:30:42 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:30:42 user nova-compute[72849]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 (non-flash)
Aug 15 16:30:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:42 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:42 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:42 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:42 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:30:42 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:30:42 user nova-compute[72849]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 (non-flash)
Aug 15 16:30:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3582a3d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843'): ({'sdh'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Removing single pathed devices sdh {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ae5982-fc71-4cb9-8f33-df272c2fedcd]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ff8533-62ec-43fb-a185-a081f1beeae6]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Flushing IO for device /dev/sdh {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:42 user nova-compute[72849]: INFO nova.compute.manager [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b8e8c5-9e70-4420-902c-2bb49fc391df]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0108d9c-6777-488f-ac52-277a5c89817e]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] SCSI volumes sdh have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bb0918-d298-4c81-8c12-ebbd0a4cafd6]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fc8825-b3c9-4160-96c0-606ac9b86210]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843, portal: 172.16.0.220,3260]
Aug 15 16:30:43 user nova-compute[72849]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843, portal: 172.16.0.220,3260] successful.
Aug 15 16:30:43 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61322d9a-d6f1-4ad5-99bc-161453081843 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec0238d-a42f-4973-bae5-3925c35ca6e4]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:30:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] <== disconnect_volume: return (342ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:30:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:30:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:43 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:30:43 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Took 0.91 seconds to deallocate network for instance.
Aug 15 16:30:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-9ac0426c-5ca7-4420-af27-7f1bf4f4f5ec req-54abeb4e-92b7-47bb-a2c4-9d30c82b5236 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received event network-vif-deleted-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:43 user nova-compute[72849]: INFO nova.compute.manager [req-9ac0426c-5ca7-4420-af27-7f1bf4f4f5ec req-54abeb4e-92b7-47bb-a2c4-9d30c82b5236 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Neutron deleted interface 2dccbc88-ff38-4ce9-b8e2-e1441cd2d005; detaching it from the instance and deleting it from the info cache
Aug 15 16:30:43 user nova-compute[72849]: DEBUG nova.network.neutron [req-9ac0426c-5ca7-4420-af27-7f1bf4f4f5ec req-54abeb4e-92b7-47bb-a2c4-9d30c82b5236 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:30:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-9ac0426c-5ca7-4420-af27-7f1bf4f4f5ec req-54abeb4e-92b7-47bb-a2c4-9d30c82b5236 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Detach interface failed, port_id=2dccbc88-ff38-4ce9-b8e2-e1441cd2d005, reason: Instance 98bcb43e-a0d9-41f1-9976-01c9e8084ae6 could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:30:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:43 user nova-compute[72849]: DEBUG nova.objects.instance [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lazy-loading 'flavor' on Instance uuid 306a1d17-459d-42cb-b575-fceae948fa79 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-83a9f1a1-0d1c-4877-9e6a-9f1dce7985f1 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "306a1d17-459d-42cb-b575-fceae948fa79" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.929s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received event network-vif-plugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] Acquiring lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] No waiting events found dispatching network-vif-plugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:30:44 user nova-compute[72849]: WARNING nova.compute.manager [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received unexpected event network-vif-plugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 for instance with vm_state deleted and task_state None.
Aug 15 16:30:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received event network-vif-plugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] Acquiring lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] No waiting events found dispatching network-vif-plugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:30:44 user nova-compute[72849]: WARNING nova.compute.manager [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received unexpected event network-vif-plugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 for instance with vm_state deleted and task_state None.
Aug 15 16:30:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received event network-vif-plugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] Acquiring lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] No waiting events found dispatching network-vif-plugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:30:44 user nova-compute[72849]: WARNING nova.compute.manager [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received unexpected event network-vif-plugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 for instance with vm_state deleted and task_state None.
Aug 15 16:30:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received event network-vif-unplugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] Acquiring lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] No waiting events found dispatching network-vif-unplugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:30:44 user nova-compute[72849]: WARNING nova.compute.manager [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received unexpected event network-vif-unplugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 for instance with vm_state deleted and task_state None.
Aug 15 16:30:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received event network-vif-plugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] Acquiring lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] No waiting events found dispatching network-vif-plugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:30:44 user nova-compute[72849]: WARNING nova.compute.manager [req-4563c15c-0904-4fc0-9298-d62ebdb30a65 req-575b3dab-80a6-4fdf-91d8-e392c53e12a6 service nova] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Received unexpected event network-vif-plugged-2dccbc88-ff38-4ce9-b8e2-e1441cd2d005 for instance with vm_state deleted and task_state None.
Aug 15 16:30:44 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:30:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:44 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Deleted allocations for instance 98bcb43e-a0d9-41f1-9976-01c9e8084ae6
Aug 15 16:30:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-eea0713c-d836-4d19-a00c-77116500aa32 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "98bcb43e-a0d9-41f1-9976-01c9e8084ae6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.692s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:48 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'pci_requests' on Instance uuid 0900e8d0-6e7f-40a3-9016-39851e697d09 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:30:48 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'numa_topology' on Instance uuid 0900e8d0-6e7f-40a3-9016-39851e697d09 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:30:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:30:48 user nova-compute[72849]: INFO nova.compute.claims [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Claim successful on node user
Aug 15 16:30:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:48 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:30:48 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:30:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:48 user nova-compute[72849]: INFO nova.network.neutron [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Updating port 58268f65-6b08-4cdd-9ae3-b256ed150e60 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 16:30:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:30:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquired lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:30:49 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:30:49 user nova-compute[72849]: DEBUG nova.compute.manager [req-8ac19cfe-76dc-484c-ae0a-2c4e270e49e2 req-a6ef30cc-05e0-4956-90d0-6c1f848bc7c9 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received event network-changed-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:49 user nova-compute[72849]: DEBUG nova.compute.manager [req-8ac19cfe-76dc-484c-ae0a-2c4e270e49e2 req-a6ef30cc-05e0-4956-90d0-6c1f848bc7c9 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Refreshing instance network info cache due to event network-changed-58268f65-6b08-4cdd-9ae3-b256ed150e60. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:30:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8ac19cfe-76dc-484c-ae0a-2c4e270e49e2 req-a6ef30cc-05e0-4956-90d0-6c1f848bc7c9 service nova] Acquiring lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:30:49 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Updating instance_info_cache with network_info: [{"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:30:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Releasing lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:30:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:30:50 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Creating image(s)
Aug 15 16:30:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "/opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "/opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "/opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:50 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0900e8d0-6e7f-40a3-9016-39851e697d09 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:30:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8ac19cfe-76dc-484c-ae0a-2c4e270e49e2 req-a6ef30cc-05e0-4956-90d0-6c1f848bc7c9 service nova] Acquired lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:30:50 user nova-compute[72849]: DEBUG nova.network.neutron [req-8ac19cfe-76dc-484c-ae0a-2c4e270e49e2 req-a6ef30cc-05e0-4956-90d0-6c1f848bc7c9 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Refreshing network info cache for port 58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:30:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e.part --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e.part --force-share --output=json" returned: 0 in 0.262s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:51 user nova-compute[72849]: DEBUG nova.virt.images [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] 55b05045-695a-40fe-b6d6-f0e655728485 was qcow2, converting to raw {{(pid=72849) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 16:30:51 user nova-compute[72849]: DEBUG nova.privsep.utils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72849) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 16:30:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e.part /opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e.converted {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e.part /opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e.converted" returned: 0 in 0.468s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e.converted --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:51 user nova-compute[72849]: DEBUG nova.network.neutron [req-8ac19cfe-76dc-484c-ae0a-2c4e270e49e2 req-a6ef30cc-05e0-4956-90d0-6c1f848bc7c9 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Updated VIF entry in instance network info cache for port 58268f65-6b08-4cdd-9ae3-b256ed150e60. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:30:51 user nova-compute[72849]: DEBUG nova.network.neutron [req-8ac19cfe-76dc-484c-ae0a-2c4e270e49e2 req-a6ef30cc-05e0-4956-90d0-6c1f848bc7c9 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Updating instance_info_cache with network_info: [{"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:30:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8ac19cfe-76dc-484c-ae0a-2c4e270e49e2 req-a6ef30cc-05e0-4956-90d0-6c1f848bc7c9 service nova] Releasing lock "refresh_cache-0900e8d0-6e7f-40a3-9016-39851e697d09" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:30:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.918s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e --force-share --output=json" returned: 0 in 0.177s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e --force-share --output=json" returned: 0 in 0.176s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e,backing_fmt=raw /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e,backing_fmt=raw /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk 1073741824" returned: 0 in 0.047s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e --force-share --output=json" returned: 0 in 0.167s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:52 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'migration_context' on Instance uuid 0900e8d0-6e7f-40a3-9016-39851e697d09 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:30:52 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Rebasing disk image.
Aug 15 16:30:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.185s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:52 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 -F raw /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 -F raw /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk" returned: 0 in 2.732s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Ensure instance console log exists: /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Start _get_guest_xml network_info=[{"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='cb6e79d3280e0334e5c042c44341f827',container_format='bare',created_at=2023-08-15T16:28:44Z,direct_url=<?>,disk_format='qcow2',id=55b05045-695a-40fe-b6d6-f0e655728485,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1356134043-shelved',owner='1bb636c3c71c479d90cf2e170db941e1',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T16:28:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yKHRAjgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '0900e8d0-6e7f-40a3-9016-39851e697d09', 'attached_at': '', 'detached_at': '', 'volume_id': '01844056-f830-4161-b587-6dd5728c9605', 'serial': '01844056-f830-4161-b587-6dd5728c9605'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '0dee56cc-fe20-4314-aa72-9957fa881d96', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:30:55 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:30:55 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cb6e79d3280e0334e5c042c44341f827',container_format='bare',created_at=2023-08-15T16:28:44Z,direct_url=<?>,disk_format='qcow2',id=55b05045-695a-40fe-b6d6-f0e655728485,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1356134043-shelved',owner='1bb636c3c71c479d90cf2e170db941e1',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T16:28:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0900e8d0-6e7f-40a3-9016-39851e697d09 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yKHRAjgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:30:55 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:30:55 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:30:55 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd62795-f4cb-4e36-ab87-53fc4289eac2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:30:55 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec83981-c289-495f-82f6-0bd303b5351b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605] added
Aug 15 16:30:55 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c269fa-813e-42cb-8942-40e00f5e2c6d]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b08925a-c7e2-43c8-b468-eaeadb0f9d73]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yKHRAjgi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yKHRAjgi" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcec58b4-19fa-4a0b-8ec2-4c86e126dac1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yKHRAjgi'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[342f0441-d0ae-4b5f-b5c4-b6ae3e9b7b46]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[61168fa0-4d70-4d36-9b1d-bab769bd614a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:30:55 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:30:55 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9525e28-40f7-44fe-8731-10e0d9941894]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605, portal: 172.16.0.220,3260]
Aug 15 16:30:55 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605, portal: 172.16.0.220,3260] successful.
Aug 15 16:30:55 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[799c4058-0a37-461f-a684-8e4d781eb147]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b2949b-4fba-4be5-840a-e90a0c4b3a02]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)
Aug 15 16:30:55 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:30:55 user nova-compute[72849]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)
Aug 15 16:30:55 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] HCTL ('39', '-', '-', 0) found on session 35 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3304468f-9064-481b-9a12-deb72965e3e3]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Searching for a device in session 35 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:30:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yKHRAjgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23730396438616130', 'path': '/dev/sdh'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730396438616130', 'path': '/dev/sdh'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T16:26:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1356134043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1356134043',id=27,image_ref='55b05045-695a-40fe-b6d6-f0e655728485',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1318766870',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:26:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1bb636c3c71c479d90cf2e170db941e1',ramdisk_id='',reservation_id='r-ik1in1jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1263463439',owner_user_name='tempest-AttachVolumeShelveTestJSON-1263463439-project-member',shelved_at='2023-08-15T16:28:49.373659',shelved_host='user',shelved_image_id='55b05045-695a-40fe-b6d6-f0e655728485'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:30:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867f247fc90437899a13a7451a3249a',uuid=0900e8d0-6e7f-40a3-9016-39851e697d09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converting VIF {"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:64:c5,bridge_name='br-int',has_traffic_filtering=True,id=58268f65-6b08-4cdd-9ae3-b256ed150e60,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58268f65-6b') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'pci_devices' on Instance uuid 0900e8d0-6e7f-40a3-9016-39851e697d09 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:30:56 user nova-compute[72849]:   <uuid>0900e8d0-6e7f-40a3-9016-39851e697d09</uuid>
Aug 15 16:30:56 user nova-compute[72849]:   <name>instance-0000001b</name>
Aug 15 16:30:56 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:30:56 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:30:56 user nova-compute[72849]:   <metadata>
Aug 15 16:30:56 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:30:56 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:30:56 user nova-compute[72849]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1356134043</nova:name>
Aug 15 16:30:56 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:30:55</nova:creationTime>
Aug 15 16:30:56 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:30:56 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:30:56 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:30:56 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:30:56 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:30:56 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:30:56 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:30:56 user nova-compute[72849]:       <nova:owner>
Aug 15 16:30:56 user nova-compute[72849]:         <nova:user uuid="e867f247fc90437899a13a7451a3249a">tempest-AttachVolumeShelveTestJSON-1263463439-project-member</nova:user>
Aug 15 16:30:56 user nova-compute[72849]:         <nova:project uuid="1bb636c3c71c479d90cf2e170db941e1">tempest-AttachVolumeShelveTestJSON-1263463439</nova:project>
Aug 15 16:30:56 user nova-compute[72849]:       </nova:owner>
Aug 15 16:30:56 user nova-compute[72849]:       <nova:root type="image" uuid="55b05045-695a-40fe-b6d6-f0e655728485"/>
Aug 15 16:30:56 user nova-compute[72849]:       <nova:ports>
Aug 15 16:30:56 user nova-compute[72849]:         <nova:port uuid="58268f65-6b08-4cdd-9ae3-b256ed150e60">
Aug 15 16:30:56 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 16:30:56 user nova-compute[72849]:         </nova:port>
Aug 15 16:30:56 user nova-compute[72849]:       </nova:ports>
Aug 15 16:30:56 user nova-compute[72849]:     </nova:instance>
Aug 15 16:30:56 user nova-compute[72849]:   </metadata>
Aug 15 16:30:56 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:30:56 user nova-compute[72849]:     <system>
Aug 15 16:30:56 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:30:56 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:30:56 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:30:56 user nova-compute[72849]:       <entry name="serial">0900e8d0-6e7f-40a3-9016-39851e697d09</entry>
Aug 15 16:30:56 user nova-compute[72849]:       <entry name="uuid">0900e8d0-6e7f-40a3-9016-39851e697d09</entry>
Aug 15 16:30:56 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:30:56 user nova-compute[72849]:     </system>
Aug 15 16:30:56 user nova-compute[72849]:   </sysinfo>
Aug 15 16:30:56 user nova-compute[72849]:   <os>
Aug 15 16:30:56 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:30:56 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:30:56 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:30:56 user nova-compute[72849]:   </os>
Aug 15 16:30:56 user nova-compute[72849]:   <features>
Aug 15 16:30:56 user nova-compute[72849]:     <acpi/>
Aug 15 16:30:56 user nova-compute[72849]:     <apic/>
Aug 15 16:30:56 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:30:56 user nova-compute[72849]:   </features>
Aug 15 16:30:56 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:30:56 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:30:56 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:30:56 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:30:56 user nova-compute[72849]:   </clock>
Aug 15 16:30:56 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:30:56 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:30:56 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:30:56 user nova-compute[72849]:   </cpu>
Aug 15 16:30:56 user nova-compute[72849]:   <devices>
Aug 15 16:30:56 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:30:56 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:30:56 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk"/>
Aug 15 16:30:56 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:30:56 user nova-compute[72849]:     </disk>
Aug 15 16:30:56 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:30:56 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:30:56 user nova-compute[72849]:       <source dev="/dev/sdh"/>
Aug 15 16:30:56 user nova-compute[72849]:       <target dev="vdc" bus="virtio"/>
Aug 15 16:30:56 user nova-compute[72849]:       <serial>01844056-f830-4161-b587-6dd5728c9605</serial>
Aug 15 16:30:56 user nova-compute[72849]:     </disk>
Aug 15 16:30:56 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:30:56 user nova-compute[72849]:       <mac address="fa:16:3e:de:64:c5"/>
Aug 15 16:30:56 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:30:56 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:30:56 user nova-compute[72849]:       <target dev="tap58268f65-6b"/>
Aug 15 16:30:56 user nova-compute[72849]:     </interface>
Aug 15 16:30:56 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:30:56 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/console.log" append="off"/>
Aug 15 16:30:56 user nova-compute[72849]:     </serial>
Aug 15 16:30:56 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:30:56 user nova-compute[72849]:     <video>
Aug 15 16:30:56 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:30:56 user nova-compute[72849]:     </video>
Aug 15 16:30:56 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:30:56 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:30:56 user nova-compute[72849]:     </rng>
Aug 15 16:30:56 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:30:56 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:30:56 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:30:56 user nova-compute[72849]:     </memballoon>
Aug 15 16:30:56 user nova-compute[72849]:   </devices>
Aug 15 16:30:56 user nova-compute[72849]: </domain>
Aug 15 16:30:56 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T16:26:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1356134043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1356134043',id=27,image_ref='55b05045-695a-40fe-b6d6-f0e655728485',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1318766870',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:26:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1bb636c3c71c479d90cf2e170db941e1',ramdisk_id='',reservation_id='r-ik1in1jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1263463439',owner_user_name='tempest-AttachVolumeShelveTestJSON-1263463439-project-member',shelved_at='2023-08-15T16:28:49.373659',shelved_host='user',shelved_image_id='55b05045-695a-40fe-b6d6-f0e655728485'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:30:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867f247fc90437899a13a7451a3249a',uuid=0900e8d0-6e7f-40a3-9016-39851e697d09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converting VIF {"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:64:c5,bridge_name='br-int',has_traffic_filtering=True,id=58268f65-6b08-4cdd-9ae3-b256ed150e60,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58268f65-6b') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG os_vif [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:64:c5,bridge_name='br-int',has_traffic_filtering=True,id=58268f65-6b08-4cdd-9ae3-b256ed150e60,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58268f65-6b') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58268f65-6b, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58268f65-6b, col_values=(('external_ids', {'iface-id': '58268f65-6b08-4cdd-9ae3-b256ed150e60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:64:c5', 'vm-uuid': '0900e8d0-6e7f-40a3-9016-39851e697d09'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:30:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:57 user nova-compute[72849]: INFO os_vif [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:64:c5,bridge_name='br-int',has_traffic_filtering=True,id=58268f65-6b08-4cdd-9ae3-b256ed150e60,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58268f65-6b')
Aug 15 16:30:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:30:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:30:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] No VIF found with MAC fa:16:3e:de:64:c5, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:30:57 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117042.7679803, 98bcb43e-a0d9-41f1-9976-01c9e8084ae6 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:30:57 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] VM Stopped (Lifecycle Event)
Aug 15 16:30:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-b4b61b6a-dda3-44f0-bd93-092c0e95b4cd None None] [instance: 98bcb43e-a0d9-41f1-9976-01c9e8084ae6] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:30:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:58 user nova-compute[72849]: DEBUG nova.compute.manager [req-b4be9eb2-7b90-476f-89bb-fb712c692380 req-29f6a732-3c33-449f-a326-9283cd5ba20b service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received event network-vif-plugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:30:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b4be9eb2-7b90-476f-89bb-fb712c692380 req-29f6a732-3c33-449f-a326-9283cd5ba20b service nova] Acquiring lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:30:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b4be9eb2-7b90-476f-89bb-fb712c692380 req-29f6a732-3c33-449f-a326-9283cd5ba20b service nova] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:30:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b4be9eb2-7b90-476f-89bb-fb712c692380 req-29f6a732-3c33-449f-a326-9283cd5ba20b service nova] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:30:58 user nova-compute[72849]: DEBUG nova.compute.manager [req-b4be9eb2-7b90-476f-89bb-fb712c692380 req-29f6a732-3c33-449f-a326-9283cd5ba20b service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] No waiting events found dispatching network-vif-plugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:30:58 user nova-compute[72849]: WARNING nova.compute.manager [req-b4be9eb2-7b90-476f-89bb-fb712c692380 req-29f6a732-3c33-449f-a326-9283cd5ba20b service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received unexpected event network-vif-plugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 16:30:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:30:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:00 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117060.8520286, 0900e8d0-6e7f-40a3-9016-39851e697d09 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:31:00 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] VM Resumed (Lifecycle Event)
Aug 15 16:31:00 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:31:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:31:00 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Instance spawned successfully.
Aug 15 16:31:00 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:31:00 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:31:00 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:31:00 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117060.8528323, 0900e8d0-6e7f-40a3-9016-39851e697d09 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:31:00 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] VM Started (Lifecycle Event)
Aug 15 16:31:00 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:31:00 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:31:00 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:31:01 user nova-compute[72849]: DEBUG nova.compute.manager [req-608d9493-c779-4932-8f86-55ecfce9e1b7 req-9a5f4b14-d734-4c69-9cb9-9e08f15d31a0 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received event network-vif-plugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-608d9493-c779-4932-8f86-55ecfce9e1b7 req-9a5f4b14-d734-4c69-9cb9-9e08f15d31a0 service nova] Acquiring lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-608d9493-c779-4932-8f86-55ecfce9e1b7 req-9a5f4b14-d734-4c69-9cb9-9e08f15d31a0 service nova] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-608d9493-c779-4932-8f86-55ecfce9e1b7 req-9a5f4b14-d734-4c69-9cb9-9e08f15d31a0 service nova] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:01 user nova-compute[72849]: DEBUG nova.compute.manager [req-608d9493-c779-4932-8f86-55ecfce9e1b7 req-9a5f4b14-d734-4c69-9cb9-9e08f15d31a0 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] No waiting events found dispatching network-vif-plugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:31:01 user nova-compute[72849]: WARNING nova.compute.manager [req-608d9493-c779-4932-8f86-55ecfce9e1b7 req-9a5f4b14-d734-4c69-9cb9-9e08f15d31a0 service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received unexpected event network-vif-plugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 16:31:01 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:31:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9b093156-71d7-45ef-84db-e4e2ec47dea5 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.994s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:02 user nova-compute[72849]: DEBUG nova.compute.manager [req-6a3c5ea1-c20e-4fad-ac68-4a07bb37a7b8 req-6b3ae7e4-d558-4991-9ae4-4d9b306f4060 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received event network-changed-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:02 user nova-compute[72849]: DEBUG nova.compute.manager [req-6a3c5ea1-c20e-4fad-ac68-4a07bb37a7b8 req-6b3ae7e4-d558-4991-9ae4-4d9b306f4060 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Refreshing instance network info cache due to event network-changed-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:31:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6a3c5ea1-c20e-4fad-ac68-4a07bb37a7b8 req-6b3ae7e4-d558-4991-9ae4-4d9b306f4060 service nova] Acquiring lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:31:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6a3c5ea1-c20e-4fad-ac68-4a07bb37a7b8 req-6b3ae7e4-d558-4991-9ae4-4d9b306f4060 service nova] Acquired lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:31:02 user nova-compute[72849]: DEBUG nova.network.neutron [req-6a3c5ea1-c20e-4fad-ac68-4a07bb37a7b8 req-6b3ae7e4-d558-4991-9ae4-4d9b306f4060 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Refreshing network info cache for port b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:31:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:02 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'flavor' on Instance uuid b15c5692-8c0c-4bf0-a79f-b7813e71de9a {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:31:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:03 user nova-compute[72849]: INFO nova.compute.manager [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Attaching volume d4ac0a7a-d4be-4352-a588-19fb1729148d to /dev/vdb
Aug 15 16:31:03 user nova-compute[72849]: DEBUG os_brick.utils [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff8feda-af1f-42b5-aa8e-cfcc0643661d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[40da1877-a769-4ea8-b31b-e11e558752dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[24beee85-938d-4c07-8bfe-9607d7f3b180]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e234d43-366c-40a7-b1c3-130c25d7884c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG nova.network.neutron [req-6a3c5ea1-c20e-4fad-ac68-4a07bb37a7b8 req-6b3ae7e4-d558-4991-9ae4-4d9b306f4060 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Updated VIF entry in instance network info cache for port b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG nova.network.neutron [req-6a3c5ea1-c20e-4fad-ac68-4a07bb37a7b8 req-6b3ae7e4-d558-4991-9ae4-4d9b306f4060 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Updating instance_info_cache with network_info: [{"id": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "address": "fa:16:3e:8a:41:62", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183f8f-93", "ovs_interfaceid": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:31:03 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:31:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c672f0-ce4c-4226-9d3b-928b73e9f417]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG os_brick.utils [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Updating existing volume attachment record: bd3faa61-4810-4f28-92f0-7d8035da1740 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6a3c5ea1-c20e-4fad-ac68-4a07bb37a7b8 req-6b3ae7e4-d558-4991-9ae4-4d9b306f4060 service nova] Releasing lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:31:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquiring lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquiring lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:07 user nova-compute[72849]: INFO nova.compute.manager [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Terminating instance
Aug 15 16:31:07 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-5dfa8c3a-19b9-47fc-ae8d-d14f0a640d1c req-b27d845a-bc37-436e-b880-460c38500568 service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Received event network-vif-unplugged-a1bba244-632e-4030-963f-55b89cbb736d {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5dfa8c3a-19b9-47fc-ae8d-d14f0a640d1c req-b27d845a-bc37-436e-b880-460c38500568 service nova] Acquiring lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5dfa8c3a-19b9-47fc-ae8d-d14f0a640d1c req-b27d845a-bc37-436e-b880-460c38500568 service nova] Lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5dfa8c3a-19b9-47fc-ae8d-d14f0a640d1c req-b27d845a-bc37-436e-b880-460c38500568 service nova] Lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-5dfa8c3a-19b9-47fc-ae8d-d14f0a640d1c req-b27d845a-bc37-436e-b880-460c38500568 service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] No waiting events found dispatching network-vif-unplugged-a1bba244-632e-4030-963f-55b89cbb736d {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-5dfa8c3a-19b9-47fc-ae8d-d14f0a640d1c req-b27d845a-bc37-436e-b880-460c38500568 service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Received event network-vif-unplugged-a1bba244-632e-4030-963f-55b89cbb736d for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:07 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Instance destroyed successfully.
Aug 15 16:31:07 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lazy-loading 'resources' on Instance uuid a3221960-e5ff-4185-a5dd-09f2cd293cb1 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-108205641',display_name='tempest-ServersNegativeTestJSON-server-108205641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-108205641',id=19,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:22:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c44524588624412a2fe9d7988490479',ramdisk_id='',reservation_id='r-acer7roo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1396852941',owner_user_name='tempest-ServersNegativeTestJSON-1396852941-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:22:20Z,user_data=None,user_id='f0209ddf9fde4b71a069c9dfd3513e7e',uuid=a3221960-e5ff-4185-a5dd-09f2cd293cb1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1bba244-632e-4030-963f-55b89cbb736d", "address": "fa:16:3e:a8:49:ac", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1bba244-63", "ovs_interfaceid": "a1bba244-632e-4030-963f-55b89cbb736d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Converting VIF {"id": "a1bba244-632e-4030-963f-55b89cbb736d", "address": "fa:16:3e:a8:49:ac", "network": {"id": "8b5ff7d7-7bfc-467c-aae2-eced27be5b87", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1210003029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c44524588624412a2fe9d7988490479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1bba244-63", "ovs_interfaceid": "a1bba244-632e-4030-963f-55b89cbb736d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:49:ac,bridge_name='br-int',has_traffic_filtering=True,id=a1bba244-632e-4030-963f-55b89cbb736d,network=Network(8b5ff7d7-7bfc-467c-aae2-eced27be5b87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1bba244-63') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG os_vif [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:49:ac,bridge_name='br-int',has_traffic_filtering=True,id=a1bba244-632e-4030-963f-55b89cbb736d,network=Network(8b5ff7d7-7bfc-467c-aae2-eced27be5b87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1bba244-63') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1bba244-63, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:07 user nova-compute[72849]: INFO os_vif [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:49:ac,bridge_name='br-int',has_traffic_filtering=True,id=a1bba244-632e-4030-963f-55b89cbb736d,network=Network(8b5ff7d7-7bfc-467c-aae2-eced27be5b87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1bba244-63')
Aug 15 16:31:07 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Deleting instance files /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1_del
Aug 15 16:31:08 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Deletion of /opt/stack/data/nova/instances/a3221960-e5ff-4185-a5dd-09f2cd293cb1_del complete
Aug 15 16:31:08 user nova-compute[72849]: INFO nova.compute.manager [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 15 16:31:08 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:31:08 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:31:08 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:31:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:08 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:31:08 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Took 0.77 seconds to deallocate network for instance.
Aug 15 16:31:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-2493f65f-3dac-41dd-888e-41b7993a1685 req-133da6ed-e0c5-49b7-9a6f-d525c78c1bdc service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Received event network-vif-deleted-a1bba244-632e-4030-963f-55b89cbb736d {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:08 user nova-compute[72849]: INFO nova.compute.manager [req-2493f65f-3dac-41dd-888e-41b7993a1685 req-133da6ed-e0c5-49b7-9a6f-d525c78c1bdc service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Neutron deleted interface a1bba244-632e-4030-963f-55b89cbb736d; detaching it from the instance and deleting it from the info cache
Aug 15 16:31:08 user nova-compute[72849]: DEBUG nova.network.neutron [req-2493f65f-3dac-41dd-888e-41b7993a1685 req-133da6ed-e0c5-49b7-9a6f-d525c78c1bdc service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:31:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-2493f65f-3dac-41dd-888e-41b7993a1685 req-133da6ed-e0c5-49b7-9a6f-d525c78c1bdc service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Detach interface failed, port_id=a1bba244-632e-4030-963f-55b89cbb736d, reason: Instance a3221960-e5ff-4185-a5dd-09f2cd293cb1 could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:31:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:09 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:31:09 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:31:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.708s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-f7329cb9-99db-4f05-bf1e-8170628ab193 req-1cda7d46-b071-41a9-a758-7225eadd1e55 service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Received event network-vif-plugged-a1bba244-632e-4030-963f-55b89cbb736d {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f7329cb9-99db-4f05-bf1e-8170628ab193 req-1cda7d46-b071-41a9-a758-7225eadd1e55 service nova] Acquiring lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f7329cb9-99db-4f05-bf1e-8170628ab193 req-1cda7d46-b071-41a9-a758-7225eadd1e55 service nova] Lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f7329cb9-99db-4f05-bf1e-8170628ab193 req-1cda7d46-b071-41a9-a758-7225eadd1e55 service nova] Lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-f7329cb9-99db-4f05-bf1e-8170628ab193 req-1cda7d46-b071-41a9-a758-7225eadd1e55 service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] No waiting events found dispatching network-vif-plugged-a1bba244-632e-4030-963f-55b89cbb736d {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:31:09 user nova-compute[72849]: WARNING nova.compute.manager [req-f7329cb9-99db-4f05-bf1e-8170628ab193 req-1cda7d46-b071-41a9-a758-7225eadd1e55 service nova] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Received unexpected event network-vif-plugged-a1bba244-632e-4030-963f-55b89cbb736d for instance with vm_state deleted and task_state None.
Aug 15 16:31:09 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Deleted allocations for instance a3221960-e5ff-4185-a5dd-09f2cd293cb1
Aug 15 16:31:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7f0de66e-64cb-4349-8074-a9729b792d95 tempest-ServersNegativeTestJSON-1396852941 tempest-ServersNegativeTestJSON-1396852941-project-member] Lock "a3221960-e5ff-4185-a5dd-09f2cd293cb1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.686s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:10 user nova-compute[72849]: INFO nova.compute.manager [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Detaching volume 72ab3753-6199-4221-ad21-89c5e58a022f
Aug 15 16:31:10 user nova-compute[72849]: INFO nova.virt.block_device [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Attempting to driver detach volume 72ab3753-6199-4221-ad21-89c5e58a022f from mountpoint /dev/vdb
Aug 15 16:31:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Attempting to detach device vdb from instance f1da55ae-5150-476c-a229-f26ddfee7e9e from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:31:11 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:31:11 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:31:11 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:31:11 user nova-compute[72849]:   <serial>72ab3753-6199-4221-ad21-89c5e58a022f</serial>
Aug 15 16:31:11 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 16:31:11 user nova-compute[72849]: </disk>
Aug 15 16:31:11 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:31:11 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Successfully detached device vdb from instance f1da55ae-5150-476c-a229-f26ddfee7e9e from the persistent domain config.
Aug 15 16:31:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f1da55ae-5150-476c-a229-f26ddfee7e9e from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:31:11 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:31:11 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:31:11 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:31:11 user nova-compute[72849]:   <serial>72ab3753-6199-4221-ad21-89c5e58a022f</serial>
Aug 15 16:31:11 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 16:31:11 user nova-compute[72849]: </disk>
Aug 15 16:31:11 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692117071.5002189, f1da55ae-5150-476c-a229-f26ddfee7e9e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:31:11 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Successfully detached device vdb from instance f1da55ae-5150-476c-a229-f26ddfee7e9e from the live domain config.
Aug 15 16:31:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIrUsVkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:31:11 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:31:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a72c79-408e-42e6-a059-a6c8835576cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ffdd54-4726-445b-bd48-d5a2094cf27c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:31:11 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:31:11 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:31:11 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:31:11 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:31:11 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:31:11 user nova-compute[72849]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)
Aug 15 16:31:11 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:31:11 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:31:11 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:31:11 user nova-compute[72849]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f (non-flash)
Aug 15 16:31:11 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:31:11 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:31:11 user nova-compute[72849]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)
Aug 15 16:31:11 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc37832fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.045s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e616ac6-9fe7-4ae3-8e80-dc75da02ef04]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b0290d-31a8-4021-89dd-f32935c61a12]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e7ad5d-4799-4211-8bd2-733388b22dc7]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba8edef-3783-4e00-a5c8-36530f0ddcbd]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[15273710-0782-4c43-936d-0ed6618c4b97]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8162cd80-1149-4a56-91af-cdb732a84a9a]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f, portal: 172.16.0.220,3260]
Aug 15 16:31:11 user nova-compute[72849]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f, portal: 172.16.0.220,3260] successful.
Aug 15 16:31:11 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ab3753-6199-4221-ad21-89c5e58a022f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dafb34-29d8-4550-ab88-b17cf222a96e]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] <== disconnect_volume: return (360ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:31:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:31:12 user nova-compute[72849]: DEBUG nova.objects.instance [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'flavor' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:31:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3faccb8e-2443-42a9-a091-5fb108ec956b tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.805s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bc6cd113-6d9c-4cb7-b557-0a735f7f6686 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bc6cd113-6d9c-4cb7-b557-0a735f7f6686 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-bc6cd113-6d9c-4cb7-b557-0a735f7f6686 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:31:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-bc6cd113-6d9c-4cb7-b557-0a735f7f6686 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72849) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 15 16:31:13 user nova-compute[72849]: DEBUG nova.objects.instance [None req-bc6cd113-6d9c-4cb7-b557-0a735f7f6686 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'flavor' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:31:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-43fff793-dba5-4a3b-8092-449770febb26 req-9fc0c178-5d1d-4564-94e2-f2755905835d service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received event network-vif-unplugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-43fff793-dba5-4a3b-8092-449770febb26 req-9fc0c178-5d1d-4564-94e2-f2755905835d service nova] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-43fff793-dba5-4a3b-8092-449770febb26 req-9fc0c178-5d1d-4564-94e2-f2755905835d service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-43fff793-dba5-4a3b-8092-449770febb26 req-9fc0c178-5d1d-4564-94e2-f2755905835d service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-43fff793-dba5-4a3b-8092-449770febb26 req-9fc0c178-5d1d-4564-94e2-f2755905835d service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] No waiting events found dispatching network-vif-unplugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:31:13 user nova-compute[72849]: WARNING nova.compute.manager [req-43fff793-dba5-4a3b-8092-449770febb26 req-9fc0c178-5d1d-4564-94e2-f2755905835d service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received unexpected event network-vif-unplugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba for instance with vm_state active and task_state powering-off.
Aug 15 16:31:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:14 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Instance destroyed successfully.
Aug 15 16:31:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-bc6cd113-6d9c-4cb7-b557-0a735f7f6686 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:31:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bc6cd113-6d9c-4cb7-b557-0a735f7f6686 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.868s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:31:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WojnJzIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:31:14 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:31:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:31:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:31:14 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:31:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:31:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:31:14 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:31:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b77c391-d32f-4b07-96ca-229f98c3f1cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:31:14 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:31:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5946dc79-232e-453f-bea4-bd63180aeee7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d] added
Aug 15 16:31:14 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:31:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d121bd4-3978-4d18-8421-e8a4d239b798]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f922fe20-5c1f-496f-a707-0e483bd37c92]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WojnJzIH {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WojnJzIH" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5695c2e-0d47-4b49-bdec-77d1fea44740]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WojnJzIH'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[25257f6a-bd58-4f9a-bedf-788031304d48]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab6028e-f93f-479c-818d-8d844dcddbc1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)
Aug 15 16:31:15 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)
Aug 15 16:31:15 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e8bab8-7fe6-4641-8cee-686d6e97de00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d, portal: 172.16.0.220,3260]
Aug 15 16:31:15 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d, portal: 172.16.0.220,3260] successful.
Aug 15 16:31:15 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[645e840d-6f69-42a4-bfc5-2f4b3e126fd3]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8688b171-77d0-49ce-a164-1ca3d38d3e85]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)
Aug 15 16:31:15 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)
Aug 15 16:31:15 user nova-compute[72849]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)
Aug 15 16:31:15 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b88d15a-8282-4dc0-9e61-fbe7b634f715]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-b4733dee-d026-4aed-84ad-28b183f5649a req-68302406-c8fc-443e-bf89-46d6fc0df905 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received event network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b4733dee-d026-4aed-84ad-28b183f5649a req-68302406-c8fc-443e-bf89-46d6fc0df905 service nova] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b4733dee-d026-4aed-84ad-28b183f5649a req-68302406-c8fc-443e-bf89-46d6fc0df905 service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b4733dee-d026-4aed-84ad-28b183f5649a req-68302406-c8fc-443e-bf89-46d6fc0df905 service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-b4733dee-d026-4aed-84ad-28b183f5649a req-68302406-c8fc-443e-bf89-46d6fc0df905 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] No waiting events found dispatching network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:31:15 user nova-compute[72849]: WARNING nova.compute.manager [req-b4733dee-d026-4aed-84ad-28b183f5649a req-68302406-c8fc-443e-bf89-46d6fc0df905 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received unexpected event network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba for instance with vm_state stopped and task_state None.
Aug 15 16:31:16 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:31:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WojnJzIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:31:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:31:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23366613166663239', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:31:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366613166663239', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:31:16 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'flavor' on Instance uuid b15c5692-8c0c-4bf0-a79f-b7813e71de9a {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:31:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:31:16 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:31:16 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:31:16 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:31:16 user nova-compute[72849]:   <serial>d4ac0a7a-d4be-4352-a588-19fb1729148d</serial>
Aug 15 16:31:16 user nova-compute[72849]: </disk>
Aug 15 16:31:16 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:31:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:31:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:31:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] No VIF found with MAC fa:16:3e:8a:41:62, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:31:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7160f981-c918-49ea-87a8-8ad9d2c0cda0 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.769s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:17 user nova-compute[72849]: INFO nova.compute.manager [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Rescuing
Aug 15 16:31:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:31:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquired lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:31:17 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:31:17 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Updating instance_info_cache with network_info: [{"id": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "address": "fa:16:3e:8a:41:62", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183f8f-93", "ovs_interfaceid": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:31:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Releasing lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:31:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-3150f9da-9597-47da-af37-fb8042fddbe6 req-ec06fbbc-0122-4e84-a0c5-acc962cb7dae service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received event network-vif-unplugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3150f9da-9597-47da-af37-fb8042fddbe6 req-ec06fbbc-0122-4e84-a0c5-acc962cb7dae service nova] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3150f9da-9597-47da-af37-fb8042fddbe6 req-ec06fbbc-0122-4e84-a0c5-acc962cb7dae service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3150f9da-9597-47da-af37-fb8042fddbe6 req-ec06fbbc-0122-4e84-a0c5-acc962cb7dae service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-3150f9da-9597-47da-af37-fb8042fddbe6 req-ec06fbbc-0122-4e84-a0c5-acc962cb7dae service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] No waiting events found dispatching network-vif-unplugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:31:18 user nova-compute[72849]: WARNING nova.compute.manager [req-3150f9da-9597-47da-af37-fb8042fddbe6 req-ec06fbbc-0122-4e84-a0c5-acc962cb7dae service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received unexpected event network-vif-unplugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 for instance with vm_state active and task_state rescuing.
Aug 15 16:31:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:18 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Instance destroyed successfully.
Aug 15 16:31:18 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Attempting rescue
Aug 15 16:31:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72849) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 16:31:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Instance directory exists: not creating {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 16:31:18 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Creating image(s)
Aug 15 16:31:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "/opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "/opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "/opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:18 user nova-compute[72849]: DEBUG nova.objects.instance [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'trusted_certs' on Instance uuid b15c5692-8c0c-4bf0-a79f-b7813e71de9a {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:31:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:18 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.209s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk.rescue {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk.rescue" returned: 0 in 0.053s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.objects.instance [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'migration_context' on Instance uuid b15c5692-8c0c-4bf0-a79f-b7813e71de9a {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Start _get_guest_xml network_info=[{"id": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "address": "fa:16:3e:8a:41:62", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "vif_mac": "fa:16:3e:8a:41:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183f8f-93", "ovs_interfaceid": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.objects.instance [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'resources' on Instance uuid b15c5692-8c0c-4bf0-a79f-b7813e71de9a {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.objects.instance [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'numa_topology' on Instance uuid b15c5692-8c0c-4bf0-a79f-b7813e71de9a {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:31:19 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:31:19 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.objects.instance [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'vcpu_model' on Instance uuid b15c5692-8c0c-4bf0-a79f-b7813e71de9a {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1766183368',display_name='tempest-ServerRescueNegativeTestJSON-server-1766183368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1766183368',id=33,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZDWB8vYJ27BLEDjq1jEjY2KBJTj8cjBkEkfTH18cdJZ7J3D5uI+izIwW8NIAiqaP6OwefzK28im3ocei5k8arru3mLNz50MNQwsuj3glrLSKYBFwn1qRB4crV/gOKF0w==',key_name='tempest-keypair-357165589',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:29:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63fff6abd55f4552b56b7f80f3b19990',ramdisk_id='',reservation_id='r-7uw01kyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-817230683',owner_user_name='tempest-ServerRescueNegativeTestJSON-817230683-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:29:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6bc0fd1358a42debf05e9bc43b8e329',uuid=b15c5692-8c0c-4bf0-a79f-b7813e71de9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "address": "fa:16:3e:8a:41:62", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "vif_mac": "fa:16:3e:8a:41:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183f8f-93", "ovs_interfaceid": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converting VIF {"id": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "address": "fa:16:3e:8a:41:62", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "vif_mac": "fa:16:3e:8a:41:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183f8f-93", "ovs_interfaceid": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:41:62,bridge_name='br-int',has_traffic_filtering=True,id=b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0183f8f-93') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.objects.instance [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'pci_devices' on Instance uuid b15c5692-8c0c-4bf0-a79f-b7813e71de9a {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:31:19 user nova-compute[72849]:   <uuid>b15c5692-8c0c-4bf0-a79f-b7813e71de9a</uuid>
Aug 15 16:31:19 user nova-compute[72849]:   <name>instance-00000021</name>
Aug 15 16:31:19 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:31:19 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:31:19 user nova-compute[72849]:   <metadata>
Aug 15 16:31:19 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:31:19 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:31:19 user nova-compute[72849]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1766183368</nova:name>
Aug 15 16:31:19 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:31:19</nova:creationTime>
Aug 15 16:31:19 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:31:19 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:31:19 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:31:19 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:31:19 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:31:19 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:31:19 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:31:19 user nova-compute[72849]:       <nova:owner>
Aug 15 16:31:19 user nova-compute[72849]:         <nova:user uuid="a6bc0fd1358a42debf05e9bc43b8e329">tempest-ServerRescueNegativeTestJSON-817230683-project-member</nova:user>
Aug 15 16:31:19 user nova-compute[72849]:         <nova:project uuid="63fff6abd55f4552b56b7f80f3b19990">tempest-ServerRescueNegativeTestJSON-817230683</nova:project>
Aug 15 16:31:19 user nova-compute[72849]:       </nova:owner>
Aug 15 16:31:19 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:31:19 user nova-compute[72849]:       <nova:ports>
Aug 15 16:31:19 user nova-compute[72849]:         <nova:port uuid="b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9">
Aug 15 16:31:19 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 16:31:19 user nova-compute[72849]:         </nova:port>
Aug 15 16:31:19 user nova-compute[72849]:       </nova:ports>
Aug 15 16:31:19 user nova-compute[72849]:     </nova:instance>
Aug 15 16:31:19 user nova-compute[72849]:   </metadata>
Aug 15 16:31:19 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:31:19 user nova-compute[72849]:     <system>
Aug 15 16:31:19 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:31:19 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:31:19 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:31:19 user nova-compute[72849]:       <entry name="serial">b15c5692-8c0c-4bf0-a79f-b7813e71de9a</entry>
Aug 15 16:31:19 user nova-compute[72849]:       <entry name="uuid">b15c5692-8c0c-4bf0-a79f-b7813e71de9a</entry>
Aug 15 16:31:19 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:31:19 user nova-compute[72849]:     </system>
Aug 15 16:31:19 user nova-compute[72849]:   </sysinfo>
Aug 15 16:31:19 user nova-compute[72849]:   <os>
Aug 15 16:31:19 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:31:19 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:31:19 user nova-compute[72849]:   </os>
Aug 15 16:31:19 user nova-compute[72849]:   <features>
Aug 15 16:31:19 user nova-compute[72849]:     <acpi/>
Aug 15 16:31:19 user nova-compute[72849]:     <apic/>
Aug 15 16:31:19 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:31:19 user nova-compute[72849]:   </features>
Aug 15 16:31:19 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:31:19 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:31:19 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:31:19 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:31:19 user nova-compute[72849]:   </clock>
Aug 15 16:31:19 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:31:19 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:31:19 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:31:19 user nova-compute[72849]:   </cpu>
Aug 15 16:31:19 user nova-compute[72849]:   <devices>
Aug 15 16:31:19 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:31:19 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:31:19 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk.rescue"/>
Aug 15 16:31:19 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:31:19 user nova-compute[72849]:     </disk>
Aug 15 16:31:19 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:31:19 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:31:19 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk"/>
Aug 15 16:31:19 user nova-compute[72849]:       <target dev="vdb" bus="virtio"/>
Aug 15 16:31:19 user nova-compute[72849]:     </disk>
Aug 15 16:31:19 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:31:19 user nova-compute[72849]:       <mac address="fa:16:3e:8a:41:62"/>
Aug 15 16:31:19 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:31:19 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:31:19 user nova-compute[72849]:       <target dev="tapb0183f8f-93"/>
Aug 15 16:31:19 user nova-compute[72849]:     </interface>
Aug 15 16:31:19 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:31:19 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/console.log" append="off"/>
Aug 15 16:31:19 user nova-compute[72849]:     </serial>
Aug 15 16:31:19 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:31:19 user nova-compute[72849]:     <video>
Aug 15 16:31:19 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:31:19 user nova-compute[72849]:     </video>
Aug 15 16:31:19 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:31:19 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:31:19 user nova-compute[72849]:     </rng>
Aug 15 16:31:19 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:31:19 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:31:19 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:31:19 user nova-compute[72849]:     </memballoon>
Aug 15 16:31:19 user nova-compute[72849]:   </devices>
Aug 15 16:31:19 user nova-compute[72849]: </domain>
Aug 15 16:31:19 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:31:19 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Instance destroyed successfully.
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:31:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] No VIF found with MAC fa:16:3e:8a:41:62, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:31:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-acfb2aab-7066-4db8-97a6-19010123fd92 req-cead3ea4-2b71-4fc4-b936-e5b9dbf5600c service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received event network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-acfb2aab-7066-4db8-97a6-19010123fd92 req-cead3ea4-2b71-4fc4-b936-e5b9dbf5600c service nova] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-acfb2aab-7066-4db8-97a6-19010123fd92 req-cead3ea4-2b71-4fc4-b936-e5b9dbf5600c service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-acfb2aab-7066-4db8-97a6-19010123fd92 req-cead3ea4-2b71-4fc4-b936-e5b9dbf5600c service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-acfb2aab-7066-4db8-97a6-19010123fd92 req-cead3ea4-2b71-4fc4-b936-e5b9dbf5600c service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] No waiting events found dispatching network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:31:20 user nova-compute[72849]: WARNING nova.compute.manager [req-acfb2aab-7066-4db8-97a6-19010123fd92 req-cead3ea4-2b71-4fc4-b936-e5b9dbf5600c service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received unexpected event network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 for instance with vm_state active and task_state rescuing.
Aug 15 16:31:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-6d645b3a-bf15-49a5-aaf8-9c4d9207516c req-14f0a7ef-18f1-4943-8fcd-614cbd2f8cc8 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received event network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6d645b3a-bf15-49a5-aaf8-9c4d9207516c req-14f0a7ef-18f1-4943-8fcd-614cbd2f8cc8 service nova] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6d645b3a-bf15-49a5-aaf8-9c4d9207516c req-14f0a7ef-18f1-4943-8fcd-614cbd2f8cc8 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6d645b3a-bf15-49a5-aaf8-9c4d9207516c req-14f0a7ef-18f1-4943-8fcd-614cbd2f8cc8 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-6d645b3a-bf15-49a5-aaf8-9c4d9207516c req-14f0a7ef-18f1-4943-8fcd-614cbd2f8cc8 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] No waiting events found dispatching network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:31:22 user nova-compute[72849]: WARNING nova.compute.manager [req-6d645b3a-bf15-49a5-aaf8-9c4d9207516c req-14f0a7ef-18f1-4943-8fcd-614cbd2f8cc8 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received unexpected event network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 for instance with vm_state active and task_state rescuing.
Aug 15 16:31:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-6d645b3a-bf15-49a5-aaf8-9c4d9207516c req-14f0a7ef-18f1-4943-8fcd-614cbd2f8cc8 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received event network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6d645b3a-bf15-49a5-aaf8-9c4d9207516c req-14f0a7ef-18f1-4943-8fcd-614cbd2f8cc8 service nova] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6d645b3a-bf15-49a5-aaf8-9c4d9207516c req-14f0a7ef-18f1-4943-8fcd-614cbd2f8cc8 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6d645b3a-bf15-49a5-aaf8-9c4d9207516c req-14f0a7ef-18f1-4943-8fcd-614cbd2f8cc8 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-6d645b3a-bf15-49a5-aaf8-9c4d9207516c req-14f0a7ef-18f1-4943-8fcd-614cbd2f8cc8 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] No waiting events found dispatching network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:31:22 user nova-compute[72849]: WARNING nova.compute.manager [req-6d645b3a-bf15-49a5-aaf8-9c4d9207516c req-14f0a7ef-18f1-4943-8fcd-614cbd2f8cc8 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received unexpected event network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 for instance with vm_state active and task_state rescuing.
Aug 15 16:31:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Removed pending event for b15c5692-8c0c-4bf0-a79f-b7813e71de9a due to event {{(pid=72849) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 16:31:22 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117082.892916, b15c5692-8c0c-4bf0-a79f-b7813e71de9a => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:31:22 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] VM Resumed (Lifecycle Event)
Aug 15 16:31:22 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c2b0547c-8a59-429d-abcc-324551829735 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:31:22 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:31:22 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:31:22 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117067.9534597, a3221960-e5ff-4185-a5dd-09f2cd293cb1 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:31:22 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] VM Stopped (Lifecycle Event)
Aug 15 16:31:22 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 16:31:22 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117082.8944716, b15c5692-8c0c-4bf0-a79f-b7813e71de9a => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:31:22 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] VM Started (Lifecycle Event)
Aug 15 16:31:22 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a2c42490-7ace-423a-9dd5-9c2af6e57d27 None None] [instance: a3221960-e5ff-4185-a5dd-09f2cd293cb1] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:31:22 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:31:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:22 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:31:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Acquiring lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Acquiring lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:26 user nova-compute[72849]: INFO nova.compute.manager [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Terminating instance
Aug 15 16:31:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:31:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-fd6455f2-9179-47a4-ad0d-c5995378138c req-6e8dbb6f-b4a9-43bc-9dbb-437bc038e104 service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Received event network-vif-unplugged-6a067af9-827f-49c1-9a52-abed7efff8a2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fd6455f2-9179-47a4-ad0d-c5995378138c req-6e8dbb6f-b4a9-43bc-9dbb-437bc038e104 service nova] Acquiring lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fd6455f2-9179-47a4-ad0d-c5995378138c req-6e8dbb6f-b4a9-43bc-9dbb-437bc038e104 service nova] Lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fd6455f2-9179-47a4-ad0d-c5995378138c req-6e8dbb6f-b4a9-43bc-9dbb-437bc038e104 service nova] Lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-fd6455f2-9179-47a4-ad0d-c5995378138c req-6e8dbb6f-b4a9-43bc-9dbb-437bc038e104 service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] No waiting events found dispatching network-vif-unplugged-6a067af9-827f-49c1-9a52-abed7efff8a2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:31:27 user nova-compute[72849]: DEBUG nova.compute.manager [req-fd6455f2-9179-47a4-ad0d-c5995378138c req-6e8dbb6f-b4a9-43bc-9dbb-437bc038e104 service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Received event network-vif-unplugged-6a067af9-827f-49c1-9a52-abed7efff8a2 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:31:27 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:31:27 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Instance destroyed successfully.
Aug 15 16:31:27 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lazy-loading 'resources' on Instance uuid 966c2c1f-fa7a-4cea-a007-254562c6fc3b {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:31:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:29:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-622982065',display_name='tempest-VolumesNegativeTest-instance-622982065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-622982065',id=34,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:29:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5c72094710f46ecad01481a58dd05f4',ramdisk_id='',reservation_id='r-7prpqj70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-100923298',owner_user_name='tempest-VolumesNegativeTest-100923298-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:29:44Z,user_data=None,user_id='8087ed1f734c494ca72ddc378d418d72',uuid=966c2c1f-fa7a-4cea-a007-254562c6fc3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a067af9-827f-49c1-9a52-abed7efff8a2", "address": "fa:16:3e:96:7a:68", "network": {"id": "c3c65f7e-b26b-449c-99f8-6ecd2d4dec46", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ba67b7353904433812452ec00d567e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a067af9-82", "ovs_interfaceid": "6a067af9-827f-49c1-9a52-abed7efff8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:31:27 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Converting VIF {"id": "6a067af9-827f-49c1-9a52-abed7efff8a2", "address": "fa:16:3e:96:7a:68", "network": {"id": "c3c65f7e-b26b-449c-99f8-6ecd2d4dec46", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ba67b7353904433812452ec00d567e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a067af9-82", "ovs_interfaceid": "6a067af9-827f-49c1-9a52-abed7efff8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:31:27 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:7a:68,bridge_name='br-int',has_traffic_filtering=True,id=6a067af9-827f-49c1-9a52-abed7efff8a2,network=Network(c3c65f7e-b26b-449c-99f8-6ecd2d4dec46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a067af9-82') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:31:27 user nova-compute[72849]: DEBUG os_vif [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:7a:68,bridge_name='br-int',has_traffic_filtering=True,id=6a067af9-827f-49c1-9a52-abed7efff8a2,network=Network(c3c65f7e-b26b-449c-99f8-6ecd2d4dec46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a067af9-82') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:31:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a067af9-82, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:31:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:31:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:27 user nova-compute[72849]: INFO os_vif [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:7a:68,bridge_name='br-int',has_traffic_filtering=True,id=6a067af9-827f-49c1-9a52-abed7efff8a2,network=Network(c3c65f7e-b26b-449c-99f8-6ecd2d4dec46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a067af9-82')
Aug 15 16:31:27 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Deleting instance files /opt/stack/data/nova/instances/966c2c1f-fa7a-4cea-a007-254562c6fc3b_del
Aug 15 16:31:27 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Deletion of /opt/stack/data/nova/instances/966c2c1f-fa7a-4cea-a007-254562c6fc3b_del complete
Aug 15 16:31:27 user nova-compute[72849]: INFO nova.compute.manager [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 15 16:31:27 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:31:27 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:31:27 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:31:28 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:31:28 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Took 0.51 seconds to deallocate network for instance.
Aug 15 16:31:28 user nova-compute[72849]: DEBUG nova.compute.manager [req-ab3bf6d5-2b9a-4551-b655-736735021c0d req-ee68a98b-2ec6-4736-966b-26636b66974a service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Received event network-vif-deleted-6a067af9-827f-49c1-9a52-abed7efff8a2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:28 user nova-compute[72849]: INFO nova.compute.manager [req-ab3bf6d5-2b9a-4551-b655-736735021c0d req-ee68a98b-2ec6-4736-966b-26636b66974a service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Neutron deleted interface 6a067af9-827f-49c1-9a52-abed7efff8a2; detaching it from the instance and deleting it from the info cache
Aug 15 16:31:28 user nova-compute[72849]: DEBUG nova.network.neutron [req-ab3bf6d5-2b9a-4551-b655-736735021c0d req-ee68a98b-2ec6-4736-966b-26636b66974a service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:31:28 user nova-compute[72849]: DEBUG nova.compute.manager [req-ab3bf6d5-2b9a-4551-b655-736735021c0d req-ee68a98b-2ec6-4736-966b-26636b66974a service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Detach interface failed, port_id=6a067af9-827f-49c1-9a52-abed7efff8a2, reason: Instance 966c2c1f-fa7a-4cea-a007-254562c6fc3b could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:31:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:28 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:31:28 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:31:28 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:31:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:28 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Deleted allocations for instance 966c2c1f-fa7a-4cea-a007-254562c6fc3b
Aug 15 16:31:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ea14de17-eef8-4178-a13d-ced35014818a tempest-VolumesNegativeTest-100923298 tempest-VolumesNegativeTest-100923298-project-member] Lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.101s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:29 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117074.0978737, f1da55ae-5150-476c-a229-f26ddfee7e9e => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:31:29 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] VM Stopped (Lifecycle Event)
Aug 15 16:31:29 user nova-compute[72849]: DEBUG nova.compute.manager [None req-25e61fa8-72c0-4fb1-a534-2d862d0a0f1f None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:31:29 user nova-compute[72849]: DEBUG nova.compute.manager [None req-25e61fa8-72c0-4fb1-a534-2d862d0a0f1f None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:31:29 user nova-compute[72849]: DEBUG nova.compute.manager [req-3e8c9428-34ad-42cc-abc5-c0725dcb72cc req-2762474e-281f-4005-a2a9-85438be324c6 service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Received event network-vif-plugged-6a067af9-827f-49c1-9a52-abed7efff8a2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3e8c9428-34ad-42cc-abc5-c0725dcb72cc req-2762474e-281f-4005-a2a9-85438be324c6 service nova] Acquiring lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3e8c9428-34ad-42cc-abc5-c0725dcb72cc req-2762474e-281f-4005-a2a9-85438be324c6 service nova] Lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3e8c9428-34ad-42cc-abc5-c0725dcb72cc req-2762474e-281f-4005-a2a9-85438be324c6 service nova] Lock "966c2c1f-fa7a-4cea-a007-254562c6fc3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:29 user nova-compute[72849]: DEBUG nova.compute.manager [req-3e8c9428-34ad-42cc-abc5-c0725dcb72cc req-2762474e-281f-4005-a2a9-85438be324c6 service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] No waiting events found dispatching network-vif-plugged-6a067af9-827f-49c1-9a52-abed7efff8a2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:31:29 user nova-compute[72849]: WARNING nova.compute.manager [req-3e8c9428-34ad-42cc-abc5-c0725dcb72cc req-2762474e-281f-4005-a2a9-85438be324c6 service nova] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Received unexpected event network-vif-plugged-6a067af9-827f-49c1-9a52-abed7efff8a2 for instance with vm_state deleted and task_state None.
Aug 15 16:31:31 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:31:31 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:31:31 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:31:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:31:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:31:31 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:31:31 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:31:31 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Updating instance_info_cache with network_info: [{"id": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "address": "fa:16:3e:18:f5:fe", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88628ea8-90", "ovs_interfaceid": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:31:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:31:31 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:31:32 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:31:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:31:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "15aa3de5-baee-4d40-8610-1bd08249c837" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "15aa3de5-baee-4d40-8610-1bd08249c837" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:33 user nova-compute[72849]: INFO nova.compute.manager [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Detaching volume 21306e05-cf9e-4c6e-abc4-af9433f700cf
Aug 15 16:31:33 user nova-compute[72849]: INFO nova.virt.block_device [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Attempting to driver detach volume 21306e05-cf9e-4c6e-abc4-af9433f700cf from mountpoint /dev/vdb
Aug 15 16:31:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Attempting to detach device vdb from instance 15aa3de5-baee-4d40-8610-1bd08249c837 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:31:33 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:31:33 user nova-compute[72849]:   <source dev="/dev/sde"/>
Aug 15 16:31:33 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:31:33 user nova-compute[72849]:   <serial>21306e05-cf9e-4c6e-abc4-af9433f700cf</serial>
Aug 15 16:31:33 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:31:33 user nova-compute[72849]: </disk>
Aug 15 16:31:33 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:31:33 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Successfully detached device vdb from instance 15aa3de5-baee-4d40-8610-1bd08249c837 from the persistent domain config.
Aug 15 16:31:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15aa3de5-baee-4d40-8610-1bd08249c837 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:31:33 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:31:33 user nova-compute[72849]:   <source dev="/dev/sde"/>
Aug 15 16:31:33 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:31:33 user nova-compute[72849]:   <serial>21306e05-cf9e-4c6e-abc4-af9433f700cf</serial>
Aug 15 16:31:33 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:31:33 user nova-compute[72849]: </disk>
Aug 15 16:31:33 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692117093.9168274, 15aa3de5-baee-4d40-8610-1bd08249c837 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15aa3de5-baee-4d40-8610-1bd08249c837 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:31:33 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Successfully detached device vdb from instance 15aa3de5-baee-4d40-8610-1bd08249c837 from the live domain config.
Aug 15 16:31:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KiLprvgI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:31:33 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:31:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b49fffb-540d-45ae-b00f-beffc15763a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ce8d65-32d8-4eea-b50c-6fdf6c3afdc6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:31:33 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:31:33 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:31:33 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:31:33 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:31:33 user nova-compute[72849]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)
Aug 15 16:31:33 user nova-compute[72849]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)
Aug 15 16:31:33 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:31:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:31:33 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:31:33 user nova-compute[72849]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf (non-flash)
Aug 15 16:31:33 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:31:33 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:31:33 user nova-compute[72849]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)
Aug 15 16:31:33 user nova-compute[72849]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)
Aug 15 16:31:33 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3581a7400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf'): ({'sde'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Removing single pathed devices sde {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b402e4-06dc-42e6-a593-6177449ed350]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1670dcbf-3765-4b1a-859e-c379ef4e9b9b]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Flushing IO for device /dev/sde {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f41c22-4065-41fa-9312-cb461a94194b]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17871d8-57da-4cb3-acca-11022e0c2871]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] SCSI volumes sde have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[156135fc-c606-4320-96d3-4ccb4cc7f0ea]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[884e3505-eeb4-4a70-b331-c77d426ba953]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf, portal: 172.16.0.220,3260]
Aug 15 16:31:34 user nova-compute[72849]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf, portal: 172.16.0.220,3260] successful.
Aug 15 16:31:34 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21306e05-cf9e-4c6e-abc4-af9433f700cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0172ad0-bfc4-444a-a3f5-acdef79d9970]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] <== disconnect_volume: return (355ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:35 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'flavor' on Instance uuid 15aa3de5-baee-4d40-8610-1bd08249c837 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:31:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9d05c338-3c8b-484e-9141-3f8ad5fcff12 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "15aa3de5-baee-4d40-8610-1bd08249c837" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.763s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:31:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:31:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:31:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:31:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:31:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:31:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:39 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:31:39 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=6838MB free_disk=24.96291732788086GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Acquiring lock "306a1d17-459d-42cb-b575-fceae948fa79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "306a1d17-459d-42cb-b575-fceae948fa79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Acquiring lock "306a1d17-459d-42cb-b575-fceae948fa79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "306a1d17-459d-42cb-b575-fceae948fa79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "306a1d17-459d-42cb-b575-fceae948fa79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:39 user nova-compute[72849]: INFO nova.compute.manager [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Terminating instance
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Applying migration context for instance 98358bbf-c7c1-4868-81ee-77bd229133fd as it has an incoming, in-progress migration 86b2553f-a993-4cd4-b9e1-b03bf07e7682. Migration status is finished {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 16:31:39 user nova-compute[72849]: INFO nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Updating resource usage from migration 86b2553f-a993-4cd4-b9e1-b03bf07e7682
Aug 15 16:31:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc521d87-09aa-44ba-a87c-1cd5517b3707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 46f0aa43-e313-4aff-bacc-aa5290193b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance d51623f1-6613-41d6-abcb-9e4e626a97af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f1da55ae-5150-476c-a229-f26ddfee7e9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 15aa3de5-baee-4d40-8610-1bd08249c837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance ea9d5a00-42db-41e4-bb81-b3875e84f16c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 82f61128-3af4-4f82-ac4c-8ee746b5a829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 306a1d17-459d-42cb-b575-fceae948fa79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b15c5692-8c0c-4bf0-a79f-b7813e71de9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Migration 86b2553f-a993-4cd4-b9e1-b03bf07e7682 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 98358bbf-c7c1-4868-81ee-77bd229133fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0900e8d0-6e7f-40a3-9016-39851e697d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-ce139e3d-4512-4b1b-9548-350fadf71119 req-5dddfcf8-29dd-44d0-97d6-1fb360e7d24b service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Received event network-vif-unplugged-601b3faf-ad9f-4219-8f5c-bd7cca827303 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ce139e3d-4512-4b1b-9548-350fadf71119 req-5dddfcf8-29dd-44d0-97d6-1fb360e7d24b service nova] Acquiring lock "306a1d17-459d-42cb-b575-fceae948fa79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ce139e3d-4512-4b1b-9548-350fadf71119 req-5dddfcf8-29dd-44d0-97d6-1fb360e7d24b service nova] Lock "306a1d17-459d-42cb-b575-fceae948fa79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ce139e3d-4512-4b1b-9548-350fadf71119 req-5dddfcf8-29dd-44d0-97d6-1fb360e7d24b service nova] Lock "306a1d17-459d-42cb-b575-fceae948fa79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-ce139e3d-4512-4b1b-9548-350fadf71119 req-5dddfcf8-29dd-44d0-97d6-1fb360e7d24b service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] No waiting events found dispatching network-vif-unplugged-601b3faf-ad9f-4219-8f5c-bd7cca827303 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-ce139e3d-4512-4b1b-9548-350fadf71119 req-5dddfcf8-29dd-44d0-97d6-1fb360e7d24b service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Received event network-vif-unplugged-601b3faf-ad9f-4219-8f5c-bd7cca827303 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.652s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:39 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Instance destroyed successfully.
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.objects.instance [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lazy-loading 'resources' on Instance uuid 306a1d17-459d-42cb-b575-fceae948fa79 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1829945229',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1829945229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1829945',id=31,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp+KN195dBCCoE9FSVVesdNHmJVNCAI4L0A74D4dyDvRyiEKc7xprFsP9t1BdhikFYk0gJpyWtH9WckhrEWmpoe3nduua6l9wRE03ZFgYSz6jJmixJxb/wPmoIgwubWWQ==',key_name='tempest-keypair-176102540',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:28:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07c15369c3d34f9d850252762620f9ab',ramdisk_id='',reservation_id='r-9807vhz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1627285683',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:28:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52003946466941bcb8d5d55373c14eaa',uuid=306a1d17-459d-42cb-b575-fceae948fa79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "address": "fa:16:3e:71:db:6d", "network": {"id": "8c8e3ae7-d19d-4b52-8a73-b63a569ab9b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-915203707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c15369c3d34f9d850252762620f9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap601b3faf-ad", "ovs_interfaceid": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Converting VIF {"id": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "address": "fa:16:3e:71:db:6d", "network": {"id": "8c8e3ae7-d19d-4b52-8a73-b63a569ab9b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-915203707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c15369c3d34f9d850252762620f9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap601b3faf-ad", "ovs_interfaceid": "601b3faf-ad9f-4219-8f5c-bd7cca827303", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:db:6d,bridge_name='br-int',has_traffic_filtering=True,id=601b3faf-ad9f-4219-8f5c-bd7cca827303,network=Network(8c8e3ae7-d19d-4b52-8a73-b63a569ab9b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap601b3faf-ad') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG os_vif [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:db:6d,bridge_name='br-int',has_traffic_filtering=True,id=601b3faf-ad9f-4219-8f5c-bd7cca827303,network=Network(8c8e3ae7-d19d-4b52-8a73-b63a569ab9b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap601b3faf-ad') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap601b3faf-ad, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:39 user nova-compute[72849]: INFO os_vif [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:db:6d,bridge_name='br-int',has_traffic_filtering=True,id=601b3faf-ad9f-4219-8f5c-bd7cca827303,network=Network(8c8e3ae7-d19d-4b52-8a73-b63a569ab9b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap601b3faf-ad')
Aug 15 16:31:39 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Deleting instance files /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79_del
Aug 15 16:31:39 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Deletion of /opt/stack/data/nova/instances/306a1d17-459d-42cb-b575-fceae948fa79_del complete
Aug 15 16:31:39 user nova-compute[72849]: INFO nova.compute.manager [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 16:31:39 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:31:39 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:31:40 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:31:40 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:31:40 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:31:40 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:31:40 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Took 0.90 seconds to deallocate network for instance.
Aug 15 16:31:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:41 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:31:41 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:31:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-0020d903-8557-4ee7-88ca-8e536d4d0c66 req-999bb31e-631a-4590-8fa4-2e9e3eb0b693 service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Received event network-vif-plugged-601b3faf-ad9f-4219-8f5c-bd7cca827303 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0020d903-8557-4ee7-88ca-8e536d4d0c66 req-999bb31e-631a-4590-8fa4-2e9e3eb0b693 service nova] Acquiring lock "306a1d17-459d-42cb-b575-fceae948fa79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0020d903-8557-4ee7-88ca-8e536d4d0c66 req-999bb31e-631a-4590-8fa4-2e9e3eb0b693 service nova] Lock "306a1d17-459d-42cb-b575-fceae948fa79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0020d903-8557-4ee7-88ca-8e536d4d0c66 req-999bb31e-631a-4590-8fa4-2e9e3eb0b693 service nova] Lock "306a1d17-459d-42cb-b575-fceae948fa79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-0020d903-8557-4ee7-88ca-8e536d4d0c66 req-999bb31e-631a-4590-8fa4-2e9e3eb0b693 service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] No waiting events found dispatching network-vif-plugged-601b3faf-ad9f-4219-8f5c-bd7cca827303 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:31:41 user nova-compute[72849]: WARNING nova.compute.manager [req-0020d903-8557-4ee7-88ca-8e536d4d0c66 req-999bb31e-631a-4590-8fa4-2e9e3eb0b693 service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Received unexpected event network-vif-plugged-601b3faf-ad9f-4219-8f5c-bd7cca827303 for instance with vm_state deleted and task_state None.
Aug 15 16:31:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-0020d903-8557-4ee7-88ca-8e536d4d0c66 req-999bb31e-631a-4590-8fa4-2e9e3eb0b693 service nova] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Received event network-vif-deleted-601b3faf-ad9f-4219-8f5c-bd7cca827303 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:41 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Deleted allocations for instance 306a1d17-459d-42cb-b575-fceae948fa79
Aug 15 16:31:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-32042d59-da0c-4475-b3f4-392765fcab50 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683 tempest-TestServerVolumeAttachScenarioOldVersion-1627285683-project-member] Lock "306a1d17-459d-42cb-b575-fceae948fa79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.519s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:42 user nova-compute[72849]: INFO nova.compute.manager [None req-e3daab0f-ea17-45c0-a973-65e68268550e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Unrescuing
Aug 15 16:31:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3daab0f-ea17-45c0-a973-65e68268550e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "refresh_cache-ea9d5a00-42db-41e4-bb81-b3875e84f16c" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:31:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3daab0f-ea17-45c0-a973-65e68268550e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquired lock "refresh_cache-ea9d5a00-42db-41e4-bb81-b3875e84f16c" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:31:42 user nova-compute[72849]: DEBUG nova.network.neutron [None req-e3daab0f-ea17-45c0-a973-65e68268550e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:31:42 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117087.5576615, 966c2c1f-fa7a-4cea-a007-254562c6fc3b => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:31:42 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] VM Stopped (Lifecycle Event)
Aug 15 16:31:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c4aec15a-9e70-4f00-ac27-35da1dd2f566 None None] [instance: 966c2c1f-fa7a-4cea-a007-254562c6fc3b] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:31:43 user nova-compute[72849]: DEBUG nova.network.neutron [None req-e3daab0f-ea17-45c0-a973-65e68268550e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Updating instance_info_cache with network_info: [{"id": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "address": "fa:16:3e:f4:f0:ec", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f4c47f-05", "ovs_interfaceid": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:31:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3daab0f-ea17-45c0-a973-65e68268550e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Releasing lock "refresh_cache-ea9d5a00-42db-41e4-bb81-b3875e84f16c" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:31:43 user nova-compute[72849]: DEBUG nova.objects.instance [None req-e3daab0f-ea17-45c0-a973-65e68268550e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'flavor' on Instance uuid ea9d5a00-42db-41e4-bb81-b3875e84f16c {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:31:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-9880feac-70ef-40e3-abcb-469ff5823ccb req-139ce6b2-759c-4fa1-b2b6-564b1b19d7d8 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received event network-vif-unplugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9880feac-70ef-40e3-abcb-469ff5823ccb req-139ce6b2-759c-4fa1-b2b6-564b1b19d7d8 service nova] Acquiring lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9880feac-70ef-40e3-abcb-469ff5823ccb req-139ce6b2-759c-4fa1-b2b6-564b1b19d7d8 service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9880feac-70ef-40e3-abcb-469ff5823ccb req-139ce6b2-759c-4fa1-b2b6-564b1b19d7d8 service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-9880feac-70ef-40e3-abcb-469ff5823ccb req-139ce6b2-759c-4fa1-b2b6-564b1b19d7d8 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] No waiting events found dispatching network-vif-unplugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:31:43 user nova-compute[72849]: WARNING nova.compute.manager [req-9880feac-70ef-40e3-abcb-469ff5823ccb req-139ce6b2-759c-4fa1-b2b6-564b1b19d7d8 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received unexpected event network-vif-unplugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b for instance with vm_state rescued and task_state unrescuing.
Aug 15 16:31:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:44 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Instance destroyed successfully.
Aug 15 16:31:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-096e1767-014a-4543-a590-6084082cd4b4 req-d97df602-2c87-49eb-a02e-50f984210b52 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received event network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-096e1767-014a-4543-a590-6084082cd4b4 req-d97df602-2c87-49eb-a02e-50f984210b52 service nova] Acquiring lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-096e1767-014a-4543-a590-6084082cd4b4 req-d97df602-2c87-49eb-a02e-50f984210b52 service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-096e1767-014a-4543-a590-6084082cd4b4 req-d97df602-2c87-49eb-a02e-50f984210b52 service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-096e1767-014a-4543-a590-6084082cd4b4 req-d97df602-2c87-49eb-a02e-50f984210b52 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] No waiting events found dispatching network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:31:45 user nova-compute[72849]: WARNING nova.compute.manager [req-096e1767-014a-4543-a590-6084082cd4b4 req-d97df602-2c87-49eb-a02e-50f984210b52 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received unexpected event network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b for instance with vm_state rescued and task_state unrescuing.
Aug 15 16:31:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-096e1767-014a-4543-a590-6084082cd4b4 req-d97df602-2c87-49eb-a02e-50f984210b52 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received event network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-096e1767-014a-4543-a590-6084082cd4b4 req-d97df602-2c87-49eb-a02e-50f984210b52 service nova] Acquiring lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-096e1767-014a-4543-a590-6084082cd4b4 req-d97df602-2c87-49eb-a02e-50f984210b52 service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-096e1767-014a-4543-a590-6084082cd4b4 req-d97df602-2c87-49eb-a02e-50f984210b52 service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-096e1767-014a-4543-a590-6084082cd4b4 req-d97df602-2c87-49eb-a02e-50f984210b52 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] No waiting events found dispatching network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:31:45 user nova-compute[72849]: WARNING nova.compute.manager [req-096e1767-014a-4543-a590-6084082cd4b4 req-d97df602-2c87-49eb-a02e-50f984210b52 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received unexpected event network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b for instance with vm_state rescued and task_state unrescuing.
Aug 15 16:31:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Removed pending event for ea9d5a00-42db-41e4-bb81-b3875e84f16c due to event {{(pid=72849) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 16:31:47 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117107.6606812, ea9d5a00-42db-41e4-bb81-b3875e84f16c => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:31:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] VM Resumed (Lifecycle Event)
Aug 15 16:31:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-e3daab0f-ea17-45c0-a973-65e68268550e tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:31:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:31:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:31:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 16:31:47 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117107.6621583, ea9d5a00-42db-41e4-bb81-b3875e84f16c => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:31:47 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] VM Started (Lifecycle Event)
Aug 15 16:31:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:31:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:31:47 user nova-compute[72849]: DEBUG nova.compute.manager [req-01fc1c05-0f94-4b3b-b74e-5093d9cdf473 req-c0e0189a-aea2-44d3-8d3e-620d32bb7364 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received event network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:31:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-01fc1c05-0f94-4b3b-b74e-5093d9cdf473 req-c0e0189a-aea2-44d3-8d3e-620d32bb7364 service nova] Acquiring lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-01fc1c05-0f94-4b3b-b74e-5093d9cdf473 req-c0e0189a-aea2-44d3-8d3e-620d32bb7364 service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-01fc1c05-0f94-4b3b-b74e-5093d9cdf473 req-c0e0189a-aea2-44d3-8d3e-620d32bb7364 service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:47 user nova-compute[72849]: DEBUG nova.compute.manager [req-01fc1c05-0f94-4b3b-b74e-5093d9cdf473 req-c0e0189a-aea2-44d3-8d3e-620d32bb7364 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] No waiting events found dispatching network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:31:47 user nova-compute[72849]: WARNING nova.compute.manager [req-01fc1c05-0f94-4b3b-b74e-5093d9cdf473 req-c0e0189a-aea2-44d3-8d3e-620d32bb7364 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received unexpected event network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b for instance with vm_state active and task_state None.
Aug 15 16:31:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-405ee8a3-799d-4a15-a622-1b027a55b67c tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "98358bbf-c7c1-4868-81ee-77bd229133fd" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-405ee8a3-799d-4a15-a622-1b027a55b67c tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:53 user nova-compute[72849]: DEBUG nova.compute.manager [None req-405ee8a3-799d-4a15-a622-1b027a55b67c tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Going to confirm migration 2 {{(pid=72849) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 15 16:31:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-405ee8a3-799d-4a15-a622-1b027a55b67c tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "refresh_cache-98358bbf-c7c1-4868-81ee-77bd229133fd" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:31:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-405ee8a3-799d-4a15-a622-1b027a55b67c tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquired lock "refresh_cache-98358bbf-c7c1-4868-81ee-77bd229133fd" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:31:53 user nova-compute[72849]: DEBUG nova.network.neutron [None req-405ee8a3-799d-4a15-a622-1b027a55b67c tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:31:53 user nova-compute[72849]: DEBUG nova.objects.instance [None req-405ee8a3-799d-4a15-a622-1b027a55b67c tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'info_cache' on Instance uuid 98358bbf-c7c1-4868-81ee-77bd229133fd {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:31:54 user nova-compute[72849]: DEBUG nova.network.neutron [None req-405ee8a3-799d-4a15-a622-1b027a55b67c tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Updating instance_info_cache with network_info: [{"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:31:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-405ee8a3-799d-4a15-a622-1b027a55b67c tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Releasing lock "refresh_cache-98358bbf-c7c1-4868-81ee-77bd229133fd" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:31:54 user nova-compute[72849]: DEBUG nova.objects.instance [None req-405ee8a3-799d-4a15-a622-1b027a55b67c tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'migration_context' on Instance uuid 98358bbf-c7c1-4868-81ee-77bd229133fd {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:31:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-405ee8a3-799d-4a15-a622-1b027a55b67c tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:31:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-405ee8a3-799d-4a15-a622-1b027a55b67c tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:31:54 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-405ee8a3-799d-4a15-a622-1b027a55b67c tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:31:54 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-405ee8a3-799d-4a15-a622-1b027a55b67c tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:31:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-405ee8a3-799d-4a15-a622-1b027a55b67c tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.403s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:54 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117099.8647304, 306a1d17-459d-42cb-b575-fceae948fa79 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:31:54 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] VM Stopped (Lifecycle Event)
Aug 15 16:31:54 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5adcd095-2118-4aa2-93f6-726aa5aa5e80 None None] [instance: 306a1d17-459d-42cb-b575-fceae948fa79] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:31:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:31:54 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-405ee8a3-799d-4a15-a622-1b027a55b67c tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Deleted allocation for migration 86b2553f-a993-4cd4-b9e1-b03bf07e7682
Aug 15 16:31:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-405ee8a3-799d-4a15-a622-1b027a55b67c tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.378s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:31:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:32:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-c3467ba2-0982-4ae4-81e7-00f08cb381a6 req-fb92559f-64db-4ef0-b425-8aba3b6b7464 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received event network-changed-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:32:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-c3467ba2-0982-4ae4-81e7-00f08cb381a6 req-fb92559f-64db-4ef0-b425-8aba3b6b7464 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Refreshing instance network info cache due to event network-changed-1ef6b77c-2391-485e-ad7f-851bfac1b315. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:32:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c3467ba2-0982-4ae4-81e7-00f08cb381a6 req-fb92559f-64db-4ef0-b425-8aba3b6b7464 service nova] Acquiring lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:32:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c3467ba2-0982-4ae4-81e7-00f08cb381a6 req-fb92559f-64db-4ef0-b425-8aba3b6b7464 service nova] Acquired lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:32:10 user nova-compute[72849]: DEBUG nova.network.neutron [req-c3467ba2-0982-4ae4-81e7-00f08cb381a6 req-fb92559f-64db-4ef0-b425-8aba3b6b7464 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Refreshing network info cache for port 1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:32:11 user nova-compute[72849]: DEBUG nova.network.neutron [req-c3467ba2-0982-4ae4-81e7-00f08cb381a6 req-fb92559f-64db-4ef0-b425-8aba3b6b7464 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Updated VIF entry in instance network info cache for port 1ef6b77c-2391-485e-ad7f-851bfac1b315. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:32:11 user nova-compute[72849]: DEBUG nova.network.neutron [req-c3467ba2-0982-4ae4-81e7-00f08cb381a6 req-fb92559f-64db-4ef0-b425-8aba3b6b7464 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Updating instance_info_cache with network_info: [{"id": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "address": "fa:16:3e:ca:59:78", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef6b77c-23", "ovs_interfaceid": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:32:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c3467ba2-0982-4ae4-81e7-00f08cb381a6 req-fb92559f-64db-4ef0-b425-8aba3b6b7464 service nova] Releasing lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:32:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-0e0980c8-41bc-4b50-ab0a-36f1bb0b4167 req-474cdc31-9c83-4cce-8a1f-bb12fcf708d6 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received event network-changed-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:32:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-0e0980c8-41bc-4b50-ab0a-36f1bb0b4167 req-474cdc31-9c83-4cce-8a1f-bb12fcf708d6 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Refreshing instance network info cache due to event network-changed-1ef6b77c-2391-485e-ad7f-851bfac1b315. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:32:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0e0980c8-41bc-4b50-ab0a-36f1bb0b4167 req-474cdc31-9c83-4cce-8a1f-bb12fcf708d6 service nova] Acquiring lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:32:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0e0980c8-41bc-4b50-ab0a-36f1bb0b4167 req-474cdc31-9c83-4cce-8a1f-bb12fcf708d6 service nova] Acquired lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:32:11 user nova-compute[72849]: DEBUG nova.network.neutron [req-0e0980c8-41bc-4b50-ab0a-36f1bb0b4167 req-474cdc31-9c83-4cce-8a1f-bb12fcf708d6 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Refreshing network info cache for port 1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:32:12 user nova-compute[72849]: INFO nova.compute.manager [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Detaching volume b8e27685-4cd0-42b1-b8f7-38a7746db2f2
Aug 15 16:32:12 user nova-compute[72849]: INFO nova.virt.block_device [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Attempting to driver detach volume b8e27685-4cd0-42b1-b8f7-38a7746db2f2 from mountpoint /dev/vdb
Aug 15 16:32:12 user nova-compute[72849]: DEBUG nova.network.neutron [req-0e0980c8-41bc-4b50-ab0a-36f1bb0b4167 req-474cdc31-9c83-4cce-8a1f-bb12fcf708d6 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Updated VIF entry in instance network info cache for port 1ef6b77c-2391-485e-ad7f-851bfac1b315. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG nova.network.neutron [req-0e0980c8-41bc-4b50-ab0a-36f1bb0b4167 req-474cdc31-9c83-4cce-8a1f-bb12fcf708d6 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Updating instance_info_cache with network_info: [{"id": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "address": "fa:16:3e:ca:59:78", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef6b77c-23", "ovs_interfaceid": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Attempting to detach device vdb from instance 82f61128-3af4-4f82-ac4c-8ee746b5a829 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:32:12 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:32:12 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:32:12 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:32:12 user nova-compute[72849]:   <serial>b8e27685-4cd0-42b1-b8f7-38a7746db2f2</serial>
Aug 15 16:32:12 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:32:12 user nova-compute[72849]: </disk>
Aug 15 16:32:12 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:32:12 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Successfully detached device vdb from instance 82f61128-3af4-4f82-ac4c-8ee746b5a829 from the persistent domain config.
Aug 15 16:32:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 82f61128-3af4-4f82-ac4c-8ee746b5a829 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:32:12 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:32:12 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:32:12 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:32:12 user nova-compute[72849]:   <serial>b8e27685-4cd0-42b1-b8f7-38a7746db2f2</serial>
Aug 15 16:32:12 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:32:12 user nova-compute[72849]: </disk>
Aug 15 16:32:12 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-0e0980c8-41bc-4b50-ab0a-36f1bb0b4167 req-474cdc31-9c83-4cce-8a1f-bb12fcf708d6 service nova] Releasing lock "refresh_cache-82f61128-3af4-4f82-ac4c-8ee746b5a829" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692117132.5875797, 82f61128-3af4-4f82-ac4c-8ee746b5a829 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 82f61128-3af4-4f82-ac4c-8ee746b5a829 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:32:12 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Successfully detached device vdb from instance 82f61128-3af4-4f82-ac4c-8ee746b5a829 from the live domain config.
Aug 15 16:32:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VywRcJMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:32:12 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:32:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c9af3c-cd0f-4436-8442-09da448545a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9c7ae6-f7db-416b-9792-92a3a832dda8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:32:12 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:32:12 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:32:12 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:32:12 user nova-compute[72849]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)
Aug 15 16:32:12 user nova-compute[72849]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)
Aug 15 16:32:12 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:32:12 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:32:12 user nova-compute[72849]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 (non-flash)
Aug 15 16:32:12 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:32:12 user nova-compute[72849]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)
Aug 15 16:32:12 user nova-compute[72849]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)
Aug 15 16:32:12 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc338736dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2'): ({'sdc'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Removing single pathed devices sdc {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c37f78-0a88-4f67-bad4-df1dbe6229f6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[89757f9e-ab0b-4275-a799-75b8a17ca088]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Flushing IO for device /dev/sdc {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c7e97c-091a-4087-b782-d1a23aeb7f30]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[63273e04-e5e9-4ecc-bd3f-04204c5a1ded]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d900efb0-07fb-4399-9b86-1d0c6590399e]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0a5f8e-93a7-41c2-9893-cf503ada8c55]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2, portal: 172.16.0.220,3260]
Aug 15 16:32:12 user nova-compute[72849]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2, portal: 172.16.0.220,3260] successful.
Aug 15 16:32:12 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8e27685-4cd0-42b1-b8f7-38a7746db2f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de6e827-fdaa-46a8-89c4-50b9fe88baa8]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] <== disconnect_volume: return (300ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:32:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:32:13 user nova-compute[72849]: DEBUG nova.objects.instance [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lazy-loading 'flavor' on Instance uuid 82f61128-3af4-4f82-ac4c-8ee746b5a829 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:32:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0c8abcdb-48e3-4ae6-a502-8ca78e7be0fb tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.676s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:32:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "15aa3de5-baee-4d40-8610-1bd08249c837" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:32:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "15aa3de5-baee-4d40-8610-1bd08249c837" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:32:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "15aa3de5-baee-4d40-8610-1bd08249c837-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:32:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "15aa3de5-baee-4d40-8610-1bd08249c837-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:32:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "15aa3de5-baee-4d40-8610-1bd08249c837-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:32:23 user nova-compute[72849]: INFO nova.compute.manager [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Terminating instance
Aug 15 16:32:23 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:32:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-afd0ed63-9f78-4bca-b019-4b2df6f3a892 req-cc653bc0-28f0-4fc0-b91c-924d138a51f6 service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Received event network-vif-unplugged-f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:32:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-afd0ed63-9f78-4bca-b019-4b2df6f3a892 req-cc653bc0-28f0-4fc0-b91c-924d138a51f6 service nova] Acquiring lock "15aa3de5-baee-4d40-8610-1bd08249c837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:32:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-afd0ed63-9f78-4bca-b019-4b2df6f3a892 req-cc653bc0-28f0-4fc0-b91c-924d138a51f6 service nova] Lock "15aa3de5-baee-4d40-8610-1bd08249c837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:32:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-afd0ed63-9f78-4bca-b019-4b2df6f3a892 req-cc653bc0-28f0-4fc0-b91c-924d138a51f6 service nova] Lock "15aa3de5-baee-4d40-8610-1bd08249c837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:32:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-afd0ed63-9f78-4bca-b019-4b2df6f3a892 req-cc653bc0-28f0-4fc0-b91c-924d138a51f6 service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] No waiting events found dispatching network-vif-unplugged-f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:32:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-afd0ed63-9f78-4bca-b019-4b2df6f3a892 req-cc653bc0-28f0-4fc0-b91c-924d138a51f6 service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Received event network-vif-unplugged-f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:32:24 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Instance destroyed successfully.
Aug 15 16:32:24 user nova-compute[72849]: DEBUG nova.objects.instance [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'resources' on Instance uuid 15aa3de5-baee-4d40-8610-1bd08249c837 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:32:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:26:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1547849743',display_name='tempest-AttachVolumeNegativeTest-server-1547849743',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1547849743',id=26,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw47CHyB3PkFVkTAeF16KwePrqj25hUBKXEHVU+LaQn+xs6YcCej6MnsV6xB8I/4RiJMRqo7S1Y7VagB2YKuovDg0jc1tZ/6DaPQd2Tr8/xLrjdRJjz8q+G1Q+F2LkbQA==',key_name='tempest-keypair-1368480049',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:26:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0ddd223976e4b13a3b6a5638846f83a',ramdisk_id='',reservation_id='r-zgnqwo5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-693282259',owner_user_name='tempest-AttachVolumeNegativeTest-693282259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e99eefba54014b9ea83f1611b02efaad',uuid=15aa3de5-baee-4d40-8610-1bd08249c837,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "address": "fa:16:3e:e3:8c:d7", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f4dc6a-e6", "ovs_interfaceid": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:32:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converting VIF {"id": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "address": "fa:16:3e:e3:8c:d7", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f4dc6a-e6", "ovs_interfaceid": "f4f4dc6a-e6b1-4777-b99b-c240cdbc8587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:32:24 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=f4f4dc6a-e6b1-4777-b99b-c240cdbc8587,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f4dc6a-e6') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:32:24 user nova-compute[72849]: DEBUG os_vif [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=f4f4dc6a-e6b1-4777-b99b-c240cdbc8587,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f4dc6a-e6') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:32:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4f4dc6a-e6, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:32:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:32:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:24 user nova-compute[72849]: INFO os_vif [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:8c:d7,bridge_name='br-int',has_traffic_filtering=True,id=f4f4dc6a-e6b1-4777-b99b-c240cdbc8587,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f4dc6a-e6')
Aug 15 16:32:24 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Deleting instance files /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837_del
Aug 15 16:32:24 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Deletion of /opt/stack/data/nova/instances/15aa3de5-baee-4d40-8610-1bd08249c837_del complete
Aug 15 16:32:24 user nova-compute[72849]: INFO nova.compute.manager [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 15 16:32:24 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:32:24 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:32:24 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:32:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:25 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:32:25 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Took 1.08 seconds to deallocate network for instance.
Aug 15 16:32:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-897fa952-b39f-4a01-bd04-f01be20cacaa req-c1748567-2db0-4625-b6b5-eb33910e95c3 service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Received event network-vif-deleted-f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:32:25 user nova-compute[72849]: INFO nova.compute.manager [req-897fa952-b39f-4a01-bd04-f01be20cacaa req-c1748567-2db0-4625-b6b5-eb33910e95c3 service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Neutron deleted interface f4f4dc6a-e6b1-4777-b99b-c240cdbc8587; detaching it from the instance and deleting it from the info cache
Aug 15 16:32:25 user nova-compute[72849]: DEBUG nova.network.neutron [req-897fa952-b39f-4a01-bd04-f01be20cacaa req-c1748567-2db0-4625-b6b5-eb33910e95c3 service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:32:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-897fa952-b39f-4a01-bd04-f01be20cacaa req-c1748567-2db0-4625-b6b5-eb33910e95c3 service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Detach interface failed, port_id=f4f4dc6a-e6b1-4777-b99b-c240cdbc8587, reason: Instance 15aa3de5-baee-4d40-8610-1bd08249c837 could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:32:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:32:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:32:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-f7af614f-be0f-4de3-bdfb-cd5cc408a33f req-4bb517e4-d475-4a52-b203-9e4ed100c1d2 service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Received event network-vif-plugged-f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:32:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f7af614f-be0f-4de3-bdfb-cd5cc408a33f req-4bb517e4-d475-4a52-b203-9e4ed100c1d2 service nova] Acquiring lock "15aa3de5-baee-4d40-8610-1bd08249c837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:32:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f7af614f-be0f-4de3-bdfb-cd5cc408a33f req-4bb517e4-d475-4a52-b203-9e4ed100c1d2 service nova] Lock "15aa3de5-baee-4d40-8610-1bd08249c837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:32:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f7af614f-be0f-4de3-bdfb-cd5cc408a33f req-4bb517e4-d475-4a52-b203-9e4ed100c1d2 service nova] Lock "15aa3de5-baee-4d40-8610-1bd08249c837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:32:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-f7af614f-be0f-4de3-bdfb-cd5cc408a33f req-4bb517e4-d475-4a52-b203-9e4ed100c1d2 service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] No waiting events found dispatching network-vif-plugged-f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:32:26 user nova-compute[72849]: WARNING nova.compute.manager [req-f7af614f-be0f-4de3-bdfb-cd5cc408a33f req-4bb517e4-d475-4a52-b203-9e4ed100c1d2 service nova] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Received unexpected event network-vif-plugged-f4f4dc6a-e6b1-4777-b99b-c240cdbc8587 for instance with vm_state deleted and task_state None.
Aug 15 16:32:26 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:32:26 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:32:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.547s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:32:26 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Deleted allocations for instance 15aa3de5-baee-4d40-8610-1bd08249c837
Aug 15 16:32:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-de515bf9-5f63-4a2b-b7e2-7154c664269f tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "15aa3de5-baee-4d40-8610-1bd08249c837" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.783s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:32:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "0900e8d0-6e7f-40a3-9016-39851e697d09" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:32:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:32:27 user nova-compute[72849]: INFO nova.compute.manager [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Detaching volume 01844056-f830-4161-b587-6dd5728c9605
Aug 15 16:32:27 user nova-compute[72849]: INFO nova.virt.block_device [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Attempting to driver detach volume 01844056-f830-4161-b587-6dd5728c9605 from mountpoint /dev/vdc
Aug 15 16:32:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Attempting to detach device vdc from instance 0900e8d0-6e7f-40a3-9016-39851e697d09 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:32:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:32:27 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:32:27 user nova-compute[72849]:   <source dev="/dev/sdh"/>
Aug 15 16:32:27 user nova-compute[72849]:   <target dev="vdc" bus="virtio"/>
Aug 15 16:32:27 user nova-compute[72849]:   <serial>01844056-f830-4161-b587-6dd5728c9605</serial>
Aug 15 16:32:27 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 16:32:27 user nova-compute[72849]: </disk>
Aug 15 16:32:27 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:32:27 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Successfully detached device vdc from instance 0900e8d0-6e7f-40a3-9016-39851e697d09 from the persistent domain config.
Aug 15 16:32:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0900e8d0-6e7f-40a3-9016-39851e697d09 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:32:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:32:27 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:32:27 user nova-compute[72849]:   <source dev="/dev/sdh"/>
Aug 15 16:32:27 user nova-compute[72849]:   <target dev="vdc" bus="virtio"/>
Aug 15 16:32:27 user nova-compute[72849]:   <serial>01844056-f830-4161-b587-6dd5728c9605</serial>
Aug 15 16:32:27 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 16:32:27 user nova-compute[72849]: </disk>
Aug 15 16:32:27 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692117148.01372, 0900e8d0-6e7f-40a3-9016-39851e697d09 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0900e8d0-6e7f-40a3-9016-39851e697d09 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:32:28 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Successfully detached device vdc from instance 0900e8d0-6e7f-40a3-9016-39851e697d09 from the live domain config.
Aug 15 16:32:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yKHRAjgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:32:28 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:32:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f6fe7f-8bea-46f5-8977-ba47ee3ac6dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15679e0-b7aa-46ef-ab34-b0a11f39b9a4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:32:28 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:32:28 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:32:28 user nova-compute[72849]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)
Aug 15 16:32:28 user nova-compute[72849]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)
Aug 15 16:32:28 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:32:28 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:32:28 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:32:28 user nova-compute[72849]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 (non-flash)
Aug 15 16:32:28 user nova-compute[72849]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)
Aug 15 16:32:28 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc338736320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605'): ({'sdh'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Removing single pathed devices sdh {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd69a20-145a-45a3-9c97-382e0b9e2609]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[628acd7f-3f1f-478d-b63c-73dfe44d4e41]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Flushing IO for device /dev/sdh {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[91aff75c-5bc8-408a-adb5-17f81c1fb524]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b524418f-872c-4c18-803f-95af0e9de16f]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] SCSI volumes sdh have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3294bf4-7847-4631-a9e7-b7431816aa5c]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1927ea1f-b35d-4841-ab1e-dd24202868f5]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605, portal: 172.16.0.220,3260]
Aug 15 16:32:28 user nova-compute[72849]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605, portal: 172.16.0.220,3260] successful.
Aug 15 16:32:28 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01844056-f830-4161-b587-6dd5728c9605 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a05820-bdb5-47be-8938-58b7939d78c9]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] <== disconnect_volume: return (323ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:32:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:29 user nova-compute[72849]: DEBUG nova.objects.instance [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'flavor' on Instance uuid 0900e8d0-6e7f-40a3-9016-39851e697d09 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:32:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c037b3da-6708-49dc-940a-b3fa4cee11fe tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.655s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:32:29 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:32:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:30 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:32:32 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:32:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:32:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:32:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:32:32 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:32:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:33 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Updating instance_info_cache with network_info: [{"id": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "address": "fa:16:3e:15:be:6e", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d74bc-a2", "ovs_interfaceid": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:32:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-388aa265-fc0a-4928-935e-5e04e65199f6" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:32:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:32:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:32:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:32:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:32:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 16:32:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] There are 0 instances to clean {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 16:32:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:34 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:32:34 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:32:34 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:32:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:32:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:32:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:32:34 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:32:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:32:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:32:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:32:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:32:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:32:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:32:39 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:32:39 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=7128MB free_disk=25.015338897705078GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117144.450652, 15aa3de5-baee-4d40-8610-1bd08249c837 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:32:39 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] VM Stopped (Lifecycle Event)
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-42d51d59-13d4-4717-93da-38e829c5db85 None None] [instance: 15aa3de5-baee-4d40-8610-1bd08249c837] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc521d87-09aa-44ba-a87c-1cd5517b3707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 46f0aa43-e313-4aff-bacc-aa5290193b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance d51623f1-6613-41d6-abcb-9e4e626a97af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f1da55ae-5150-476c-a229-f26ddfee7e9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance ea9d5a00-42db-41e4-bb81-b3875e84f16c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 82f61128-3af4-4f82-ac4c-8ee746b5a829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b15c5692-8c0c-4bf0-a79f-b7813e71de9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 98358bbf-c7c1-4868-81ee-77bd229133fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0900e8d0-6e7f-40a3-9016-39851e697d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing inventories for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating ProviderTree inventory for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating inventory in ProviderTree for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing aggregate associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, aggregates: None {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 16:32:39 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing trait associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 16:32:40 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:32:40 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:32:40 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:32:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.936s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:32:40 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:32:40 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72849) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 16:32:40 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:32:41 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:32:41 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:32:41 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:32:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:32:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:32:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.objects.instance [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'flavor' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "refresh_cache-f1da55ae-5150-476c-a229-f26ddfee7e9e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquired lock "refresh_cache-f1da55ae-5150-476c-a229-f26ddfee7e9e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.network.neutron [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.objects.instance [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'info_cache' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 388aa265-fc0a-4928-935e-5e04e65199f6 {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid cc521d87-09aa-44ba-a87c-1cd5517b3707 {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 46f0aa43-e313-4aff-bacc-aa5290193b00 {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid d51623f1-6613-41d6-abcb-9e4e626a97af {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 0900e8d0-6e7f-40a3-9016-39851e697d09 {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid ea9d5a00-42db-41e4-bb81-b3875e84f16c {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 82f61128-3af4-4f82-ac4c-8ee746b5a829 {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 98358bbf-c7c1-4868-81ee-77bd229133fd {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid b15c5692-8c0c-4bf0-a79f-b7813e71de9a {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "388aa265-fc0a-4928-935e-5e04e65199f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "388aa265-fc0a-4928-935e-5e04e65199f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "cc521d87-09aa-44ba-a87c-1cd5517b3707" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "46f0aa43-e313-4aff-bacc-aa5290193b00" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "d51623f1-6613-41d6-abcb-9e4e626a97af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "d51623f1-6613-41d6-abcb-9e4e626a97af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:04 user nova-compute[72849]: INFO nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "0900e8d0-6e7f-40a3-9016-39851e697d09" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "98358bbf-c7c1-4868-81ee-77bd229133fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "388aa265-fc0a-4928-935e-5e04e65199f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "d51623f1-6613-41d6-abcb-9e4e626a97af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.network.neutron [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Updating instance_info_cache with network_info: [{"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Releasing lock "refresh_cache-f1da55ae-5150-476c-a229-f26ddfee7e9e" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:33:04 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Instance destroyed successfully.
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.objects.instance [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'resources' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:25:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1450170250',display_name='tempest-AttachVolumeTestJSON-server-1450170250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1450170250',id=25,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbHBCrfJdjyvvfHVCDAyVY3pxTMcpwjUaUui51i7UWK+4o1OUXo/LN4XWDmXW8h8aEFw/JKcC9Dwq6+Cbh0MQQ2dswuJTGFHVpH2lAWXJOXrjs0Yd41UjVwgxvzDZT+WQ==',key_name='tempest-keypair-1527966259',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='607d6d3506de49549888f16d06829c89',ramdisk_id='',reservation_id='r-vfgrreq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1114163063',owner_user_name='tempest-AttachVolumeTestJSON-1114163063-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:31:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abdcfedce2124d86a0df67571fdfcde9',uuid=f1da55ae-5150-476c-a229-f26ddfee7e9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converting VIF {"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG os_vif [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71bc55dc-c0, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:04 user nova-compute[72849]: INFO os_vif [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0')
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Start _get_guest_xml network_info=[{"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.objects.instance [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'numa_topology' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:33:04 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:33:04 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.objects.instance [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'vcpu_model' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:25:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1450170250',display_name='tempest-AttachVolumeTestJSON-server-1450170250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1450170250',id=25,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbHBCrfJdjyvvfHVCDAyVY3pxTMcpwjUaUui51i7UWK+4o1OUXo/LN4XWDmXW8h8aEFw/JKcC9Dwq6+Cbh0MQQ2dswuJTGFHVpH2lAWXJOXrjs0Yd41UjVwgxvzDZT+WQ==',key_name='tempest-keypair-1527966259',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='607d6d3506de49549888f16d06829c89',ramdisk_id='',reservation_id='r-vfgrreq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1114163063',owner_user_name='tempest-AttachVolumeTestJSON-1114163063-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:31:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abdcfedce2124d86a0df67571fdfcde9',uuid=f1da55ae-5150-476c-a229-f26ddfee7e9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converting VIF {"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.objects.instance [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'pci_devices' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:33:04 user nova-compute[72849]:   <uuid>f1da55ae-5150-476c-a229-f26ddfee7e9e</uuid>
Aug 15 16:33:04 user nova-compute[72849]:   <name>instance-00000019</name>
Aug 15 16:33:04 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:33:04 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:33:04 user nova-compute[72849]:   <metadata>
Aug 15 16:33:04 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:33:04 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:33:04 user nova-compute[72849]:       <nova:name>tempest-AttachVolumeTestJSON-server-1450170250</nova:name>
Aug 15 16:33:04 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:33:04</nova:creationTime>
Aug 15 16:33:04 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:33:04 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:33:04 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:33:04 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:33:04 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:33:04 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:33:04 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:33:04 user nova-compute[72849]:       <nova:owner>
Aug 15 16:33:04 user nova-compute[72849]:         <nova:user uuid="abdcfedce2124d86a0df67571fdfcde9">tempest-AttachVolumeTestJSON-1114163063-project-member</nova:user>
Aug 15 16:33:04 user nova-compute[72849]:         <nova:project uuid="607d6d3506de49549888f16d06829c89">tempest-AttachVolumeTestJSON-1114163063</nova:project>
Aug 15 16:33:04 user nova-compute[72849]:       </nova:owner>
Aug 15 16:33:04 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:33:04 user nova-compute[72849]:       <nova:ports>
Aug 15 16:33:04 user nova-compute[72849]:         <nova:port uuid="71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba">
Aug 15 16:33:04 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 16:33:04 user nova-compute[72849]:         </nova:port>
Aug 15 16:33:04 user nova-compute[72849]:       </nova:ports>
Aug 15 16:33:04 user nova-compute[72849]:     </nova:instance>
Aug 15 16:33:04 user nova-compute[72849]:   </metadata>
Aug 15 16:33:04 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:33:04 user nova-compute[72849]:     <system>
Aug 15 16:33:04 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:33:04 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:33:04 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:33:04 user nova-compute[72849]:       <entry name="serial">f1da55ae-5150-476c-a229-f26ddfee7e9e</entry>
Aug 15 16:33:04 user nova-compute[72849]:       <entry name="uuid">f1da55ae-5150-476c-a229-f26ddfee7e9e</entry>
Aug 15 16:33:04 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:33:04 user nova-compute[72849]:     </system>
Aug 15 16:33:04 user nova-compute[72849]:   </sysinfo>
Aug 15 16:33:04 user nova-compute[72849]:   <os>
Aug 15 16:33:04 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:33:04 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:33:04 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:33:04 user nova-compute[72849]:   </os>
Aug 15 16:33:04 user nova-compute[72849]:   <features>
Aug 15 16:33:04 user nova-compute[72849]:     <acpi/>
Aug 15 16:33:04 user nova-compute[72849]:     <apic/>
Aug 15 16:33:04 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:33:04 user nova-compute[72849]:   </features>
Aug 15 16:33:04 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:33:04 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:33:04 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:33:04 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:33:04 user nova-compute[72849]:   </clock>
Aug 15 16:33:04 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:33:04 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:33:04 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:33:04 user nova-compute[72849]:   </cpu>
Aug 15 16:33:04 user nova-compute[72849]:   <devices>
Aug 15 16:33:04 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:33:04 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:33:04 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk"/>
Aug 15 16:33:04 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:33:04 user nova-compute[72849]:     </disk>
Aug 15 16:33:04 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:33:04 user nova-compute[72849]:       <mac address="fa:16:3e:62:d6:3e"/>
Aug 15 16:33:04 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:33:04 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:33:04 user nova-compute[72849]:       <target dev="tap71bc55dc-c0"/>
Aug 15 16:33:04 user nova-compute[72849]:     </interface>
Aug 15 16:33:04 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:33:04 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/console.log" append="off"/>
Aug 15 16:33:04 user nova-compute[72849]:     </serial>
Aug 15 16:33:04 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:33:04 user nova-compute[72849]:     <video>
Aug 15 16:33:04 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:33:04 user nova-compute[72849]:     </video>
Aug 15 16:33:04 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:33:04 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:33:04 user nova-compute[72849]:     </rng>
Aug 15 16:33:04 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:33:04 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:33:04 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:33:04 user nova-compute[72849]:     </memballoon>
Aug 15 16:33:04 user nova-compute[72849]:   </devices>
Aug 15 16:33:04 user nova-compute[72849]: </domain>
Aug 15 16:33:04 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:33:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG nova.objects.instance [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'trusted_certs' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.234s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Cannot resize image /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG nova.objects.instance [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'migration_context' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:25:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1450170250',display_name='tempest-AttachVolumeTestJSON-server-1450170250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1450170250',id=25,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbHBCrfJdjyvvfHVCDAyVY3pxTMcpwjUaUui51i7UWK+4o1OUXo/LN4XWDmXW8h8aEFw/JKcC9Dwq6+Cbh0MQQ2dswuJTGFHVpH2lAWXJOXrjs0Yd41UjVwgxvzDZT+WQ==',key_name='tempest-keypair-1527966259',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='607d6d3506de49549888f16d06829c89',ramdisk_id='',reservation_id='r-vfgrreq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1114163063',owner_user_name='tempest-AttachVolumeTestJSON-1114163063-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:31:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abdcfedce2124d86a0df67571fdfcde9',uuid=f1da55ae-5150-476c-a229-f26ddfee7e9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converting VIF {"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG os_vif [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71bc55dc-c0, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71bc55dc-c0, col_values=(('external_ids', {'iface-id': '71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:d6:3e', 'vm-uuid': 'f1da55ae-5150-476c-a229-f26ddfee7e9e'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:33:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:05 user nova-compute[72849]: INFO os_vif [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0')
Aug 15 16:33:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-f79d2e96-159f-4d68-92bf-5eb667dba809 req-31370573-53ea-4f8c-bd1a-7723dc45d278 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received event network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:33:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f79d2e96-159f-4d68-92bf-5eb667dba809 req-31370573-53ea-4f8c-bd1a-7723dc45d278 service nova] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f79d2e96-159f-4d68-92bf-5eb667dba809 req-31370573-53ea-4f8c-bd1a-7723dc45d278 service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f79d2e96-159f-4d68-92bf-5eb667dba809 req-31370573-53ea-4f8c-bd1a-7723dc45d278 service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-f79d2e96-159f-4d68-92bf-5eb667dba809 req-31370573-53ea-4f8c-bd1a-7723dc45d278 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] No waiting events found dispatching network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:33:07 user nova-compute[72849]: WARNING nova.compute.manager [req-f79d2e96-159f-4d68-92bf-5eb667dba809 req-31370573-53ea-4f8c-bd1a-7723dc45d278 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received unexpected event network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba for instance with vm_state stopped and task_state powering-on.
Aug 15 16:33:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:08 user nova-compute[72849]: INFO nova.compute.manager [None req-1bce50a2-04aa-4db5-be1e-73b16c600a43 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Unrescuing
Aug 15 16:33:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1bce50a2-04aa-4db5-be1e-73b16c600a43 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:33:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1bce50a2-04aa-4db5-be1e-73b16c600a43 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquired lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:33:08 user nova-compute[72849]: DEBUG nova.network.neutron [None req-1bce50a2-04aa-4db5-be1e-73b16c600a43 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:33:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:09 user nova-compute[72849]: DEBUG nova.network.neutron [None req-1bce50a2-04aa-4db5-be1e-73b16c600a43 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Updating instance_info_cache with network_info: [{"id": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "address": "fa:16:3e:8a:41:62", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183f8f-93", "ovs_interfaceid": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:33:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1bce50a2-04aa-4db5-be1e-73b16c600a43 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Releasing lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:33:09 user nova-compute[72849]: DEBUG nova.objects.instance [None req-1bce50a2-04aa-4db5-be1e-73b16c600a43 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'flavor' on Instance uuid b15c5692-8c0c-4bf0-a79f-b7813e71de9a {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:33:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-5fa6cdff-fb96-41fc-8c71-a2a61deecb33 req-9fbeff72-5f0e-4c27-abae-0c0b0732f4c6 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received event network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:33:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5fa6cdff-fb96-41fc-8c71-a2a61deecb33 req-9fbeff72-5f0e-4c27-abae-0c0b0732f4c6 service nova] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5fa6cdff-fb96-41fc-8c71-a2a61deecb33 req-9fbeff72-5f0e-4c27-abae-0c0b0732f4c6 service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5fa6cdff-fb96-41fc-8c71-a2a61deecb33 req-9fbeff72-5f0e-4c27-abae-0c0b0732f4c6 service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-5fa6cdff-fb96-41fc-8c71-a2a61deecb33 req-9fbeff72-5f0e-4c27-abae-0c0b0732f4c6 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] No waiting events found dispatching network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:33:09 user nova-compute[72849]: WARNING nova.compute.manager [req-5fa6cdff-fb96-41fc-8c71-a2a61deecb33 req-9fbeff72-5f0e-4c27-abae-0c0b0732f4c6 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received unexpected event network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba for instance with vm_state stopped and task_state powering-on.
Aug 15 16:33:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:09 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117189.6488283, f1da55ae-5150-476c-a229-f26ddfee7e9e => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:33:09 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] VM Resumed (Lifecycle Event)
Aug 15 16:33:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:09 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:33:09 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Instance rebooted successfully.
Aug 15 16:33:09 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0bdbe612-cf82-40e7-a7f9-e615c794c0f7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:33:09 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:33:09 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:33:09 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 16:33:09 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117189.658033, f1da55ae-5150-476c-a229-f26ddfee7e9e => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:33:09 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] VM Started (Lifecycle Event)
Aug 15 16:33:09 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:33:09 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:33:09 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 16:33:09 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Instance destroyed successfully.
Aug 15 16:33:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-7adc2834-7975-4ad7-864b-f9218c309243 req-9f337ee5-a0f2-46cb-b61f-7017282d9df9 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received event network-vif-unplugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:33:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7adc2834-7975-4ad7-864b-f9218c309243 req-9f337ee5-a0f2-46cb-b61f-7017282d9df9 service nova] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7adc2834-7975-4ad7-864b-f9218c309243 req-9f337ee5-a0f2-46cb-b61f-7017282d9df9 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7adc2834-7975-4ad7-864b-f9218c309243 req-9f337ee5-a0f2-46cb-b61f-7017282d9df9 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-7adc2834-7975-4ad7-864b-f9218c309243 req-9f337ee5-a0f2-46cb-b61f-7017282d9df9 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] No waiting events found dispatching network-vif-unplugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:33:11 user nova-compute[72849]: WARNING nova.compute.manager [req-7adc2834-7975-4ad7-864b-f9218c309243 req-9f337ee5-a0f2-46cb-b61f-7017282d9df9 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received unexpected event network-vif-unplugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 for instance with vm_state rescued and task_state unrescuing.
Aug 15 16:33:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-7adc2834-7975-4ad7-864b-f9218c309243 req-9f337ee5-a0f2-46cb-b61f-7017282d9df9 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received event network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:33:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7adc2834-7975-4ad7-864b-f9218c309243 req-9f337ee5-a0f2-46cb-b61f-7017282d9df9 service nova] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7adc2834-7975-4ad7-864b-f9218c309243 req-9f337ee5-a0f2-46cb-b61f-7017282d9df9 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7adc2834-7975-4ad7-864b-f9218c309243 req-9f337ee5-a0f2-46cb-b61f-7017282d9df9 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-7adc2834-7975-4ad7-864b-f9218c309243 req-9f337ee5-a0f2-46cb-b61f-7017282d9df9 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] No waiting events found dispatching network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:33:11 user nova-compute[72849]: WARNING nova.compute.manager [req-7adc2834-7975-4ad7-864b-f9218c309243 req-9f337ee5-a0f2-46cb-b61f-7017282d9df9 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received unexpected event network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 for instance with vm_state rescued and task_state unrescuing.
Aug 15 16:33:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-d8f356fa-d800-4606-8dc6-2505fe6e926f req-a7da5696-c940-45fc-ae3c-aef22debdcb8 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received event network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:33:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d8f356fa-d800-4606-8dc6-2505fe6e926f req-a7da5696-c940-45fc-ae3c-aef22debdcb8 service nova] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d8f356fa-d800-4606-8dc6-2505fe6e926f req-a7da5696-c940-45fc-ae3c-aef22debdcb8 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d8f356fa-d800-4606-8dc6-2505fe6e926f req-a7da5696-c940-45fc-ae3c-aef22debdcb8 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-d8f356fa-d800-4606-8dc6-2505fe6e926f req-a7da5696-c940-45fc-ae3c-aef22debdcb8 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] No waiting events found dispatching network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:33:13 user nova-compute[72849]: WARNING nova.compute.manager [req-d8f356fa-d800-4606-8dc6-2505fe6e926f req-a7da5696-c940-45fc-ae3c-aef22debdcb8 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received unexpected event network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 for instance with vm_state rescued and task_state unrescuing.
Aug 15 16:33:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-d8f356fa-d800-4606-8dc6-2505fe6e926f req-a7da5696-c940-45fc-ae3c-aef22debdcb8 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received event network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:33:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d8f356fa-d800-4606-8dc6-2505fe6e926f req-a7da5696-c940-45fc-ae3c-aef22debdcb8 service nova] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d8f356fa-d800-4606-8dc6-2505fe6e926f req-a7da5696-c940-45fc-ae3c-aef22debdcb8 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d8f356fa-d800-4606-8dc6-2505fe6e926f req-a7da5696-c940-45fc-ae3c-aef22debdcb8 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-d8f356fa-d800-4606-8dc6-2505fe6e926f req-a7da5696-c940-45fc-ae3c-aef22debdcb8 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] No waiting events found dispatching network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:33:13 user nova-compute[72849]: WARNING nova.compute.manager [req-d8f356fa-d800-4606-8dc6-2505fe6e926f req-a7da5696-c940-45fc-ae3c-aef22debdcb8 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received unexpected event network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 for instance with vm_state rescued and task_state unrescuing.
Aug 15 16:33:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Removed pending event for b15c5692-8c0c-4bf0-a79f-b7813e71de9a due to event {{(pid=72849) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 16:33:13 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117193.853789, b15c5692-8c0c-4bf0-a79f-b7813e71de9a => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:33:13 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] VM Resumed (Lifecycle Event)
Aug 15 16:33:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-1bce50a2-04aa-4db5-be1e-73b16c600a43 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:33:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:33:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:33:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:13 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 16:33:13 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117193.8634384, b15c5692-8c0c-4bf0-a79f-b7813e71de9a => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:33:13 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] VM Started (Lifecycle Event)
Aug 15 16:33:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:33:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:33:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:15 user nova-compute[72849]: INFO nova.compute.manager [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Terminating instance
Aug 15 16:33:15 user nova-compute[72849]: DEBUG nova.compute.manager [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:33:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:16 user nova-compute[72849]: DEBUG nova.compute.manager [req-98964b8d-24ba-46dd-b9b2-8de6d42ba1be req-b31f7486-90f5-4995-8ebd-1e953a765127 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received event network-vif-unplugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:33:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-98964b8d-24ba-46dd-b9b2-8de6d42ba1be req-b31f7486-90f5-4995-8ebd-1e953a765127 service nova] Acquiring lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-98964b8d-24ba-46dd-b9b2-8de6d42ba1be req-b31f7486-90f5-4995-8ebd-1e953a765127 service nova] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-98964b8d-24ba-46dd-b9b2-8de6d42ba1be req-b31f7486-90f5-4995-8ebd-1e953a765127 service nova] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:16 user nova-compute[72849]: DEBUG nova.compute.manager [req-98964b8d-24ba-46dd-b9b2-8de6d42ba1be req-b31f7486-90f5-4995-8ebd-1e953a765127 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] No waiting events found dispatching network-vif-unplugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:33:16 user nova-compute[72849]: DEBUG nova.compute.manager [req-98964b8d-24ba-46dd-b9b2-8de6d42ba1be req-b31f7486-90f5-4995-8ebd-1e953a765127 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received event network-vif-unplugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:33:16 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Instance destroyed successfully.
Aug 15 16:33:16 user nova-compute[72849]: DEBUG nova.objects.instance [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lazy-loading 'resources' on Instance uuid 82f61128-3af4-4f82-ac4c-8ee746b5a829 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:33:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-365929827',display_name='tempest-TestMinimumBasicScenario-server-365929827',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-365929827',id=29,image_ref='6719f73e-264d-4d11-bcbd-f88a02f98c71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjER5UtwRI+rP16dcAJycNrE1LL4uKxZ8IeE4zGjJ4ywSwno6+QPUQPvFfyNaI/VvBhZlT34caF/ZgMZ1ggK70kd84SJPZ4Pq2yHXiJU9gvoSUbLNznFdDAQXqw1xpPLA==',key_name='tempest-TestMinimumBasicScenario-1014285734',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:28:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8512a50775b24f798c5cf345f08e0dd2',ramdisk_id='',reservation_id='r-kp7aiq6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6719f73e-264d-4d11-bcbd-f88a02f98c71',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2032437405',owner_user_name='tempest-TestMinimumBasicScenario-2032437405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:30:26Z,user_data=None,user_id='d9420a64b5ea462681f3a9c6cf55986c',uuid=82f61128-3af4-4f82-ac4c-8ee746b5a829,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "address": "fa:16:3e:ca:59:78", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef6b77c-23", "ovs_interfaceid": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:33:16 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Converting VIF {"id": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "address": "fa:16:3e:ca:59:78", "network": {"id": "9098684e-8392-46a8-b5ee-6f1846a3e64a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1194804297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8512a50775b24f798c5cf345f08e0dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef6b77c-23", "ovs_interfaceid": "1ef6b77c-2391-485e-ad7f-851bfac1b315", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:33:16 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:59:78,bridge_name='br-int',has_traffic_filtering=True,id=1ef6b77c-2391-485e-ad7f-851bfac1b315,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef6b77c-23') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:33:16 user nova-compute[72849]: DEBUG os_vif [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:59:78,bridge_name='br-int',has_traffic_filtering=True,id=1ef6b77c-2391-485e-ad7f-851bfac1b315,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef6b77c-23') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:33:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ef6b77c-23, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:33:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:16 user nova-compute[72849]: INFO os_vif [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:59:78,bridge_name='br-int',has_traffic_filtering=True,id=1ef6b77c-2391-485e-ad7f-851bfac1b315,network=Network(9098684e-8392-46a8-b5ee-6f1846a3e64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef6b77c-23')
Aug 15 16:33:16 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Deleting instance files /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829_del
Aug 15 16:33:16 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Deletion of /opt/stack/data/nova/instances/82f61128-3af4-4f82-ac4c-8ee746b5a829_del complete
Aug 15 16:33:16 user nova-compute[72849]: INFO nova.compute.manager [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 15 16:33:16 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:33:16 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:33:16 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:33:17 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:33:17 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Took 0.92 seconds to deallocate network for instance.
Aug 15 16:33:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-fc3bf097-8323-44fe-9aef-32db5e01ed35 req-b929961c-9644-4501-b728-07f6ef6cccef service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received event network-vif-deleted-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:33:17 user nova-compute[72849]: INFO nova.compute.manager [req-fc3bf097-8323-44fe-9aef-32db5e01ed35 req-b929961c-9644-4501-b728-07f6ef6cccef service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Neutron deleted interface 1ef6b77c-2391-485e-ad7f-851bfac1b315; detaching it from the instance and deleting it from the info cache
Aug 15 16:33:17 user nova-compute[72849]: DEBUG nova.network.neutron [req-fc3bf097-8323-44fe-9aef-32db5e01ed35 req-b929961c-9644-4501-b728-07f6ef6cccef service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:33:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-fc3bf097-8323-44fe-9aef-32db5e01ed35 req-b929961c-9644-4501-b728-07f6ef6cccef service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Detach interface failed, port_id=1ef6b77c-2391-485e-ad7f-851bfac1b315, reason: Instance 82f61128-3af4-4f82-ac4c-8ee746b5a829 could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:33:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "0900e8d0-6e7f-40a3-9016-39851e697d09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:17 user nova-compute[72849]: INFO nova.compute.manager [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Terminating instance
Aug 15 16:33:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:33:17 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:33:17 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:33:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.594s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:18 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Deleted allocations for instance 82f61128-3af4-4f82-ac4c-8ee746b5a829
Aug 15 16:33:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-da2cad41-fd10-4fa7-9aed-5139ea1da021 tempest-TestMinimumBasicScenario-2032437405 tempest-TestMinimumBasicScenario-2032437405-project-member] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.724s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-fab36150-be04-418f-b143-3abb76eb89db req-eef738bc-13e7-489b-857e-b3b5634c6749 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received event network-vif-plugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:33:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fab36150-be04-418f-b143-3abb76eb89db req-eef738bc-13e7-489b-857e-b3b5634c6749 service nova] Acquiring lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fab36150-be04-418f-b143-3abb76eb89db req-eef738bc-13e7-489b-857e-b3b5634c6749 service nova] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fab36150-be04-418f-b143-3abb76eb89db req-eef738bc-13e7-489b-857e-b3b5634c6749 service nova] Lock "82f61128-3af4-4f82-ac4c-8ee746b5a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-fab36150-be04-418f-b143-3abb76eb89db req-eef738bc-13e7-489b-857e-b3b5634c6749 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] No waiting events found dispatching network-vif-plugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:33:18 user nova-compute[72849]: WARNING nova.compute.manager [req-fab36150-be04-418f-b143-3abb76eb89db req-eef738bc-13e7-489b-857e-b3b5634c6749 service nova] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Received unexpected event network-vif-plugged-1ef6b77c-2391-485e-ad7f-851bfac1b315 for instance with vm_state deleted and task_state None.
Aug 15 16:33:18 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Instance destroyed successfully.
Aug 15 16:33:18 user nova-compute[72849]: DEBUG nova.objects.instance [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'resources' on Instance uuid 0900e8d0-6e7f-40a3-9016-39851e697d09 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:33:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T16:26:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1356134043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1356134043',id=27,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFI/WYqNgdhrW6ev+SXUzc863+su95TT4W3Vt1HMyWURKe/jZziC6ZzGxo7ZQjy5wAZn1VasI3e3uGWKduWt4WYUmvmETmO7289jUPX5hc72NdFOqpXF4ziM1kL0kqT9CQ==',key_name='tempest-keypair-1318766870',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:31:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bb636c3c71c479d90cf2e170db941e1',ramdisk_id='',reservation_id='r-ik1in1jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1263463439',owner_user_name='tempest-AttachVolumeShelveTestJSON-1263463439-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:31:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867f247fc90437899a13a7451a3249a',uuid=0900e8d0-6e7f-40a3-9016-39851e697d09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:33:18 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converting VIF {"id": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "address": "fa:16:3e:de:64:c5", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58268f65-6b", "ovs_interfaceid": "58268f65-6b08-4cdd-9ae3-b256ed150e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:33:18 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:64:c5,bridge_name='br-int',has_traffic_filtering=True,id=58268f65-6b08-4cdd-9ae3-b256ed150e60,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58268f65-6b') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:33:18 user nova-compute[72849]: DEBUG os_vif [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:64:c5,bridge_name='br-int',has_traffic_filtering=True,id=58268f65-6b08-4cdd-9ae3-b256ed150e60,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58268f65-6b') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:33:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58268f65-6b, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:33:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:33:18 user nova-compute[72849]: INFO os_vif [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:64:c5,bridge_name='br-int',has_traffic_filtering=True,id=58268f65-6b08-4cdd-9ae3-b256ed150e60,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58268f65-6b')
Aug 15 16:33:18 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Deleting instance files /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09_del
Aug 15 16:33:18 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Deletion of /opt/stack/data/nova/instances/0900e8d0-6e7f-40a3-9016-39851e697d09_del complete
Aug 15 16:33:18 user nova-compute[72849]: INFO nova.compute.manager [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 15 16:33:18 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:33:18 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:33:18 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:33:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:33:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-5856cea1-3d9d-4624-82ba-0248a24ef3a2 req-f52a2bf6-1c92-4890-9574-3f7a12e2350c service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received event network-vif-unplugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:33:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5856cea1-3d9d-4624-82ba-0248a24ef3a2 req-f52a2bf6-1c92-4890-9574-3f7a12e2350c service nova] Acquiring lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5856cea1-3d9d-4624-82ba-0248a24ef3a2 req-f52a2bf6-1c92-4890-9574-3f7a12e2350c service nova] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5856cea1-3d9d-4624-82ba-0248a24ef3a2 req-f52a2bf6-1c92-4890-9574-3f7a12e2350c service nova] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-5856cea1-3d9d-4624-82ba-0248a24ef3a2 req-f52a2bf6-1c92-4890-9574-3f7a12e2350c service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] No waiting events found dispatching network-vif-unplugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:33:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-5856cea1-3d9d-4624-82ba-0248a24ef3a2 req-f52a2bf6-1c92-4890-9574-3f7a12e2350c service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received event network-vif-unplugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:33:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-5856cea1-3d9d-4624-82ba-0248a24ef3a2 req-f52a2bf6-1c92-4890-9574-3f7a12e2350c service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received event network-vif-plugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:33:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5856cea1-3d9d-4624-82ba-0248a24ef3a2 req-f52a2bf6-1c92-4890-9574-3f7a12e2350c service nova] Acquiring lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5856cea1-3d9d-4624-82ba-0248a24ef3a2 req-f52a2bf6-1c92-4890-9574-3f7a12e2350c service nova] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5856cea1-3d9d-4624-82ba-0248a24ef3a2 req-f52a2bf6-1c92-4890-9574-3f7a12e2350c service nova] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-5856cea1-3d9d-4624-82ba-0248a24ef3a2 req-f52a2bf6-1c92-4890-9574-3f7a12e2350c service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] No waiting events found dispatching network-vif-plugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:33:19 user nova-compute[72849]: WARNING nova.compute.manager [req-5856cea1-3d9d-4624-82ba-0248a24ef3a2 req-f52a2bf6-1c92-4890-9574-3f7a12e2350c service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received unexpected event network-vif-plugged-58268f65-6b08-4cdd-9ae3-b256ed150e60 for instance with vm_state active and task_state deleting.
Aug 15 16:33:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:33:19 user nova-compute[72849]: INFO nova.compute.claims [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Claim successful on node user
Aug 15 16:33:20 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:33:20 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Took 1.46 seconds to deallocate network for instance.
Aug 15 16:33:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG nova.compute.manager [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.099s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG nova.compute.manager [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG nova.network.neutron [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:33:20 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:33:20 user nova-compute[72849]: DEBUG nova.compute.manager [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG nova.policy [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e99eefba54014b9ea83f1611b02efaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ddd223976e4b13a3b6a5638846f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG nova.compute.manager [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:33:20 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Creating image(s)
Aug 15 16:33:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "/opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "/opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "/opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.225s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.615s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:21 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Deleted allocations for instance 0900e8d0-6e7f-40a3-9016-39851e697d09
Aug 15 16:33:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f5bb1cb6-1396-43b7-9fc9-adcbf887ff02 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "0900e8d0-6e7f-40a3-9016-39851e697d09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.318s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.252s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk 1073741824" returned: 0 in 0.060s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG nova.network.neutron [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Successfully created port: ff0a1cb3-0154-4850-aaac-558f01cbe112 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.210s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Cannot resize image /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG nova.objects.instance [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'migration_context' on Instance uuid c313dd0f-12a8-46e1-8443-31a3abfac0ab {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Ensure instance console log exists: /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-0bab70e6-2dc4-4af1-b8f1-67ac2cfd2261 req-9237d8d1-ad33-4913-b381-f9e80526c40d service nova] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Received event network-vif-deleted-58268f65-6b08-4cdd-9ae3-b256ed150e60 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.network.neutron [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Successfully updated port: ff0a1cb3-0154-4850-aaac-558f01cbe112 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "refresh_cache-c313dd0f-12a8-46e1-8443-31a3abfac0ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquired lock "refresh_cache-c313dd0f-12a8-46e1-8443-31a3abfac0ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.network.neutron [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.network.neutron [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.network.neutron [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Updating instance_info_cache with network_info: [{"id": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "address": "fa:16:3e:e6:27:9b", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0a1cb3-01", "ovs_interfaceid": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Releasing lock "refresh_cache-c313dd0f-12a8-46e1-8443-31a3abfac0ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.compute.manager [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Instance network_info: |[{"id": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "address": "fa:16:3e:e6:27:9b", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0a1cb3-01", "ovs_interfaceid": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Start _get_guest_xml network_info=[{"id": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "address": "fa:16:3e:e6:27:9b", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0a1cb3-01", "ovs_interfaceid": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:33:22 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:33:22 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:33:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1279941866',display_name='tempest-AttachVolumeNegativeTest-server-1279941866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1279941866',id=35,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVTLnwCWR14rqb7+1lYuoasp48GYs5PD3svZ9Xp3VeWkj+p04cVCfsZ8wyrVenylv1NmVBRnHiXuOgUDPJwDwnC8iqHdF/jM6NCQ56NZsjBGB8ua/a797HDB4bj9uJ5bQ==',key_name='tempest-keypair-1791302560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0ddd223976e4b13a3b6a5638846f83a',ramdisk_id='',reservation_id='r-rgkike6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-693282259',owner_user_name='tempest-AttachVolumeNegativeTest-693282259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:33:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e99eefba54014b9ea83f1611b02efaad',uuid=c313dd0f-12a8-46e1-8443-31a3abfac0ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "address": "fa:16:3e:e6:27:9b", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0a1cb3-01", "ovs_interfaceid": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converting VIF {"id": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "address": "fa:16:3e:e6:27:9b", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0a1cb3-01", "ovs_interfaceid": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:27:9b,bridge_name='br-int',has_traffic_filtering=True,id=ff0a1cb3-0154-4850-aaac-558f01cbe112,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0a1cb3-01') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.objects.instance [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'pci_devices' on Instance uuid c313dd0f-12a8-46e1-8443-31a3abfac0ab {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:33:22 user nova-compute[72849]:   <uuid>c313dd0f-12a8-46e1-8443-31a3abfac0ab</uuid>
Aug 15 16:33:22 user nova-compute[72849]:   <name>instance-00000023</name>
Aug 15 16:33:22 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:33:22 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:33:22 user nova-compute[72849]:   <metadata>
Aug 15 16:33:22 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:33:22 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:33:22 user nova-compute[72849]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1279941866</nova:name>
Aug 15 16:33:22 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:33:22</nova:creationTime>
Aug 15 16:33:22 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:33:22 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:33:22 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:33:22 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:33:22 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:33:22 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:33:22 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:33:22 user nova-compute[72849]:       <nova:owner>
Aug 15 16:33:22 user nova-compute[72849]:         <nova:user uuid="e99eefba54014b9ea83f1611b02efaad">tempest-AttachVolumeNegativeTest-693282259-project-member</nova:user>
Aug 15 16:33:22 user nova-compute[72849]:         <nova:project uuid="d0ddd223976e4b13a3b6a5638846f83a">tempest-AttachVolumeNegativeTest-693282259</nova:project>
Aug 15 16:33:22 user nova-compute[72849]:       </nova:owner>
Aug 15 16:33:22 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:33:22 user nova-compute[72849]:       <nova:ports>
Aug 15 16:33:22 user nova-compute[72849]:         <nova:port uuid="ff0a1cb3-0154-4850-aaac-558f01cbe112">
Aug 15 16:33:22 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 16:33:22 user nova-compute[72849]:         </nova:port>
Aug 15 16:33:22 user nova-compute[72849]:       </nova:ports>
Aug 15 16:33:22 user nova-compute[72849]:     </nova:instance>
Aug 15 16:33:22 user nova-compute[72849]:   </metadata>
Aug 15 16:33:22 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:33:22 user nova-compute[72849]:     <system>
Aug 15 16:33:22 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:33:22 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:33:22 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:33:22 user nova-compute[72849]:       <entry name="serial">c313dd0f-12a8-46e1-8443-31a3abfac0ab</entry>
Aug 15 16:33:22 user nova-compute[72849]:       <entry name="uuid">c313dd0f-12a8-46e1-8443-31a3abfac0ab</entry>
Aug 15 16:33:22 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:33:22 user nova-compute[72849]:     </system>
Aug 15 16:33:22 user nova-compute[72849]:   </sysinfo>
Aug 15 16:33:22 user nova-compute[72849]:   <os>
Aug 15 16:33:22 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:33:22 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:33:22 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:33:22 user nova-compute[72849]:   </os>
Aug 15 16:33:22 user nova-compute[72849]:   <features>
Aug 15 16:33:22 user nova-compute[72849]:     <acpi/>
Aug 15 16:33:22 user nova-compute[72849]:     <apic/>
Aug 15 16:33:22 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:33:22 user nova-compute[72849]:   </features>
Aug 15 16:33:22 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:33:22 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:33:22 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:33:22 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:33:22 user nova-compute[72849]:   </clock>
Aug 15 16:33:22 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:33:22 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:33:22 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:33:22 user nova-compute[72849]:   </cpu>
Aug 15 16:33:22 user nova-compute[72849]:   <devices>
Aug 15 16:33:22 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:33:22 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:33:22 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk"/>
Aug 15 16:33:22 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:33:22 user nova-compute[72849]:     </disk>
Aug 15 16:33:22 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:33:22 user nova-compute[72849]:       <mac address="fa:16:3e:e6:27:9b"/>
Aug 15 16:33:22 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:33:22 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:33:22 user nova-compute[72849]:       <target dev="tapff0a1cb3-01"/>
Aug 15 16:33:22 user nova-compute[72849]:     </interface>
Aug 15 16:33:22 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:33:22 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/console.log" append="off"/>
Aug 15 16:33:22 user nova-compute[72849]:     </serial>
Aug 15 16:33:22 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:33:22 user nova-compute[72849]:     <video>
Aug 15 16:33:22 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:33:22 user nova-compute[72849]:     </video>
Aug 15 16:33:22 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:33:22 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:33:22 user nova-compute[72849]:     </rng>
Aug 15 16:33:22 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:33:22 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:33:22 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:33:22 user nova-compute[72849]:     </memballoon>
Aug 15 16:33:22 user nova-compute[72849]:   </devices>
Aug 15 16:33:22 user nova-compute[72849]: </domain>
Aug 15 16:33:22 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:33:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1279941866',display_name='tempest-AttachVolumeNegativeTest-server-1279941866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1279941866',id=35,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVTLnwCWR14rqb7+1lYuoasp48GYs5PD3svZ9Xp3VeWkj+p04cVCfsZ8wyrVenylv1NmVBRnHiXuOgUDPJwDwnC8iqHdF/jM6NCQ56NZsjBGB8ua/a797HDB4bj9uJ5bQ==',key_name='tempest-keypair-1791302560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0ddd223976e4b13a3b6a5638846f83a',ramdisk_id='',reservation_id='r-rgkike6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-693282259',owner_user_name='tempest-AttachVolumeNegativeTest-693282259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:33:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e99eefba54014b9ea83f1611b02efaad',uuid=c313dd0f-12a8-46e1-8443-31a3abfac0ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "address": "fa:16:3e:e6:27:9b", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0a1cb3-01", "ovs_interfaceid": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converting VIF {"id": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "address": "fa:16:3e:e6:27:9b", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0a1cb3-01", "ovs_interfaceid": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:27:9b,bridge_name='br-int',has_traffic_filtering=True,id=ff0a1cb3-0154-4850-aaac-558f01cbe112,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0a1cb3-01') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG os_vif [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:27:9b,bridge_name='br-int',has_traffic_filtering=True,id=ff0a1cb3-0154-4850-aaac-558f01cbe112,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0a1cb3-01') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff0a1cb3-01, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff0a1cb3-01, col_values=(('external_ids', {'iface-id': 'ff0a1cb3-0154-4850-aaac-558f01cbe112', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:27:9b', 'vm-uuid': 'c313dd0f-12a8-46e1-8443-31a3abfac0ab'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:22 user nova-compute[72849]: INFO os_vif [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:27:9b,bridge_name='br-int',has_traffic_filtering=True,id=ff0a1cb3-0154-4850-aaac-558f01cbe112,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0a1cb3-01')
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:33:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] No VIF found with MAC fa:16:3e:e6:27:9b, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:33:23 user nova-compute[72849]: DEBUG nova.compute.manager [req-d80643bc-5a9c-42c2-a861-517b87723821 req-4140da0f-dddf-4173-a5e0-08f2c59da4f6 service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Received event network-changed-ff0a1cb3-0154-4850-aaac-558f01cbe112 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:33:23 user nova-compute[72849]: DEBUG nova.compute.manager [req-d80643bc-5a9c-42c2-a861-517b87723821 req-4140da0f-dddf-4173-a5e0-08f2c59da4f6 service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Refreshing instance network info cache due to event network-changed-ff0a1cb3-0154-4850-aaac-558f01cbe112. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:33:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d80643bc-5a9c-42c2-a861-517b87723821 req-4140da0f-dddf-4173-a5e0-08f2c59da4f6 service nova] Acquiring lock "refresh_cache-c313dd0f-12a8-46e1-8443-31a3abfac0ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:33:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d80643bc-5a9c-42c2-a861-517b87723821 req-4140da0f-dddf-4173-a5e0-08f2c59da4f6 service nova] Acquired lock "refresh_cache-c313dd0f-12a8-46e1-8443-31a3abfac0ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:33:23 user nova-compute[72849]: DEBUG nova.network.neutron [req-d80643bc-5a9c-42c2-a861-517b87723821 req-4140da0f-dddf-4173-a5e0-08f2c59da4f6 service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Refreshing network info cache for port ff0a1cb3-0154-4850-aaac-558f01cbe112 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:33:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:24 user nova-compute[72849]: DEBUG nova.network.neutron [req-d80643bc-5a9c-42c2-a861-517b87723821 req-4140da0f-dddf-4173-a5e0-08f2c59da4f6 service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Updated VIF entry in instance network info cache for port ff0a1cb3-0154-4850-aaac-558f01cbe112. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:33:24 user nova-compute[72849]: DEBUG nova.network.neutron [req-d80643bc-5a9c-42c2-a861-517b87723821 req-4140da0f-dddf-4173-a5e0-08f2c59da4f6 service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Updating instance_info_cache with network_info: [{"id": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "address": "fa:16:3e:e6:27:9b", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0a1cb3-01", "ovs_interfaceid": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:33:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d80643bc-5a9c-42c2-a861-517b87723821 req-4140da0f-dddf-4173-a5e0-08f2c59da4f6 service nova] Releasing lock "refresh_cache-c313dd0f-12a8-46e1-8443-31a3abfac0ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:33:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-c685acf4-755e-46ca-a0b2-dd30413f1529 req-12434716-2984-4119-8f2d-e206f28c30d6 service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Received event network-vif-plugged-ff0a1cb3-0154-4850-aaac-558f01cbe112 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:33:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c685acf4-755e-46ca-a0b2-dd30413f1529 req-12434716-2984-4119-8f2d-e206f28c30d6 service nova] Acquiring lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c685acf4-755e-46ca-a0b2-dd30413f1529 req-12434716-2984-4119-8f2d-e206f28c30d6 service nova] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c685acf4-755e-46ca-a0b2-dd30413f1529 req-12434716-2984-4119-8f2d-e206f28c30d6 service nova] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-c685acf4-755e-46ca-a0b2-dd30413f1529 req-12434716-2984-4119-8f2d-e206f28c30d6 service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] No waiting events found dispatching network-vif-plugged-ff0a1cb3-0154-4850-aaac-558f01cbe112 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:33:25 user nova-compute[72849]: WARNING nova.compute.manager [req-c685acf4-755e-46ca-a0b2-dd30413f1529 req-12434716-2984-4119-8f2d-e206f28c30d6 service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Received unexpected event network-vif-plugged-ff0a1cb3-0154-4850-aaac-558f01cbe112 for instance with vm_state building and task_state spawning.
Aug 15 16:33:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-c685acf4-755e-46ca-a0b2-dd30413f1529 req-12434716-2984-4119-8f2d-e206f28c30d6 service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Received event network-vif-plugged-ff0a1cb3-0154-4850-aaac-558f01cbe112 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:33:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c685acf4-755e-46ca-a0b2-dd30413f1529 req-12434716-2984-4119-8f2d-e206f28c30d6 service nova] Acquiring lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c685acf4-755e-46ca-a0b2-dd30413f1529 req-12434716-2984-4119-8f2d-e206f28c30d6 service nova] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c685acf4-755e-46ca-a0b2-dd30413f1529 req-12434716-2984-4119-8f2d-e206f28c30d6 service nova] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-c685acf4-755e-46ca-a0b2-dd30413f1529 req-12434716-2984-4119-8f2d-e206f28c30d6 service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] No waiting events found dispatching network-vif-plugged-ff0a1cb3-0154-4850-aaac-558f01cbe112 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:33:25 user nova-compute[72849]: WARNING nova.compute.manager [req-c685acf4-755e-46ca-a0b2-dd30413f1529 req-12434716-2984-4119-8f2d-e206f28c30d6 service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Received unexpected event network-vif-plugged-ff0a1cb3-0154-4850-aaac-558f01cbe112 for instance with vm_state building and task_state spawning.
Aug 15 16:33:26 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117206.3374703, c313dd0f-12a8-46e1-8443-31a3abfac0ab => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:33:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] VM Resumed (Lifecycle Event)
Aug 15 16:33:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:33:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:33:26 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Instance spawned successfully.
Aug 15 16:33:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:33:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:33:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:33:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:33:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:33:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:33:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:33:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:33:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:33:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:33:26 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117206.3383784, c313dd0f-12a8-46e1-8443-31a3abfac0ab => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:33:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] VM Started (Lifecycle Event)
Aug 15 16:33:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:33:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:33:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:33:26 user nova-compute[72849]: INFO nova.compute.manager [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Took 5.77 seconds to spawn the instance on the hypervisor.
Aug 15 16:33:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:33:26 user nova-compute[72849]: INFO nova.compute.manager [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Took 6.79 seconds to build instance.
Aug 15 16:33:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cefa64ee-d7ee-4dfb-a9b4-ffa38960ed0a tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.003s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:30 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:33:31 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117196.2817152, 82f61128-3af4-4f82-ac4c-8ee746b5a829 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:33:31 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] VM Stopped (Lifecycle Event)
Aug 15 16:33:31 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:33:31 user nova-compute[72849]: DEBUG nova.compute.manager [None req-89b094cb-26cc-4e0b-b259-eef8d80b2c64 None None] [instance: 82f61128-3af4-4f82-ac4c-8ee746b5a829] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:33:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:33 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117198.6578848, 0900e8d0-6e7f-40a3-9016-39851e697d09 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:33:33 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] VM Stopped (Lifecycle Event)
Aug 15 16:33:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-dfa5931b-64ad-4507-bb25-5f7b3512d8ec None None] [instance: 0900e8d0-6e7f-40a3-9016-39851e697d09] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:33:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:34 user nova-compute[72849]: INFO nova.compute.manager [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Terminating instance
Aug 15 16:33:34 user nova-compute[72849]: DEBUG nova.compute.manager [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG nova.compute.manager [req-2f9963ff-ba80-41a9-873a-b178a8f73b1c req-41d3adaa-5789-4d0b-9d65-db079a2b07b7 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received event network-vif-unplugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2f9963ff-ba80-41a9-873a-b178a8f73b1c req-41d3adaa-5789-4d0b-9d65-db079a2b07b7 service nova] Acquiring lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2f9963ff-ba80-41a9-873a-b178a8f73b1c req-41d3adaa-5789-4d0b-9d65-db079a2b07b7 service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2f9963ff-ba80-41a9-873a-b178a8f73b1c req-41d3adaa-5789-4d0b-9d65-db079a2b07b7 service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG nova.compute.manager [req-2f9963ff-ba80-41a9-873a-b178a8f73b1c req-41d3adaa-5789-4d0b-9d65-db079a2b07b7 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] No waiting events found dispatching network-vif-unplugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG nova.compute.manager [req-2f9963ff-ba80-41a9-873a-b178a8f73b1c req-41d3adaa-5789-4d0b-9d65-db079a2b07b7 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received event network-vif-unplugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Updating instance_info_cache with network_info: [{"id": "993c798d-2a87-4ee5-80ea-484b8848ca54", "address": "fa:16:3e:e2:8e:fc", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993c798d-2a", "ovs_interfaceid": "993c798d-2a87-4ee5-80ea-484b8848ca54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:33:34 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Instance destroyed successfully.
Aug 15 16:33:34 user nova-compute[72849]: DEBUG nova.objects.instance [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'resources' on Instance uuid ea9d5a00-42db-41e4-bb81-b3875e84f16c {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-111188340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-111188340',id=28,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:29:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f51f800c0ca74e149a2f8ed9718b221f',ramdisk_id='',reservation_id='r-0c8a77eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:31:48Z,user_data=None,user_id='cd6279423b7f43c4aac7956aec43efdd',uuid=ea9d5a00-42db-41e4-bb81-b3875e84f16c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "address": "fa:16:3e:f4:f0:ec", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f4c47f-05", "ovs_interfaceid": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converting VIF {"id": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "address": "fa:16:3e:f4:f0:ec", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f4c47f-05", "ovs_interfaceid": "65f4c47f-0546-4a8a-bbe6-64a38fb5210b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:f0:ec,bridge_name='br-int',has_traffic_filtering=True,id=65f4c47f-0546-4a8a-bbe6-64a38fb5210b,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f4c47f-05') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG os_vif [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:f0:ec,bridge_name='br-int',has_traffic_filtering=True,id=65f4c47f-0546-4a8a-bbe6-64a38fb5210b,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f4c47f-05') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65f4c47f-05, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:34 user nova-compute[72849]: INFO os_vif [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:f0:ec,bridge_name='br-int',has_traffic_filtering=True,id=65f4c47f-0546-4a8a-bbe6-64a38fb5210b,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f4c47f-05')
Aug 15 16:33:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZvYJlWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:33:34 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:33:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:33:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[585af378-4d63-4446-abff-eeeeb0d2b5cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f90927-f837-4126-8b9f-116ded3559bc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:33:35 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:33:35 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:33:35 user nova-compute[72849]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)
Aug 15 16:33:35 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:33:35 user nova-compute[72849]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a (non-flash)
Aug 15 16:33:35 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:33:35 user nova-compute[72849]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)
Aug 15 16:33:35 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3874dde10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a'): ({'sdd'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Removing single pathed devices sdd {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac1fd41-fec1-4ed1-af0a-d3b9d3968543]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1ff184-dfd9-4593-ba87-88626d2f2dc8]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Flushing IO for device /dev/sdd {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b0ae5b-b637-43b5-9223-2fd81a9afa4f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e9c7c2-768d-4ca4-9110-fb044c087564]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] SCSI volumes sdd have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c816d1e-e4dc-4c42-8ca6-b6830fc1431f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f5bfed-45eb-44ea-bd87-bc544098d6ac]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a, portal: 172.16.0.220,3260]
Aug 15 16:33:35 user nova-compute[72849]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a, portal: 172.16.0.220,3260] successful.
Aug 15 16:33:35 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23f99289-8881-40a2-9fe0-dee320c8131a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[642fa315-3ee7-4024-a57a-353df921a23c]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] <== disconnect_volume: return (346ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:33:35 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Deleting instance files /opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c_del
Aug 15 16:33:35 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Deletion of /opt/stack/data/nova/instances/ea9d5a00-42db-41e4-bb81-b3875e84f16c_del complete
Aug 15 16:33:35 user nova-compute[72849]: INFO nova.compute.manager [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:33:35 user nova-compute[72849]: DEBUG nova.compute.manager [req-8bb7656c-fbed-4caf-85ca-3bb63627dda1 req-a42a75f2-fc18-4865-8340-3e9f04d4e91f service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received event network-vif-deleted-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:33:35 user nova-compute[72849]: INFO nova.compute.manager [req-8bb7656c-fbed-4caf-85ca-3bb63627dda1 req-a42a75f2-fc18-4865-8340-3e9f04d4e91f service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Neutron deleted interface 65f4c47f-0546-4a8a-bbe6-64a38fb5210b; detaching it from the instance and deleting it from the info cache
Aug 15 16:33:35 user nova-compute[72849]: DEBUG nova.network.neutron [req-8bb7656c-fbed-4caf-85ca-3bb63627dda1 req-a42a75f2-fc18-4865-8340-3e9f04d4e91f service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:33:35 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Took 0.59 seconds to deallocate network for instance.
Aug 15 16:33:36 user nova-compute[72849]: DEBUG nova.compute.manager [req-8bb7656c-fbed-4caf-85ca-3bb63627dda1 req-a42a75f2-fc18-4865-8340-3e9f04d4e91f service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Detach interface failed, port_id=65f4c47f-0546-4a8a-bbe6-64a38fb5210b, reason: Instance ea9d5a00-42db-41e4-bb81-b3875e84f16c could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:33:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:33:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:33:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:36 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:33:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:33:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:36 user nova-compute[72849]: DEBUG nova.compute.manager [req-6e7c9482-5019-4383-9314-5171810ab52a req-5ef520c3-738b-45ab-b56c-4a18e87b9088 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received event network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:33:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6e7c9482-5019-4383-9314-5171810ab52a req-5ef520c3-738b-45ab-b56c-4a18e87b9088 service nova] Acquiring lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6e7c9482-5019-4383-9314-5171810ab52a req-5ef520c3-738b-45ab-b56c-4a18e87b9088 service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6e7c9482-5019-4383-9314-5171810ab52a req-5ef520c3-738b-45ab-b56c-4a18e87b9088 service nova] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:36 user nova-compute[72849]: DEBUG nova.compute.manager [req-6e7c9482-5019-4383-9314-5171810ab52a req-5ef520c3-738b-45ab-b56c-4a18e87b9088 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] No waiting events found dispatching network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:33:36 user nova-compute[72849]: WARNING nova.compute.manager [req-6e7c9482-5019-4383-9314-5171810ab52a req-5ef520c3-738b-45ab-b56c-4a18e87b9088 service nova] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Received unexpected event network-vif-plugged-65f4c47f-0546-4a8a-bbe6-64a38fb5210b for instance with vm_state active and task_state deleting.
Aug 15 16:33:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:36 user nova-compute[72849]: INFO nova.compute.manager [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Took 0.87 seconds to detach 1 volumes for instance.
Aug 15 16:33:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:37 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:33:37 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:33:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.486s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:37 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Deleted allocations for instance ea9d5a00-42db-41e4-bb81-b3875e84f16c
Aug 15 16:33:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6e8bffce-a62c-440b-9679-8a0b1d962e9c tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "ea9d5a00-42db-41e4-bb81-b3875e84f16c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.468s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:33:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:33:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:33:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:33:40 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:33:40 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:33:40 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=7428MB free_disk=25.057018280029297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:33:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:33:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:33:40 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:33:40 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:33:40 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:33:40 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc521d87-09aa-44ba-a87c-1cd5517b3707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:33:40 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 46f0aa43-e313-4aff-bacc-aa5290193b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:33:40 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance d51623f1-6613-41d6-abcb-9e4e626a97af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:33:40 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f1da55ae-5150-476c-a229-f26ddfee7e9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:33:40 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b15c5692-8c0c-4bf0-a79f-b7813e71de9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:33:40 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 98358bbf-c7c1-4868-81ee-77bd229133fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:33:40 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance c313dd0f-12a8-46e1-8443-31a3abfac0ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:33:40 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:33:40 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:33:41 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:33:41 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:33:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:33:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:33:43 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:33:43 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:33:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:45 user nova-compute[72849]: INFO nova.compute.manager [None req-9894dbf4-9569-420a-acab-8eba82e4016e tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Get console output
Aug 15 16:33:45 user nova-compute[72849]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 15 16:33:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:49 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117214.900745, ea9d5a00-42db-41e4-bb81-b3875e84f16c => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:33:49 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] VM Stopped (Lifecycle Event)
Aug 15 16:33:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-67c352d7-c56c-46ef-ae95-04fadf26b0d0 None None] [instance: ea9d5a00-42db-41e4-bb81-b3875e84f16c] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:33:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:33:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:34:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:34:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:34:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:34:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "4b9f21bc-836f-4095-9eb3-d3971d418363" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:34:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:12 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:34:12 user nova-compute[72849]: INFO nova.compute.claims [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Claim successful on node user
Aug 15 16:34:12 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:34:12 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:34:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:34:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:34:12 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:34:12 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:34:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG nova.policy [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e867f247fc90437899a13a7451a3249a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb636c3c71c479d90cf2e170db941e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:34:13 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Creating image(s)
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "/opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "/opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.192s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.200s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk 1073741824" returned: 0 in 0.051s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.187s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Successfully created port: cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Cannot resize image /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'migration_context' on Instance uuid 4b9f21bc-836f-4095-9eb3-d3971d418363 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Ensure instance console log exists: /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:14 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Successfully updated port: cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:34:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:34:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquired lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:34:14 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:34:14 user nova-compute[72849]: DEBUG nova.compute.manager [req-1af46126-6e7c-43a0-9da0-0af43db003fc req-46f2c3f3-8ce9-4b66-9f97-acdaf1ad0446 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received event network-changed-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:34:14 user nova-compute[72849]: DEBUG nova.compute.manager [req-1af46126-6e7c-43a0-9da0-0af43db003fc req-46f2c3f3-8ce9-4b66-9f97-acdaf1ad0446 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Refreshing instance network info cache due to event network-changed-cb180f95-0817-4f21-807c-4a96a65e4062. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:34:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1af46126-6e7c-43a0-9da0-0af43db003fc req-46f2c3f3-8ce9-4b66-9f97-acdaf1ad0446 service nova] Acquiring lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:34:14 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:34:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.network.neutron [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Updating instance_info_cache with network_info: [{"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Releasing lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Instance network_info: |[{"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1af46126-6e7c-43a0-9da0-0af43db003fc req-46f2c3f3-8ce9-4b66-9f97-acdaf1ad0446 service nova] Acquired lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.network.neutron [req-1af46126-6e7c-43a0-9da0-0af43db003fc req-46f2c3f3-8ce9-4b66-9f97-acdaf1ad0446 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Refreshing network info cache for port cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Start _get_guest_xml network_info=[{"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:34:15 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:34:15 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:34:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1489512197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1489512197',id=36,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe+X3TlJY7viy6yCC4qfoaJNUF0aD42WXrGPlRjIPb89wzbqYH9zALZJ5CRJe4p1pdHW/9jzBSM0IPaTRUdlDyBTE1hky/6604FqoKqX9DPrfM+jFneqscMa1UPBBiqoQ==',key_name='tempest-keypair-1622612503',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bb636c3c71c479d90cf2e170db941e1',ramdisk_id='',reservation_id='r-ti7scmj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1263463439',owner_user_name='tempest-AttachVolumeShelveTestJSON-1263463439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:34:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867f247fc90437899a13a7451a3249a',uuid=4b9f21bc-836f-4095-9eb3-d3971d418363,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converting VIF {"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:b5:7a,bridge_name='br-int',has_traffic_filtering=True,id=cb180f95-0817-4f21-807c-4a96a65e4062,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb180f95-08') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b9f21bc-836f-4095-9eb3-d3971d418363 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:34:15 user nova-compute[72849]:   <uuid>4b9f21bc-836f-4095-9eb3-d3971d418363</uuid>
Aug 15 16:34:15 user nova-compute[72849]:   <name>instance-00000024</name>
Aug 15 16:34:15 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:34:15 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:34:15 user nova-compute[72849]:   <metadata>
Aug 15 16:34:15 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:34:15 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:34:15 user nova-compute[72849]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1489512197</nova:name>
Aug 15 16:34:15 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:34:15</nova:creationTime>
Aug 15 16:34:15 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:34:15 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:34:15 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:34:15 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:34:15 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:34:15 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:34:15 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:34:15 user nova-compute[72849]:       <nova:owner>
Aug 15 16:34:15 user nova-compute[72849]:         <nova:user uuid="e867f247fc90437899a13a7451a3249a">tempest-AttachVolumeShelveTestJSON-1263463439-project-member</nova:user>
Aug 15 16:34:15 user nova-compute[72849]:         <nova:project uuid="1bb636c3c71c479d90cf2e170db941e1">tempest-AttachVolumeShelveTestJSON-1263463439</nova:project>
Aug 15 16:34:15 user nova-compute[72849]:       </nova:owner>
Aug 15 16:34:15 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:34:15 user nova-compute[72849]:       <nova:ports>
Aug 15 16:34:15 user nova-compute[72849]:         <nova:port uuid="cb180f95-0817-4f21-807c-4a96a65e4062">
Aug 15 16:34:15 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:34:15 user nova-compute[72849]:         </nova:port>
Aug 15 16:34:15 user nova-compute[72849]:       </nova:ports>
Aug 15 16:34:15 user nova-compute[72849]:     </nova:instance>
Aug 15 16:34:15 user nova-compute[72849]:   </metadata>
Aug 15 16:34:15 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:34:15 user nova-compute[72849]:     <system>
Aug 15 16:34:15 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:34:15 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:34:15 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:34:15 user nova-compute[72849]:       <entry name="serial">4b9f21bc-836f-4095-9eb3-d3971d418363</entry>
Aug 15 16:34:15 user nova-compute[72849]:       <entry name="uuid">4b9f21bc-836f-4095-9eb3-d3971d418363</entry>
Aug 15 16:34:15 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:34:15 user nova-compute[72849]:     </system>
Aug 15 16:34:15 user nova-compute[72849]:   </sysinfo>
Aug 15 16:34:15 user nova-compute[72849]:   <os>
Aug 15 16:34:15 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:34:15 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:34:15 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:34:15 user nova-compute[72849]:   </os>
Aug 15 16:34:15 user nova-compute[72849]:   <features>
Aug 15 16:34:15 user nova-compute[72849]:     <acpi/>
Aug 15 16:34:15 user nova-compute[72849]:     <apic/>
Aug 15 16:34:15 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:34:15 user nova-compute[72849]:   </features>
Aug 15 16:34:15 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:34:15 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:34:15 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:34:15 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:34:15 user nova-compute[72849]:   </clock>
Aug 15 16:34:15 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:34:15 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:34:15 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:34:15 user nova-compute[72849]:   </cpu>
Aug 15 16:34:15 user nova-compute[72849]:   <devices>
Aug 15 16:34:15 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:34:15 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:34:15 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk"/>
Aug 15 16:34:15 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:34:15 user nova-compute[72849]:     </disk>
Aug 15 16:34:15 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:34:15 user nova-compute[72849]:       <mac address="fa:16:3e:ea:b5:7a"/>
Aug 15 16:34:15 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:34:15 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:34:15 user nova-compute[72849]:       <target dev="tapcb180f95-08"/>
Aug 15 16:34:15 user nova-compute[72849]:     </interface>
Aug 15 16:34:15 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:34:15 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/console.log" append="off"/>
Aug 15 16:34:15 user nova-compute[72849]:     </serial>
Aug 15 16:34:15 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:34:15 user nova-compute[72849]:     <video>
Aug 15 16:34:15 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:34:15 user nova-compute[72849]:     </video>
Aug 15 16:34:15 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:34:15 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:34:15 user nova-compute[72849]:     </rng>
Aug 15 16:34:15 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:34:15 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:34:15 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:34:15 user nova-compute[72849]:     </memballoon>
Aug 15 16:34:15 user nova-compute[72849]:   </devices>
Aug 15 16:34:15 user nova-compute[72849]: </domain>
Aug 15 16:34:15 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:34:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1489512197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1489512197',id=36,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe+X3TlJY7viy6yCC4qfoaJNUF0aD42WXrGPlRjIPb89wzbqYH9zALZJ5CRJe4p1pdHW/9jzBSM0IPaTRUdlDyBTE1hky/6604FqoKqX9DPrfM+jFneqscMa1UPBBiqoQ==',key_name='tempest-keypair-1622612503',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bb636c3c71c479d90cf2e170db941e1',ramdisk_id='',reservation_id='r-ti7scmj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1263463439',owner_user_name='tempest-AttachVolumeShelveTestJSON-1263463439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:34:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867f247fc90437899a13a7451a3249a',uuid=4b9f21bc-836f-4095-9eb3-d3971d418363,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converting VIF {"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:b5:7a,bridge_name='br-int',has_traffic_filtering=True,id=cb180f95-0817-4f21-807c-4a96a65e4062,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb180f95-08') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG os_vif [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:b5:7a,bridge_name='br-int',has_traffic_filtering=True,id=cb180f95-0817-4f21-807c-4a96a65e4062,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb180f95-08') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb180f95-08, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb180f95-08, col_values=(('external_ids', {'iface-id': 'cb180f95-0817-4f21-807c-4a96a65e4062', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:b5:7a', 'vm-uuid': '4b9f21bc-836f-4095-9eb3-d3971d418363'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:15 user nova-compute[72849]: INFO os_vif [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:b5:7a,bridge_name='br-int',has_traffic_filtering=True,id=cb180f95-0817-4f21-807c-4a96a65e4062,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb180f95-08')
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] No VIF found with MAC fa:16:3e:ea:b5:7a, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.network.neutron [req-1af46126-6e7c-43a0-9da0-0af43db003fc req-46f2c3f3-8ce9-4b66-9f97-acdaf1ad0446 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Updated VIF entry in instance network info cache for port cb180f95-0817-4f21-807c-4a96a65e4062. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG nova.network.neutron [req-1af46126-6e7c-43a0-9da0-0af43db003fc req-46f2c3f3-8ce9-4b66-9f97-acdaf1ad0446 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Updating instance_info_cache with network_info: [{"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:34:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1af46126-6e7c-43a0-9da0-0af43db003fc req-46f2c3f3-8ce9-4b66-9f97-acdaf1ad0446 service nova] Releasing lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:34:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:16 user nova-compute[72849]: DEBUG nova.compute.manager [req-7c3bea99-8b5b-4832-9d70-19865572fddb req-65627899-4ed7-4da6-ad30-f6301d12caed service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received event network-vif-plugged-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:34:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7c3bea99-8b5b-4832-9d70-19865572fddb req-65627899-4ed7-4da6-ad30-f6301d12caed service nova] Acquiring lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7c3bea99-8b5b-4832-9d70-19865572fddb req-65627899-4ed7-4da6-ad30-f6301d12caed service nova] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7c3bea99-8b5b-4832-9d70-19865572fddb req-65627899-4ed7-4da6-ad30-f6301d12caed service nova] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:16 user nova-compute[72849]: DEBUG nova.compute.manager [req-7c3bea99-8b5b-4832-9d70-19865572fddb req-65627899-4ed7-4da6-ad30-f6301d12caed service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] No waiting events found dispatching network-vif-plugged-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:34:16 user nova-compute[72849]: WARNING nova.compute.manager [req-7c3bea99-8b5b-4832-9d70-19865572fddb req-65627899-4ed7-4da6-ad30-f6301d12caed service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received unexpected event network-vif-plugged-cb180f95-0817-4f21-807c-4a96a65e4062 for instance with vm_state building and task_state spawning.
Aug 15 16:34:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:18 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117258.910767, 4b9f21bc-836f-4095-9eb3-d3971d418363 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:34:18 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] VM Resumed (Lifecycle Event)
Aug 15 16:34:18 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:34:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:34:18 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Instance spawned successfully.
Aug 15 16:34:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:34:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:18 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:34:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:34:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:34:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:34:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:34:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:34:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:34:18 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:34:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:34:19 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117258.9127886, 4b9f21bc-836f-4095-9eb3-d3971d418363 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:34:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] VM Started (Lifecycle Event)
Aug 15 16:34:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-14bf5e77-221c-4b25-804f-87c71b1a0103 req-84d62456-8158-42d0-8d7e-0a1d078774e5 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received event network-vif-plugged-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:34:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-14bf5e77-221c-4b25-804f-87c71b1a0103 req-84d62456-8158-42d0-8d7e-0a1d078774e5 service nova] Acquiring lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-14bf5e77-221c-4b25-804f-87c71b1a0103 req-84d62456-8158-42d0-8d7e-0a1d078774e5 service nova] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-14bf5e77-221c-4b25-804f-87c71b1a0103 req-84d62456-8158-42d0-8d7e-0a1d078774e5 service nova] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-14bf5e77-221c-4b25-804f-87c71b1a0103 req-84d62456-8158-42d0-8d7e-0a1d078774e5 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] No waiting events found dispatching network-vif-plugged-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:34:19 user nova-compute[72849]: WARNING nova.compute.manager [req-14bf5e77-221c-4b25-804f-87c71b1a0103 req-84d62456-8158-42d0-8d7e-0a1d078774e5 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received unexpected event network-vif-plugged-cb180f95-0817-4f21-807c-4a96a65e4062 for instance with vm_state building and task_state spawning.
Aug 15 16:34:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:34:19 user nova-compute[72849]: INFO nova.compute.manager [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Took 5.94 seconds to spawn the instance on the hypervisor.
Aug 15 16:34:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:34:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:34:19 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:34:19 user nova-compute[72849]: INFO nova.compute.manager [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Took 6.72 seconds to build instance.
Aug 15 16:34:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9f941106-0e81-4cae-bbfe-e01cf4c6c998 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.821s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "d51623f1-6613-41d6-abcb-9e4e626a97af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "d51623f1-6613-41d6-abcb-9e4e626a97af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "d51623f1-6613-41d6-abcb-9e4e626a97af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "d51623f1-6613-41d6-abcb-9e4e626a97af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "d51623f1-6613-41d6-abcb-9e4e626a97af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:25 user nova-compute[72849]: INFO nova.compute.manager [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Terminating instance
Aug 15 16:34:25 user nova-compute[72849]: DEBUG nova.compute.manager [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:25 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Instance destroyed successfully.
Aug 15 16:34:25 user nova-compute[72849]: DEBUG nova.objects.instance [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'resources' on Instance uuid d51623f1-6613-41d6-abcb-9e4e626a97af {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1019432305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1019432305',id=24,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:25:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f51f800c0ca74e149a2f8ed9718b221f',ramdisk_id='',reservation_id='r-m9ldc7ly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:26:58Z,user_data=None,user_id='cd6279423b7f43c4aac7956aec43efdd',uuid=d51623f1-6613-41d6-abcb-9e4e626a97af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "address": "fa:16:3e:a9:be:c7", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe64b8c-04", "ovs_interfaceid": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converting VIF {"id": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "address": "fa:16:3e:a9:be:c7", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe64b8c-04", "ovs_interfaceid": "fbe64b8c-04d1-40d1-9b24-f3f021c282aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:be:c7,bridge_name='br-int',has_traffic_filtering=True,id=fbe64b8c-04d1-40d1-9b24-f3f021c282aa,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe64b8c-04') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG os_vif [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:be:c7,bridge_name='br-int',has_traffic_filtering=True,id=fbe64b8c-04d1-40d1-9b24-f3f021c282aa,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe64b8c-04') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbe64b8c-04, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:34:25 user nova-compute[72849]: INFO os_vif [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:be:c7,bridge_name='br-int',has_traffic_filtering=True,id=fbe64b8c-04d1-40d1-9b24-f3f021c282aa,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe64b8c-04')
Aug 15 16:34:25 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Deleting instance files /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af_del
Aug 15 16:34:25 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Deletion of /opt/stack/data/nova/instances/d51623f1-6613-41d6-abcb-9e4e626a97af_del complete
Aug 15 16:34:25 user nova-compute[72849]: INFO nova.compute.manager [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 15 16:34:25 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:34:25 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:34:26 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:34:26 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Took 0.45 seconds to deallocate network for instance.
Aug 15 16:34:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-c446beab-6c4c-4ef6-973d-110f642edb8b req-c64904ef-cf9d-4c9d-ad26-b58cf0cce3a0 service nova] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Received event network-vif-deleted-fbe64b8c-04d1-40d1-9b24-f3f021c282aa {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:34:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:26 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:34:26 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:34:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:26 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Deleted allocations for instance d51623f1-6613-41d6-abcb-9e4e626a97af
Aug 15 16:34:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d8c6aa35-77b7-4b13-b9a7-9d1b7f704eb2 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "d51623f1-6613-41d6-abcb-9e4e626a97af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.747s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:31 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:34:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "f0007ddd-f25d-4708-b617-d98728f6ffcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:31 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:34:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:32 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:34:32 user nova-compute[72849]: INFO nova.compute.claims [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Claim successful on node user
Aug 15 16:34:32 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:34:32 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.983s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG nova.network.neutron [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:34:33 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:34:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG nova.policy [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97a15b3aa0e9432da4b36d52bba1a9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535e7bf486d84793aafc48b88712daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:34:33 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Creating image(s)
Aug 15 16:34:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "/opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "/opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.200s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.194s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk 1073741824" returned: 0 in 0.057s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG nova.network.neutron [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Successfully created port: de3685be-4bbe-4c94-b193-49797916f7cc {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.208s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Cannot resize image /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG nova.objects.instance [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lazy-loading 'migration_context' on Instance uuid f0007ddd-f25d-4708-b617-d98728f6ffcc {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Ensure instance console log exists: /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG nova.network.neutron [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Successfully updated port: de3685be-4bbe-4c94-b193-49797916f7cc {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "refresh_cache-f0007ddd-f25d-4708-b617-d98728f6ffcc" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquired lock "refresh_cache-f0007ddd-f25d-4708-b617-d98728f6ffcc" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG nova.network.neutron [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG nova.compute.manager [req-4cd78c5a-9207-4b57-9ee3-710d1f7c8e01 req-33f771d5-c86a-4672-b831-20d3b738c37b service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Received event network-changed-de3685be-4bbe-4c94-b193-49797916f7cc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG nova.compute.manager [req-4cd78c5a-9207-4b57-9ee3-710d1f7c8e01 req-33f771d5-c86a-4672-b831-20d3b738c37b service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Refreshing instance network info cache due to event network-changed-de3685be-4bbe-4c94-b193-49797916f7cc. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4cd78c5a-9207-4b57-9ee3-710d1f7c8e01 req-33f771d5-c86a-4672-b831-20d3b738c37b service nova] Acquiring lock "refresh_cache-f0007ddd-f25d-4708-b617-d98728f6ffcc" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:34:34 user nova-compute[72849]: DEBUG nova.network.neutron [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.network.neutron [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Updating instance_info_cache with network_info: [{"id": "de3685be-4bbe-4c94-b193-49797916f7cc", "address": "fa:16:3e:b0:a4:25", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3685be-4b", "ovs_interfaceid": "de3685be-4bbe-4c94-b193-49797916f7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Releasing lock "refresh_cache-f0007ddd-f25d-4708-b617-d98728f6ffcc" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Instance network_info: |[{"id": "de3685be-4bbe-4c94-b193-49797916f7cc", "address": "fa:16:3e:b0:a4:25", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3685be-4b", "ovs_interfaceid": "de3685be-4bbe-4c94-b193-49797916f7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4cd78c5a-9207-4b57-9ee3-710d1f7c8e01 req-33f771d5-c86a-4672-b831-20d3b738c37b service nova] Acquired lock "refresh_cache-f0007ddd-f25d-4708-b617-d98728f6ffcc" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.network.neutron [req-4cd78c5a-9207-4b57-9ee3-710d1f7c8e01 req-33f771d5-c86a-4672-b831-20d3b738c37b service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Refreshing network info cache for port de3685be-4bbe-4c94-b193-49797916f7cc {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Start _get_guest_xml network_info=[{"id": "de3685be-4bbe-4c94-b193-49797916f7cc", "address": "fa:16:3e:b0:a4:25", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3685be-4b", "ovs_interfaceid": "de3685be-4bbe-4c94-b193-49797916f7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:34:35 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:34:35 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:34:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1930308320',display_name='tempest-TestStampPattern-server-1930308320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1930308320',id=37,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMi45qmqS3JUOsCtLhOHr8dN0lAxTLLIGCYJEIKxFLRznYZlSyGaG7loxy0DXCnWZwO5buUhd7UKGlCKbbX0UVLrUyKLyamZajv/9tO6pGG+kS70g0npId3SIuDJieSVQ==',key_name='tempest-TestStampPattern-336120091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='535e7bf486d84793aafc48b88712daf5',ramdisk_id='',reservation_id='r-8qqflud6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1132040334',owner_user_name='tempest-TestStampPattern-1132040334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:34:33Z,user_data=None,user_id='97a15b3aa0e9432da4b36d52bba1a9a8',uuid=f0007ddd-f25d-4708-b617-d98728f6ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de3685be-4bbe-4c94-b193-49797916f7cc", "address": "fa:16:3e:b0:a4:25", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3685be-4b", "ovs_interfaceid": "de3685be-4bbe-4c94-b193-49797916f7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Converting VIF {"id": "de3685be-4bbe-4c94-b193-49797916f7cc", "address": "fa:16:3e:b0:a4:25", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3685be-4b", "ovs_interfaceid": "de3685be-4bbe-4c94-b193-49797916f7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a4:25,bridge_name='br-int',has_traffic_filtering=True,id=de3685be-4bbe-4c94-b193-49797916f7cc,network=Network(07227fb5-780c-4de1-8211-f2ac91fd1908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3685be-4b') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.objects.instance [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lazy-loading 'pci_devices' on Instance uuid f0007ddd-f25d-4708-b617-d98728f6ffcc {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:34:35 user nova-compute[72849]:   <uuid>f0007ddd-f25d-4708-b617-d98728f6ffcc</uuid>
Aug 15 16:34:35 user nova-compute[72849]:   <name>instance-00000025</name>
Aug 15 16:34:35 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:34:35 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:34:35 user nova-compute[72849]:   <metadata>
Aug 15 16:34:35 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:34:35 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:34:35 user nova-compute[72849]:       <nova:name>tempest-TestStampPattern-server-1930308320</nova:name>
Aug 15 16:34:35 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:34:35</nova:creationTime>
Aug 15 16:34:35 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:34:35 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:34:35 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:34:35 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:34:35 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:34:35 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:34:35 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:34:35 user nova-compute[72849]:       <nova:owner>
Aug 15 16:34:35 user nova-compute[72849]:         <nova:user uuid="97a15b3aa0e9432da4b36d52bba1a9a8">tempest-TestStampPattern-1132040334-project-member</nova:user>
Aug 15 16:34:35 user nova-compute[72849]:         <nova:project uuid="535e7bf486d84793aafc48b88712daf5">tempest-TestStampPattern-1132040334</nova:project>
Aug 15 16:34:35 user nova-compute[72849]:       </nova:owner>
Aug 15 16:34:35 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:34:35 user nova-compute[72849]:       <nova:ports>
Aug 15 16:34:35 user nova-compute[72849]:         <nova:port uuid="de3685be-4bbe-4c94-b193-49797916f7cc">
Aug 15 16:34:35 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 16:34:35 user nova-compute[72849]:         </nova:port>
Aug 15 16:34:35 user nova-compute[72849]:       </nova:ports>
Aug 15 16:34:35 user nova-compute[72849]:     </nova:instance>
Aug 15 16:34:35 user nova-compute[72849]:   </metadata>
Aug 15 16:34:35 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:34:35 user nova-compute[72849]:     <system>
Aug 15 16:34:35 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:34:35 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:34:35 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:34:35 user nova-compute[72849]:       <entry name="serial">f0007ddd-f25d-4708-b617-d98728f6ffcc</entry>
Aug 15 16:34:35 user nova-compute[72849]:       <entry name="uuid">f0007ddd-f25d-4708-b617-d98728f6ffcc</entry>
Aug 15 16:34:35 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:34:35 user nova-compute[72849]:     </system>
Aug 15 16:34:35 user nova-compute[72849]:   </sysinfo>
Aug 15 16:34:35 user nova-compute[72849]:   <os>
Aug 15 16:34:35 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:34:35 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:34:35 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:34:35 user nova-compute[72849]:   </os>
Aug 15 16:34:35 user nova-compute[72849]:   <features>
Aug 15 16:34:35 user nova-compute[72849]:     <acpi/>
Aug 15 16:34:35 user nova-compute[72849]:     <apic/>
Aug 15 16:34:35 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:34:35 user nova-compute[72849]:   </features>
Aug 15 16:34:35 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:34:35 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:34:35 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:34:35 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:34:35 user nova-compute[72849]:   </clock>
Aug 15 16:34:35 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:34:35 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:34:35 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:34:35 user nova-compute[72849]:   </cpu>
Aug 15 16:34:35 user nova-compute[72849]:   <devices>
Aug 15 16:34:35 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:34:35 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:34:35 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk"/>
Aug 15 16:34:35 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:34:35 user nova-compute[72849]:     </disk>
Aug 15 16:34:35 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:34:35 user nova-compute[72849]:       <mac address="fa:16:3e:b0:a4:25"/>
Aug 15 16:34:35 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:34:35 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:34:35 user nova-compute[72849]:       <target dev="tapde3685be-4b"/>
Aug 15 16:34:35 user nova-compute[72849]:     </interface>
Aug 15 16:34:35 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:34:35 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/console.log" append="off"/>
Aug 15 16:34:35 user nova-compute[72849]:     </serial>
Aug 15 16:34:35 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:34:35 user nova-compute[72849]:     <video>
Aug 15 16:34:35 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:34:35 user nova-compute[72849]:     </video>
Aug 15 16:34:35 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:34:35 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:34:35 user nova-compute[72849]:     </rng>
Aug 15 16:34:35 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:34:35 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:34:35 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:34:35 user nova-compute[72849]:     </memballoon>
Aug 15 16:34:35 user nova-compute[72849]:   </devices>
Aug 15 16:34:35 user nova-compute[72849]: </domain>
Aug 15 16:34:35 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:34:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1930308320',display_name='tempest-TestStampPattern-server-1930308320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1930308320',id=37,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMi45qmqS3JUOsCtLhOHr8dN0lAxTLLIGCYJEIKxFLRznYZlSyGaG7loxy0DXCnWZwO5buUhd7UKGlCKbbX0UVLrUyKLyamZajv/9tO6pGG+kS70g0npId3SIuDJieSVQ==',key_name='tempest-TestStampPattern-336120091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='535e7bf486d84793aafc48b88712daf5',ramdisk_id='',reservation_id='r-8qqflud6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1132040334',owner_user_name='tempest-TestStampPattern-1132040334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:34:33Z,user_data=None,user_id='97a15b3aa0e9432da4b36d52bba1a9a8',uuid=f0007ddd-f25d-4708-b617-d98728f6ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de3685be-4bbe-4c94-b193-49797916f7cc", "address": "fa:16:3e:b0:a4:25", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3685be-4b", "ovs_interfaceid": "de3685be-4bbe-4c94-b193-49797916f7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Converting VIF {"id": "de3685be-4bbe-4c94-b193-49797916f7cc", "address": "fa:16:3e:b0:a4:25", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3685be-4b", "ovs_interfaceid": "de3685be-4bbe-4c94-b193-49797916f7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a4:25,bridge_name='br-int',has_traffic_filtering=True,id=de3685be-4bbe-4c94-b193-49797916f7cc,network=Network(07227fb5-780c-4de1-8211-f2ac91fd1908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3685be-4b') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG os_vif [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a4:25,bridge_name='br-int',has_traffic_filtering=True,id=de3685be-4bbe-4c94-b193-49797916f7cc,network=Network(07227fb5-780c-4de1-8211-f2ac91fd1908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3685be-4b') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde3685be-4b, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde3685be-4b, col_values=(('external_ids', {'iface-id': 'de3685be-4bbe-4c94-b193-49797916f7cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:a4:25', 'vm-uuid': 'f0007ddd-f25d-4708-b617-d98728f6ffcc'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:35 user nova-compute[72849]: INFO os_vif [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a4:25,bridge_name='br-int',has_traffic_filtering=True,id=de3685be-4bbe-4c94-b193-49797916f7cc,network=Network(07227fb5-780c-4de1-8211-f2ac91fd1908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3685be-4b')
Aug 15 16:34:35 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] No VIF found with MAC fa:16:3e:b0:a4:25, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.network.neutron [req-4cd78c5a-9207-4b57-9ee3-710d1f7c8e01 req-33f771d5-c86a-4672-b831-20d3b738c37b service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Updated VIF entry in instance network info cache for port de3685be-4bbe-4c94-b193-49797916f7cc. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG nova.network.neutron [req-4cd78c5a-9207-4b57-9ee3-710d1f7c8e01 req-33f771d5-c86a-4672-b831-20d3b738c37b service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Updating instance_info_cache with network_info: [{"id": "de3685be-4bbe-4c94-b193-49797916f7cc", "address": "fa:16:3e:b0:a4:25", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3685be-4b", "ovs_interfaceid": "de3685be-4bbe-4c94-b193-49797916f7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:34:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4cd78c5a-9207-4b57-9ee3-710d1f7c8e01 req-33f771d5-c86a-4672-b831-20d3b738c37b service nova] Releasing lock "refresh_cache-f0007ddd-f25d-4708-b617-d98728f6ffcc" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:34:36 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Updating instance_info_cache with network_info: [{"id": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "address": "fa:16:3e:ca:d6:ea", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010fd638-d6", "ovs_interfaceid": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:34:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:34:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:34:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:34:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:36 user nova-compute[72849]: DEBUG nova.compute.manager [req-2255de77-a51a-4e56-8a54-4e76425c50d6 req-9b273208-b154-46c6-bb30-c295946d66b5 service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Received event network-vif-plugged-de3685be-4bbe-4c94-b193-49797916f7cc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:34:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2255de77-a51a-4e56-8a54-4e76425c50d6 req-9b273208-b154-46c6-bb30-c295946d66b5 service nova] Acquiring lock "f0007ddd-f25d-4708-b617-d98728f6ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2255de77-a51a-4e56-8a54-4e76425c50d6 req-9b273208-b154-46c6-bb30-c295946d66b5 service nova] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2255de77-a51a-4e56-8a54-4e76425c50d6 req-9b273208-b154-46c6-bb30-c295946d66b5 service nova] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:36 user nova-compute[72849]: DEBUG nova.compute.manager [req-2255de77-a51a-4e56-8a54-4e76425c50d6 req-9b273208-b154-46c6-bb30-c295946d66b5 service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] No waiting events found dispatching network-vif-plugged-de3685be-4bbe-4c94-b193-49797916f7cc {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:34:36 user nova-compute[72849]: WARNING nova.compute.manager [req-2255de77-a51a-4e56-8a54-4e76425c50d6 req-9b273208-b154-46c6-bb30-c295946d66b5 service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Received unexpected event network-vif-plugged-de3685be-4bbe-4c94-b193-49797916f7cc for instance with vm_state building and task_state spawning.
Aug 15 16:34:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:37 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:34:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:34:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:34:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117278.74622, f0007ddd-f25d-4708-b617-d98728f6ffcc => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:34:38 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] VM Resumed (Lifecycle Event)
Aug 15 16:34:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:34:38 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Instance spawned successfully.
Aug 15 16:34:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:34:38 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:34:38 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117278.758506, f0007ddd-f25d-4708-b617-d98728f6ffcc => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:34:38 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] VM Started (Lifecycle Event)
Aug 15 16:34:38 user nova-compute[72849]: INFO nova.compute.manager [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Took 5.63 seconds to spawn the instance on the hypervisor.
Aug 15 16:34:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:34:38 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:34:38 user nova-compute[72849]: DEBUG nova.compute.manager [req-7bd6b97c-5e38-44b7-8307-8fc159f49879 req-a8ded472-2abf-4f39-b59a-55e2bb492907 service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Received event network-vif-plugged-de3685be-4bbe-4c94-b193-49797916f7cc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7bd6b97c-5e38-44b7-8307-8fc159f49879 req-a8ded472-2abf-4f39-b59a-55e2bb492907 service nova] Acquiring lock "f0007ddd-f25d-4708-b617-d98728f6ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7bd6b97c-5e38-44b7-8307-8fc159f49879 req-a8ded472-2abf-4f39-b59a-55e2bb492907 service nova] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7bd6b97c-5e38-44b7-8307-8fc159f49879 req-a8ded472-2abf-4f39-b59a-55e2bb492907 service nova] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:38 user nova-compute[72849]: DEBUG nova.compute.manager [req-7bd6b97c-5e38-44b7-8307-8fc159f49879 req-a8ded472-2abf-4f39-b59a-55e2bb492907 service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] No waiting events found dispatching network-vif-plugged-de3685be-4bbe-4c94-b193-49797916f7cc {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:34:38 user nova-compute[72849]: WARNING nova.compute.manager [req-7bd6b97c-5e38-44b7-8307-8fc159f49879 req-a8ded472-2abf-4f39-b59a-55e2bb492907 service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Received unexpected event network-vif-plugged-de3685be-4bbe-4c94-b193-49797916f7cc for instance with vm_state building and task_state spawning.
Aug 15 16:34:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:38 user nova-compute[72849]: INFO nova.compute.manager [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Took 6.98 seconds to build instance.
Aug 15 16:34:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3da2a6e2-db30-4cc6-b3bf-28e2213c0490 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.088s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:34:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:40 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117265.767524, d51623f1-6613-41d6-abcb-9e4e626a97af => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:34:40 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] VM Stopped (Lifecycle Event)
Aug 15 16:34:40 user nova-compute[72849]: DEBUG nova.compute.manager [None req-61905be6-843d-41a4-a2ca-9a7a7b5a8c6d None None] [instance: d51623f1-6613-41d6-abcb-9e4e626a97af] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:34:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:34:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:41 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:34:41 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:34:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=7331MB free_disk=25.13927459716797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:34:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:42 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:34:42 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:34:42 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:34:42 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc521d87-09aa-44ba-a87c-1cd5517b3707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:34:42 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 46f0aa43-e313-4aff-bacc-aa5290193b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:34:42 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f1da55ae-5150-476c-a229-f26ddfee7e9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:34:42 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b15c5692-8c0c-4bf0-a79f-b7813e71de9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:34:42 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 98358bbf-c7c1-4868-81ee-77bd229133fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:34:42 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance c313dd0f-12a8-46e1-8443-31a3abfac0ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:34:42 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 4b9f21bc-836f-4095-9eb3-d3971d418363 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:34:42 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f0007ddd-f25d-4708-b617-d98728f6ffcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:34:42 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:34:42 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:34:42 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:34:42 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:34:42 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:34:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:44 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:34:44 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:34:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "98358bbf-c7c1-4868-81ee-77bd229133fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:46 user nova-compute[72849]: INFO nova.compute.manager [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Terminating instance
Aug 15 16:34:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG nova.compute.manager [req-a4a7dda3-28a6-40b4-a07f-d8494aee3474 req-cbe485e2-2c46-4cdc-bef4-e19766cbb9a5 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received event network-vif-unplugged-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a4a7dda3-28a6-40b4-a07f-d8494aee3474 req-cbe485e2-2c46-4cdc-bef4-e19766cbb9a5 service nova] Acquiring lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a4a7dda3-28a6-40b4-a07f-d8494aee3474 req-cbe485e2-2c46-4cdc-bef4-e19766cbb9a5 service nova] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a4a7dda3-28a6-40b4-a07f-d8494aee3474 req-cbe485e2-2c46-4cdc-bef4-e19766cbb9a5 service nova] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG nova.compute.manager [req-a4a7dda3-28a6-40b4-a07f-d8494aee3474 req-cbe485e2-2c46-4cdc-bef4-e19766cbb9a5 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] No waiting events found dispatching network-vif-unplugged-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG nova.compute.manager [req-a4a7dda3-28a6-40b4-a07f-d8494aee3474 req-cbe485e2-2c46-4cdc-bef4-e19766cbb9a5 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received event network-vif-unplugged-f6196531-f18f-4440-8a72-27835267e702 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:34:46 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Instance destroyed successfully.
Aug 15 16:34:46 user nova-compute[72849]: DEBUG nova.objects.instance [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'resources' on Instance uuid 98358bbf-c7c1-4868-81ee-77bd229133fd {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2006001136',display_name='tempest-ServerActionsTestOtherA-server-2006001136',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2006001136',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFz77lNADA9bIEqsG+/0pmqytVknVJgn2QYVHLyikCb7OZcHj5oDk3lRMMWld0kQEG++u8j1QCo1UgVUz17EVZQY5cNigvtxWp2mZweLxgKV8OVoFjr81Ihq1bC8gLICA==',key_name='tempest-keypair-669870558',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:30:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33a3a3412c95451db4dd0edc27f361cc',ramdisk_id='',reservation_id='r-hj2o5jsg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-514064593',owner_user_name='tempest-ServerActionsTestOtherA-514064593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:31:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60cbe30799ad4438b84251a254691b70',uuid=98358bbf-c7c1-4868-81ee-77bd229133fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converting VIF {"id": "f6196531-f18f-4440-8a72-27835267e702", "address": "fa:16:3e:81:b9:08", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6196531-f1", "ovs_interfaceid": "f6196531-f18f-4440-8a72-27835267e702", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:b9:08,bridge_name='br-int',has_traffic_filtering=True,id=f6196531-f18f-4440-8a72-27835267e702,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6196531-f1') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG os_vif [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:b9:08,bridge_name='br-int',has_traffic_filtering=True,id=f6196531-f18f-4440-8a72-27835267e702,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6196531-f1') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6196531-f1, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:34:46 user nova-compute[72849]: INFO os_vif [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:b9:08,bridge_name='br-int',has_traffic_filtering=True,id=f6196531-f18f-4440-8a72-27835267e702,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6196531-f1')
Aug 15 16:34:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzMGVaDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:34:46 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:34:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7c1c7c-9bab-40ed-8e1d-6713e9244bfb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b815397d-4699-46b3-84a8-0b8349fbd770]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:34:46 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:34:46 user nova-compute[72849]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)
Aug 15 16:34:46 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:34:46 user nova-compute[72849]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 (non-flash)
Aug 15 16:34:46 user nova-compute[72849]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)
Aug 15 16:34:46 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3582cb520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792'): ({'sdg'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Removing single pathed devices sdg {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70d4680-9796-4725-8854-a5599c98fabc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d740264-929a-4406-ac98-d8e932323435]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Flushing IO for device /dev/sdg {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[96765bc0-dd94-421f-9a86-e4ae9ea95beb]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.069s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9b3e94-9f1e-43f6-851f-0e2e36db3237]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] SCSI volumes sdg have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be71428-da43-44c1-9666-75f29def3ff6]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffb072f-71b4-4e61-bedc-0acfa86ff63c]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792, portal: 172.16.0.220,3260]
Aug 15 16:34:47 user nova-compute[72849]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792, portal: 172.16.0.220,3260] successful.
Aug 15 16:34:47 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6cf00e-e4c2-4a4a-a31d-d4618ce3bd02]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] <== disconnect_volume: return (338ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:34:47 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Deleting instance files /opt/stack/data/nova/instances/98358bbf-c7c1-4868-81ee-77bd229133fd_del
Aug 15 16:34:47 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Deletion of /opt/stack/data/nova/instances/98358bbf-c7c1-4868-81ee-77bd229133fd_del complete
Aug 15 16:34:47 user nova-compute[72849]: INFO nova.compute.manager [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 15 16:34:47 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:34:47 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:34:48 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Took 0.72 seconds to deallocate network for instance.
Aug 15 16:34:48 user nova-compute[72849]: DEBUG nova.compute.manager [req-92230c7c-5d93-49d0-8c0e-5c3d349a997e req-1de1bbe7-cff3-4f7d-a3cb-972a510a9e33 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received event network-vif-plugged-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:34:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-92230c7c-5d93-49d0-8c0e-5c3d349a997e req-1de1bbe7-cff3-4f7d-a3cb-972a510a9e33 service nova] Acquiring lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-92230c7c-5d93-49d0-8c0e-5c3d349a997e req-1de1bbe7-cff3-4f7d-a3cb-972a510a9e33 service nova] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-92230c7c-5d93-49d0-8c0e-5c3d349a997e req-1de1bbe7-cff3-4f7d-a3cb-972a510a9e33 service nova] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:48 user nova-compute[72849]: DEBUG nova.compute.manager [req-92230c7c-5d93-49d0-8c0e-5c3d349a997e req-1de1bbe7-cff3-4f7d-a3cb-972a510a9e33 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] No waiting events found dispatching network-vif-plugged-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:34:48 user nova-compute[72849]: WARNING nova.compute.manager [req-92230c7c-5d93-49d0-8c0e-5c3d349a997e req-1de1bbe7-cff3-4f7d-a3cb-972a510a9e33 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received unexpected event network-vif-plugged-f6196531-f18f-4440-8a72-27835267e702 for instance with vm_state active and task_state deleting.
Aug 15 16:34:48 user nova-compute[72849]: DEBUG nova.compute.manager [req-92230c7c-5d93-49d0-8c0e-5c3d349a997e req-1de1bbe7-cff3-4f7d-a3cb-972a510a9e33 service nova] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Received event network-vif-deleted-f6196531-f18f-4440-8a72-27835267e702 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:34:48 user nova-compute[72849]: INFO nova.compute.manager [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Took 0.73 seconds to detach 1 volumes for instance.
Aug 15 16:34:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Deleting volume: 5f4a35b3-572d-4c8f-b4bd-f97d7d15b792 {{(pid=72849) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 16:34:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:49 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:34:49 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:34:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:49 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Deleted allocations for instance 98358bbf-c7c1-4868-81ee-77bd229133fd
Aug 15 16:34:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5f78a053-4093-4290-a55d-40ca893a2a61 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "98358bbf-c7c1-4868-81ee-77bd229133fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.339s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:55 user nova-compute[72849]: INFO nova.compute.manager [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Terminating instance
Aug 15 16:34:55 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-80adf725-b18f-4ffd-b9cc-c8b2cf8bae18 req-ce1833d9-d2f8-42b4-bad4-0dd8c361a5ca service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received event network-vif-unplugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-80adf725-b18f-4ffd-b9cc-c8b2cf8bae18 req-ce1833d9-d2f8-42b4-bad4-0dd8c361a5ca service nova] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-80adf725-b18f-4ffd-b9cc-c8b2cf8bae18 req-ce1833d9-d2f8-42b4-bad4-0dd8c361a5ca service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-80adf725-b18f-4ffd-b9cc-c8b2cf8bae18 req-ce1833d9-d2f8-42b4-bad4-0dd8c361a5ca service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-80adf725-b18f-4ffd-b9cc-c8b2cf8bae18 req-ce1833d9-d2f8-42b4-bad4-0dd8c361a5ca service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] No waiting events found dispatching network-vif-unplugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-80adf725-b18f-4ffd-b9cc-c8b2cf8bae18 req-ce1833d9-d2f8-42b4-bad4-0dd8c361a5ca service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received event network-vif-unplugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:55 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Instance destroyed successfully.
Aug 15 16:34:55 user nova-compute[72849]: DEBUG nova.objects.instance [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'resources' on Instance uuid f1da55ae-5150-476c-a229-f26ddfee7e9e {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:25:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1450170250',display_name='tempest-AttachVolumeTestJSON-server-1450170250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1450170250',id=25,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbHBCrfJdjyvvfHVCDAyVY3pxTMcpwjUaUui51i7UWK+4o1OUXo/LN4XWDmXW8h8aEFw/JKcC9Dwq6+Cbh0MQQ2dswuJTGFHVpH2lAWXJOXrjs0Yd41UjVwgxvzDZT+WQ==',key_name='tempest-keypair-1527966259',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='607d6d3506de49549888f16d06829c89',ramdisk_id='',reservation_id='r-vfgrreq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1114163063',owner_user_name='tempest-AttachVolumeTestJSON-1114163063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:33:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abdcfedce2124d86a0df67571fdfcde9',uuid=f1da55ae-5150-476c-a229-f26ddfee7e9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converting VIF {"id": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "address": "fa:16:3e:62:d6:3e", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71bc55dc-c0", "ovs_interfaceid": "71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG os_vif [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71bc55dc-c0, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:34:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:34:55 user nova-compute[72849]: INFO os_vif [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:d6:3e,bridge_name='br-int',has_traffic_filtering=True,id=71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71bc55dc-c0')
Aug 15 16:34:55 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Deleting instance files /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e_del
Aug 15 16:34:55 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Deletion of /opt/stack/data/nova/instances/f1da55ae-5150-476c-a229-f26ddfee7e9e_del complete
Aug 15 16:34:56 user nova-compute[72849]: INFO nova.compute.manager [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 15 16:34:56 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:34:56 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:34:56 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:34:56 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:34:56 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Took 0.95 seconds to deallocate network for instance.
Aug 15 16:34:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:57 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:34:57 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:34:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:57 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Deleted allocations for instance f1da55ae-5150-476c-a229-f26ddfee7e9e
Aug 15 16:34:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2f8afe3b-8933-4c57-a9ca-6a77733776f1 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.164s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-f6204123-d7a1-4dfe-a5f9-dd2a2fd2b79b req-6be6c3f5-df12-40bd-9107-5950756e08d5 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received event network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:34:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f6204123-d7a1-4dfe-a5f9-dd2a2fd2b79b req-6be6c3f5-df12-40bd-9107-5950756e08d5 service nova] Acquiring lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:34:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f6204123-d7a1-4dfe-a5f9-dd2a2fd2b79b req-6be6c3f5-df12-40bd-9107-5950756e08d5 service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:34:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f6204123-d7a1-4dfe-a5f9-dd2a2fd2b79b req-6be6c3f5-df12-40bd-9107-5950756e08d5 service nova] Lock "f1da55ae-5150-476c-a229-f26ddfee7e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:34:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-f6204123-d7a1-4dfe-a5f9-dd2a2fd2b79b req-6be6c3f5-df12-40bd-9107-5950756e08d5 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] No waiting events found dispatching network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:34:57 user nova-compute[72849]: WARNING nova.compute.manager [req-f6204123-d7a1-4dfe-a5f9-dd2a2fd2b79b req-6be6c3f5-df12-40bd-9107-5950756e08d5 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received unexpected event network-vif-plugged-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba for instance with vm_state deleted and task_state None.
Aug 15 16:34:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-f6204123-d7a1-4dfe-a5f9-dd2a2fd2b79b req-6be6c3f5-df12-40bd-9107-5950756e08d5 service nova] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Received event network-vif-deleted-71bc55dc-c08b-4850-8fda-ae8c9bb8a1ba {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:34:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:00 user nova-compute[72849]: DEBUG nova.compute.manager [req-34885008-239d-4f42-945b-be7f3bab2f08 req-c4953433-7eb0-42b5-91e0-164bdf88e8d0 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received event network-changed-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:00 user nova-compute[72849]: DEBUG nova.compute.manager [req-34885008-239d-4f42-945b-be7f3bab2f08 req-c4953433-7eb0-42b5-91e0-164bdf88e8d0 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Refreshing instance network info cache due to event network-changed-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:35:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-34885008-239d-4f42-945b-be7f3bab2f08 req-c4953433-7eb0-42b5-91e0-164bdf88e8d0 service nova] Acquiring lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:35:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-34885008-239d-4f42-945b-be7f3bab2f08 req-c4953433-7eb0-42b5-91e0-164bdf88e8d0 service nova] Acquired lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:35:00 user nova-compute[72849]: DEBUG nova.network.neutron [req-34885008-239d-4f42-945b-be7f3bab2f08 req-c4953433-7eb0-42b5-91e0-164bdf88e8d0 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Refreshing network info cache for port b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:35:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:00 user nova-compute[72849]: INFO nova.compute.manager [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Detaching volume d4ac0a7a-d4be-4352-a588-19fb1729148d
Aug 15 16:35:01 user nova-compute[72849]: INFO nova.virt.block_device [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Attempting to driver detach volume d4ac0a7a-d4be-4352-a588-19fb1729148d from mountpoint /dev/vdb
Aug 15 16:35:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Attempting to detach device vdb from instance b15c5692-8c0c-4bf0-a79f-b7813e71de9a from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:35:01 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:35:01 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:35:01 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:35:01 user nova-compute[72849]:   <serial>d4ac0a7a-d4be-4352-a588-19fb1729148d</serial>
Aug 15 16:35:01 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:35:01 user nova-compute[72849]: </disk>
Aug 15 16:35:01 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:35:01 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Successfully detached device vdb from instance b15c5692-8c0c-4bf0-a79f-b7813e71de9a from the persistent domain config.
Aug 15 16:35:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b15c5692-8c0c-4bf0-a79f-b7813e71de9a from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:35:01 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:35:01 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:35:01 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:35:01 user nova-compute[72849]:   <serial>d4ac0a7a-d4be-4352-a588-19fb1729148d</serial>
Aug 15 16:35:01 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:35:01 user nova-compute[72849]: </disk>
Aug 15 16:35:01 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG nova.network.neutron [req-34885008-239d-4f42-945b-be7f3bab2f08 req-c4953433-7eb0-42b5-91e0-164bdf88e8d0 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Updated VIF entry in instance network info cache for port b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG nova.network.neutron [req-34885008-239d-4f42-945b-be7f3bab2f08 req-c4953433-7eb0-42b5-91e0-164bdf88e8d0 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Updating instance_info_cache with network_info: [{"id": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "address": "fa:16:3e:8a:41:62", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183f8f-93", "ovs_interfaceid": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-34885008-239d-4f42-945b-be7f3bab2f08 req-c4953433-7eb0-42b5-91e0-164bdf88e8d0 service nova] Releasing lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692117301.55711, b15c5692-8c0c-4bf0-a79f-b7813e71de9a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b15c5692-8c0c-4bf0-a79f-b7813e71de9a {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:35:01 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Successfully detached device vdb from instance b15c5692-8c0c-4bf0-a79f-b7813e71de9a from the live domain config.
Aug 15 16:35:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WojnJzIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:35:01 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:35:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7fdf99-644a-4439-bd38-16ea09b5986a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fbce5c-f682-467d-a4fe-b703f04dd9b4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:35:01 user nova-compute[72849]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)
Aug 15 16:35:01 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:35:01 user nova-compute[72849]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d (non-flash)
Aug 15 16:35:01 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3582ca680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a155b89f-b690-4cd3-aa8c-1f6e638a061f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[44492e84-0887-44f5-9538-ffcee72f66ff]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ab89b9-1fe3-4032-8776-e1f5435b6f04]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[da131177-d1f2-47d3-b4c9-df0b31ed03ba]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e98ad3-2e45-494b-bc66-05462db947a1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c3b17e-3ea4-4cbc-a16d-fb09135e0a8b]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d, portal: 172.16.0.220,3260]
Aug 15 16:35:01 user nova-compute[72849]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d, portal: 172.16.0.220,3260] successful.
Aug 15 16:35:01 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117286.816837, 98358bbf-c7c1-4868-81ee-77bd229133fd => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:35:01 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] VM Stopped (Lifecycle Event)
Aug 15 16:35:01 user nova-compute[72849]: DEBUG nova.compute.manager [None req-9807aa47-4a83-4644-82bc-6e2e8b1460c7 None None] [instance: 98358bbf-c7c1-4868-81ee-77bd229133fd] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ac0a7a-d4be-4352-a588-19fb1729148d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[826cab38-1a92-4ef3-9f84-54b991f098e2]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] <== disconnect_volume: return (267ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:35:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:35:02 user nova-compute[72849]: DEBUG nova.objects.instance [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'flavor' on Instance uuid b15c5692-8c0c-4bf0-a79f-b7813e71de9a {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:35:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f9f4cfef-3dd2-400d-af1c-d9f22b844df2 tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.663s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:02 user nova-compute[72849]: DEBUG nova.compute.manager [req-e2929b4e-c07a-45be-92e4-84727e2b8035 req-d3676f1a-bc4e-4b87-a429-f3d8958796b0 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received event network-changed-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:02 user nova-compute[72849]: DEBUG nova.compute.manager [req-e2929b4e-c07a-45be-92e4-84727e2b8035 req-d3676f1a-bc4e-4b87-a429-f3d8958796b0 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Refreshing instance network info cache due to event network-changed-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:35:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e2929b4e-c07a-45be-92e4-84727e2b8035 req-d3676f1a-bc4e-4b87-a429-f3d8958796b0 service nova] Acquiring lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:35:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e2929b4e-c07a-45be-92e4-84727e2b8035 req-d3676f1a-bc4e-4b87-a429-f3d8958796b0 service nova] Acquired lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:35:02 user nova-compute[72849]: DEBUG nova.network.neutron [req-e2929b4e-c07a-45be-92e4-84727e2b8035 req-d3676f1a-bc4e-4b87-a429-f3d8958796b0 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Refreshing network info cache for port b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:35:03 user nova-compute[72849]: DEBUG nova.network.neutron [req-e2929b4e-c07a-45be-92e4-84727e2b8035 req-d3676f1a-bc4e-4b87-a429-f3d8958796b0 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Updated VIF entry in instance network info cache for port b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:35:03 user nova-compute[72849]: DEBUG nova.network.neutron [req-e2929b4e-c07a-45be-92e4-84727e2b8035 req-d3676f1a-bc4e-4b87-a429-f3d8958796b0 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Updating instance_info_cache with network_info: [{"id": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "address": "fa:16:3e:8a:41:62", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183f8f-93", "ovs_interfaceid": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:35:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e2929b4e-c07a-45be-92e4-84727e2b8035 req-d3676f1a-bc4e-4b87-a429-f3d8958796b0 service nova] Releasing lock "refresh_cache-b15c5692-8c0c-4bf0-a79f-b7813e71de9a" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:35:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-7bb04f5e-0af9-4aa7-9326-0f9572da4662 req-6de8fad3-4540-4f7e-ae34-7195a663887f service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Received event network-changed-ff0a1cb3-0154-4850-aaac-558f01cbe112 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-7bb04f5e-0af9-4aa7-9326-0f9572da4662 req-6de8fad3-4540-4f7e-ae34-7195a663887f service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Refreshing instance network info cache due to event network-changed-ff0a1cb3-0154-4850-aaac-558f01cbe112. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:35:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7bb04f5e-0af9-4aa7-9326-0f9572da4662 req-6de8fad3-4540-4f7e-ae34-7195a663887f service nova] Acquiring lock "refresh_cache-c313dd0f-12a8-46e1-8443-31a3abfac0ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:35:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7bb04f5e-0af9-4aa7-9326-0f9572da4662 req-6de8fad3-4540-4f7e-ae34-7195a663887f service nova] Acquired lock "refresh_cache-c313dd0f-12a8-46e1-8443-31a3abfac0ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:35:10 user nova-compute[72849]: DEBUG nova.network.neutron [req-7bb04f5e-0af9-4aa7-9326-0f9572da4662 req-6de8fad3-4540-4f7e-ae34-7195a663887f service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Refreshing network info cache for port ff0a1cb3-0154-4850-aaac-558f01cbe112 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:35:10 user nova-compute[72849]: DEBUG nova.network.neutron [req-7bb04f5e-0af9-4aa7-9326-0f9572da4662 req-6de8fad3-4540-4f7e-ae34-7195a663887f service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Updated VIF entry in instance network info cache for port ff0a1cb3-0154-4850-aaac-558f01cbe112. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:35:10 user nova-compute[72849]: DEBUG nova.network.neutron [req-7bb04f5e-0af9-4aa7-9326-0f9572da4662 req-6de8fad3-4540-4f7e-ae34-7195a663887f service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Updating instance_info_cache with network_info: [{"id": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "address": "fa:16:3e:e6:27:9b", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0a1cb3-01", "ovs_interfaceid": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:35:10 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117295.9277058, f1da55ae-5150-476c-a229-f26ddfee7e9e => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:35:10 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] VM Stopped (Lifecycle Event)
Aug 15 16:35:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7bb04f5e-0af9-4aa7-9326-0f9572da4662 req-6de8fad3-4540-4f7e-ae34-7195a663887f service nova] Releasing lock "refresh_cache-c313dd0f-12a8-46e1-8443-31a3abfac0ab" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:35:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-af281ff0-cce7-43dd-a0db-9435bc9b3b4e None None] [instance: f1da55ae-5150-476c-a229-f26ddfee7e9e] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:35:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG nova.objects.instance [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'flavor' on Instance uuid c313dd0f-12a8-46e1-8443-31a3abfac0ab {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:14 user nova-compute[72849]: INFO nova.compute.manager [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Attaching volume 72c39c2c-38f3-4040-8adb-3ac49d0c89cf to /dev/vdb
Aug 15 16:35:14 user nova-compute[72849]: DEBUG os_brick.utils [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0b56f8-d256-4122-829b-1b97e3646dba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c75cd03-0c2b-46cc-84b9-6bcdc23c80a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[750127c2-60d6-4cf0-b0fa-0458d27009ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d29e474-bff2-45e3-8bb5-114ecf4221b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:35:14 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:35:14 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99bb46d-05c4-460a-8a11-e3bac5737ceb]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG os_brick.utils [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:35:14 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Updating existing volume attachment record: ca5bc7e3-2418-4923-b3ef-c547cc656262 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:35:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:15 user nova-compute[72849]: INFO nova.compute.manager [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Terminating instance
Aug 15 16:35:15 user nova-compute[72849]: DEBUG nova.compute.manager [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:35:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-49c7ca22-d916-46cf-8e65-4cb3da32f573 req-bf83de22-cc25-4a8a-96c1-c03c1b7925a2 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-vif-unplugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-49c7ca22-d916-46cf-8e65-4cb3da32f573 req-bf83de22-cc25-4a8a-96c1-c03c1b7925a2 service nova] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-49c7ca22-d916-46cf-8e65-4cb3da32f573 req-bf83de22-cc25-4a8a-96c1-c03c1b7925a2 service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-49c7ca22-d916-46cf-8e65-4cb3da32f573 req-bf83de22-cc25-4a8a-96c1-c03c1b7925a2 service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-49c7ca22-d916-46cf-8e65-4cb3da32f573 req-bf83de22-cc25-4a8a-96c1-c03c1b7925a2 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] No waiting events found dispatching network-vif-unplugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:35:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-49c7ca22-d916-46cf-8e65-4cb3da32f573 req-bf83de22-cc25-4a8a-96c1-c03c1b7925a2 service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-vif-unplugged-993c798d-2a87-4ee5-80ea-484b8848ca54 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:16 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Instance destroyed successfully.
Aug 15 16:35:16 user nova-compute[72849]: DEBUG nova.objects.instance [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'resources' on Instance uuid 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-403650730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-403650730',id=13,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:21:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f51f800c0ca74e149a2f8ed9718b221f',ramdisk_id='',reservation_id='r-xr5wu3j2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:23:14Z,user_data=None,user_id='cd6279423b7f43c4aac7956aec43efdd',uuid=84b77d6c-5e6f-4fee-81fd-d58ee58b06ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "993c798d-2a87-4ee5-80ea-484b8848ca54", "address": "fa:16:3e:e2:8e:fc", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993c798d-2a", "ovs_interfaceid": "993c798d-2a87-4ee5-80ea-484b8848ca54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converting VIF {"id": "993c798d-2a87-4ee5-80ea-484b8848ca54", "address": "fa:16:3e:e2:8e:fc", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993c798d-2a", "ovs_interfaceid": "993c798d-2a87-4ee5-80ea-484b8848ca54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=993c798d-2a87-4ee5-80ea-484b8848ca54,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993c798d-2a') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_vif [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=993c798d-2a87-4ee5-80ea-484b8848ca54,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993c798d-2a') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap993c798d-2a, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:35:16 user nova-compute[72849]: INFO os_vif [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=993c798d-2a87-4ee5-80ea-484b8848ca54,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993c798d-2a')
Aug 15 16:35:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDEiHUZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:35:16 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bd1c63-091a-4e3b-bbb2-36d062aa656a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1fd1ea-e204-4f50-a4b7-37fcc79ba9c6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:35:16 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead (non-flash)
Aug 15 16:35:16 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc35827d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead'): ({'sdf'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Removing single pathed devices sdf {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bfc4f1-2dc0-441d-ace3-f381960bd084]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac53a3c-562c-4cac-a0dc-b3d80acc68ac]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Flushing IO for device /dev/sdf {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13f74ef-eaf9-4f75-b231-1abe2377fe01]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[944875f0-2086-4263-b2cd-f5ef0eadce70]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] SCSI volumes sdf have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb002cd2-790e-4998-bf05-ffef6da8400e]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec2f048-41d8-474f-b5fd-0acadf590bbf]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead, portal: 172.16.0.220,3260]
Aug 15 16:35:16 user nova-compute[72849]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead, portal: 172.16.0.220,3260] successful.
Aug 15 16:35:16 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a80adf-5b9b-4aa2-91d2-22f75686aead -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3175c9-d013-42c1-9bf1-a17e59f8634f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] <== disconnect_volume: return (297ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:35:16 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Deleting instance files /opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab_del
Aug 15 16:35:16 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Deletion of /opt/stack/data/nova/instances/84b77d6c-5e6f-4fee-81fd-d58ee58b06ab_del complete
Aug 15 16:35:16 user nova-compute[72849]: INFO nova.compute.manager [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 15 16:35:16 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:35:16 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:35:17 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:35:17 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Took 0.55 seconds to deallocate network for instance.
Aug 15 16:35:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-b7bc8011-5e51-4d09-a5ae-8352924cdbef req-64d25c61-6901-4d14-8151-a67bc1a4b9ca service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b7bc8011-5e51-4d09-a5ae-8352924cdbef req-64d25c61-6901-4d14-8151-a67bc1a4b9ca service nova] Acquiring lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b7bc8011-5e51-4d09-a5ae-8352924cdbef req-64d25c61-6901-4d14-8151-a67bc1a4b9ca service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b7bc8011-5e51-4d09-a5ae-8352924cdbef req-64d25c61-6901-4d14-8151-a67bc1a4b9ca service nova] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-b7bc8011-5e51-4d09-a5ae-8352924cdbef req-64d25c61-6901-4d14-8151-a67bc1a4b9ca service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] No waiting events found dispatching network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:35:18 user nova-compute[72849]: WARNING nova.compute.manager [req-b7bc8011-5e51-4d09-a5ae-8352924cdbef req-64d25c61-6901-4d14-8151-a67bc1a4b9ca service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received unexpected event network-vif-plugged-993c798d-2a87-4ee5-80ea-484b8848ca54 for instance with vm_state active and task_state deleting.
Aug 15 16:35:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-b7bc8011-5e51-4d09-a5ae-8352924cdbef req-64d25c61-6901-4d14-8151-a67bc1a4b9ca service nova] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Received event network-vif-deleted-993c798d-2a87-4ee5-80ea-484b8848ca54 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:18 user nova-compute[72849]: INFO nova.compute.manager [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Took 0.78 seconds to detach 1 volumes for instance.
Aug 15 16:35:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:18 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:35:18 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:35:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:18 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Deleted allocations for instance 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab
Aug 15 16:35:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-99e26a3b-a3f2-48b0-8ac8-7fcfaa5000ba tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "84b77d6c-5e6f-4fee-81fd-d58ee58b06ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.044s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQrzJMby', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:35:23 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:35:23 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:35:23 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d30eaa2-1c9d-491d-a3b7-11b25182b2e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:35:23 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3eafcb-f751-41cf-adc9-5f122556e8dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf] added
Aug 15 16:35:23 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae4234a-272e-4138-9303-c3e820fba6d9]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bea6c7-cb5f-48d7-979d-6e84c7166aae]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQrzJMby {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQrzJMby" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f490002f-9b6f-4a70-9b15-f72d8f7ab496]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eQrzJMby'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f505073-fe94-4056-8cd4-9bdafba83ec8]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f388b5-6418-4dd2-8f08-bae4ba659354]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:35:23 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:35:23 user nova-compute[72849]:  {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:35:23 user nova-compute[72849]: WARNING os_brick.initiator.connectors.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 16:35:23 user nova-compute[72849]: 
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8edab7-3bbf-4820-b4ab-ad1de71dadec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf, portal: 172.16.0.220,3260]
Aug 15 16:35:23 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf, portal: 172.16.0.220,3260] successful.
Aug 15 16:35:23 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70df81d-7206-4b66-b825-57047bb5f234]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd680398-a49d-4a5d-8060-1e7674710b59]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf (non-flash)
Aug 15 16:35:23 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf (non-flash)
Aug 15 16:35:23 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b392fd2b-f45d-4c65-a3d3-43e47edd0867]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:23 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: None {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:35:24 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:35:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQrzJMby', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:35:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:35:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26433333634316166', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:35:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433333634316166', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:35:24 user nova-compute[72849]: DEBUG nova.objects.instance [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'flavor' on Instance uuid c313dd0f-12a8-46e1-8443-31a3abfac0ab {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:35:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:35:24 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:35:24 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:35:24 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:35:24 user nova-compute[72849]:   <serial>72c39c2c-38f3-4040-8adb-3ac49d0c89cf</serial>
Aug 15 16:35:24 user nova-compute[72849]: </disk>
Aug 15 16:35:24 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:35:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:35:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:35:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] No VIF found with MAC fa:16:3e:e6:27:9b, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:35:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-27b2ca88-5442-4cde-becb-c8d49e8aee7b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.615s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:25 user nova-compute[72849]: INFO nova.compute.manager [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Detaching volume 72c39c2c-38f3-4040-8adb-3ac49d0c89cf
Aug 15 16:35:25 user nova-compute[72849]: INFO nova.virt.block_device [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Attempting to driver detach volume 72c39c2c-38f3-4040-8adb-3ac49d0c89cf from mountpoint /dev/vdb
Aug 15 16:35:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Attempting to detach device vdb from instance c313dd0f-12a8-46e1-8443-31a3abfac0ab from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:35:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:35:25 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:35:25 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:35:25 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:35:25 user nova-compute[72849]:   <serial>72c39c2c-38f3-4040-8adb-3ac49d0c89cf</serial>
Aug 15 16:35:25 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:35:25 user nova-compute[72849]: </disk>
Aug 15 16:35:25 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:35:25 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Successfully detached device vdb from instance c313dd0f-12a8-46e1-8443-31a3abfac0ab from the persistent domain config.
Aug 15 16:35:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c313dd0f-12a8-46e1-8443-31a3abfac0ab from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:35:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:35:25 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:35:25 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:35:25 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:35:25 user nova-compute[72849]:   <serial>72c39c2c-38f3-4040-8adb-3ac49d0c89cf</serial>
Aug 15 16:35:25 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:35:25 user nova-compute[72849]: </disk>
Aug 15 16:35:25 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692117326.107769, c313dd0f-12a8-46e1-8443-31a3abfac0ab => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c313dd0f-12a8-46e1-8443-31a3abfac0ab {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:35:26 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Successfully detached device vdb from instance c313dd0f-12a8-46e1-8443-31a3abfac0ab from the live domain config.
Aug 15 16:35:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQrzJMby', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:35:26 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:35:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68999a1-93a7-4d1e-ab7e-a8c015c615c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca88a567-f045-4449-baac-58a6a9d96e5c]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf (non-flash)
Aug 15 16:35:26 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf (non-flash)
Aug 15 16:35:26 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3781b8550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f41006e-ed23-4b47-9deb-cb81b7ce0976]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53c96cc-621e-4052-baa8-6a13b6460bc3]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3921d158-c8f3-4f08-be71-7ecd1d588a50]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07a68a6-c20b-40de-94a2-d7a90327b9cb]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f169cdda-2d36-4ed9-ae62-f60eaee4abaf]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b7ce71-bc75-4014-a6d0-0a87409c930b]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf, portal: 172.16.0.220,3260]
Aug 15 16:35:26 user nova-compute[72849]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf, portal: 172.16.0.220,3260] successful.
Aug 15 16:35:26 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c39c2c-38f3-4040-8adb-3ac49d0c89cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17830cc-d73d-4c6d-9ed8-bafc85068f6a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] <== disconnect_volume: return (257ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:35:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:27 user nova-compute[72849]: DEBUG nova.objects.instance [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'flavor' on Instance uuid c313dd0f-12a8-46e1-8443-31a3abfac0ab {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:35:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e4917699-2980-4a2c-9d8b-770dd2e370e3 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.566s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:31 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117316.4793298, 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:35:31 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] VM Stopped (Lifecycle Event)
Aug 15 16:35:31 user nova-compute[72849]: DEBUG nova.compute.manager [None req-018587d3-8c69-4d9c-b6a6-627413cf27e1 None None] [instance: 84b77d6c-5e6f-4fee-81fd-d58ee58b06ab] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:35:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:33 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:35:34 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:35:34 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:35:34 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:35:35 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:35:35 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:35:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:35:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-46f0aa43-e313-4aff-bacc-aa5290193b00" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:35:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-46f0aa43-e313-4aff-bacc-aa5290193b00" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:35:35 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:35:35 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Updating instance_info_cache with network_info: [{"id": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "address": "fa:16:3e:dc:17:58", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6eba8c-01", "ovs_interfaceid": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:35:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-46f0aa43-e313-4aff-bacc-aa5290193b00" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:35:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:35:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:35:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:35:37 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:35:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:37 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:35:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:41 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:35:41 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:35:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=7685MB free_disk=25.135486602783203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:35:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:35:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 388aa265-fc0a-4928-935e-5e04e65199f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:35:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc521d87-09aa-44ba-a87c-1cd5517b3707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:35:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 46f0aa43-e313-4aff-bacc-aa5290193b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:35:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b15c5692-8c0c-4bf0-a79f-b7813e71de9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:35:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance c313dd0f-12a8-46e1-8443-31a3abfac0ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:35:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 4b9f21bc-836f-4095-9eb3-d3971d418363 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:35:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f0007ddd-f25d-4708-b617-d98728f6ffcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:35:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:35:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:35:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:41 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:35:41 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:35:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:35:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "388aa265-fc0a-4928-935e-5e04e65199f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "388aa265-fc0a-4928-935e-5e04e65199f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:43 user nova-compute[72849]: INFO nova.compute.manager [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Terminating instance
Aug 15 16:35:43 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-cc2f0fdf-a19d-46b6-b413-643d6ce9a375 req-9590d3b2-50a9-4a27-b7fc-412bed437ad0 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received event network-vif-unplugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-cc2f0fdf-a19d-46b6-b413-643d6ce9a375 req-9590d3b2-50a9-4a27-b7fc-412bed437ad0 service nova] Acquiring lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-cc2f0fdf-a19d-46b6-b413-643d6ce9a375 req-9590d3b2-50a9-4a27-b7fc-412bed437ad0 service nova] Lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-cc2f0fdf-a19d-46b6-b413-643d6ce9a375 req-9590d3b2-50a9-4a27-b7fc-412bed437ad0 service nova] Lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-cc2f0fdf-a19d-46b6-b413-643d6ce9a375 req-9590d3b2-50a9-4a27-b7fc-412bed437ad0 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] No waiting events found dispatching network-vif-unplugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-cc2f0fdf-a19d-46b6-b413-643d6ce9a375 req-9590d3b2-50a9-4a27-b7fc-412bed437ad0 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received event network-vif-unplugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:43 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Instance destroyed successfully.
Aug 15 16:35:43 user nova-compute[72849]: DEBUG nova.objects.instance [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lazy-loading 'resources' on Instance uuid 388aa265-fc0a-4928-935e-5e04e65199f6 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2125106153',display_name='tempest-ServerActionsTestOtherA-server-2125106153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2125106153',id=2,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFz77lNADA9bIEqsG+/0pmqytVknVJgn2QYVHLyikCb7OZcHj5oDk3lRMMWld0kQEG++u8j1QCo1UgVUz17EVZQY5cNigvtxWp2mZweLxgKV8OVoFjr81Ihq1bC8gLICA==',key_name='tempest-keypair-669870558',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:16:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33a3a3412c95451db4dd0edc27f361cc',ramdisk_id='',reservation_id='r-hnpg3jas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-514064593',owner_user_name='tempest-ServerActionsTestOtherA-514064593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60cbe30799ad4438b84251a254691b70',uuid=388aa265-fc0a-4928-935e-5e04e65199f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "address": "fa:16:3e:15:be:6e", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d74bc-a2", "ovs_interfaceid": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converting VIF {"id": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "address": "fa:16:3e:15:be:6e", "network": {"id": "759c7744-fb27-4d05-9b56-c820951b9f88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1826635397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33a3a3412c95451db4dd0edc27f361cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0d74bc-a2", "ovs_interfaceid": "1b0d74bc-a28a-4a88-80b2-377fc19f2c30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:be:6e,bridge_name='br-int',has_traffic_filtering=True,id=1b0d74bc-a28a-4a88-80b2-377fc19f2c30,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0d74bc-a2') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG os_vif [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:be:6e,bridge_name='br-int',has_traffic_filtering=True,id=1b0d74bc-a28a-4a88-80b2-377fc19f2c30,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0d74bc-a2') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b0d74bc-a2, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:35:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:35:44 user nova-compute[72849]: INFO os_vif [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:be:6e,bridge_name='br-int',has_traffic_filtering=True,id=1b0d74bc-a28a-4a88-80b2-377fc19f2c30,network=Network(759c7744-fb27-4d05-9b56-c820951b9f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0d74bc-a2')
Aug 15 16:35:44 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Deleting instance files /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6_del
Aug 15 16:35:44 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Deletion of /opt/stack/data/nova/instances/388aa265-fc0a-4928-935e-5e04e65199f6_del complete
Aug 15 16:35:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:44 user nova-compute[72849]: INFO nova.compute.manager [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 15 16:35:44 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:35:44 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:35:44 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:35:44 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:35:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:44 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:35:44 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Took 0.68 seconds to deallocate network for instance.
Aug 15 16:35:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-ccb683c2-a2e5-48d4-91ee-36332e940d60 req-3d814fc3-15d5-429f-ad05-1843c9896863 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received event network-vif-deleted-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:45 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Deleted allocations for instance 388aa265-fc0a-4928-935e-5e04e65199f6
Aug 15 16:35:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4e675f8c-1a96-47b5-b50c-36b51644e4d3 tempest-ServerActionsTestOtherA-514064593 tempest-ServerActionsTestOtherA-514064593-project-member] Lock "388aa265-fc0a-4928-935e-5e04e65199f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.071s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received event network-vif-plugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] Acquiring lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] Lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] Lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] No waiting events found dispatching network-vif-plugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:35:45 user nova-compute[72849]: WARNING nova.compute.manager [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received unexpected event network-vif-plugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 for instance with vm_state deleted and task_state None.
Aug 15 16:35:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received event network-vif-plugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] Acquiring lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] Lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] Lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] No waiting events found dispatching network-vif-plugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:35:45 user nova-compute[72849]: WARNING nova.compute.manager [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received unexpected event network-vif-plugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 for instance with vm_state deleted and task_state None.
Aug 15 16:35:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received event network-vif-plugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] Acquiring lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] Lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] Lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] No waiting events found dispatching network-vif-plugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:35:45 user nova-compute[72849]: WARNING nova.compute.manager [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received unexpected event network-vif-plugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 for instance with vm_state deleted and task_state None.
Aug 15 16:35:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received event network-vif-unplugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] Acquiring lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] Lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] Lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] No waiting events found dispatching network-vif-unplugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:35:45 user nova-compute[72849]: WARNING nova.compute.manager [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received unexpected event network-vif-unplugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 for instance with vm_state deleted and task_state None.
Aug 15 16:35:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received event network-vif-plugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] Acquiring lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] Lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] Lock "388aa265-fc0a-4928-935e-5e04e65199f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] No waiting events found dispatching network-vif-plugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:35:45 user nova-compute[72849]: WARNING nova.compute.manager [req-eca7de27-65e6-49fc-9c7d-d2d54a73868a req-f03f757a-6df8-4901-b21b-c5aca7ef3839 service nova] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Received unexpected event network-vif-plugged-1b0d74bc-a28a-4a88-80b2-377fc19f2c30 for instance with vm_state deleted and task_state None.
Aug 15 16:35:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:35:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:49 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:35:49 user nova-compute[72849]: INFO nova.compute.claims [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Claim successful on node user
Aug 15 16:35:49 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:35:49 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:35:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:35:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:35:49 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:35:49 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:35:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:35:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:35:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:35:49 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Creating image(s)
Aug 15 16:35:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "/opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "/opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.174s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG nova.policy [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abdcfedce2124d86a0df67571fdfcde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607d6d3506de49549888f16d06829c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/disk 1073741824" returned: 0 in 0.050s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Cannot resize image /opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG nova.objects.instance [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'migration_context' on Instance uuid f2f0b640-e9ae-43ba-a175-a9ab87d30c8b {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Ensure instance console log exists: /opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:51 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Successfully created port: 6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:35:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:51 user nova-compute[72849]: INFO nova.compute.manager [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Terminating instance
Aug 15 16:35:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:35:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:51 user nova-compute[72849]: DEBUG nova.compute.manager [req-cf9a1d2a-45a1-46b5-815e-b89b57a703c1 req-77f04ed2-fc11-4f14-b7fd-187fb05b2104 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received event network-vif-unplugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-cf9a1d2a-45a1-46b5-815e-b89b57a703c1 req-77f04ed2-fc11-4f14-b7fd-187fb05b2104 service nova] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-cf9a1d2a-45a1-46b5-815e-b89b57a703c1 req-77f04ed2-fc11-4f14-b7fd-187fb05b2104 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-cf9a1d2a-45a1-46b5-815e-b89b57a703c1 req-77f04ed2-fc11-4f14-b7fd-187fb05b2104 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:51 user nova-compute[72849]: DEBUG nova.compute.manager [req-cf9a1d2a-45a1-46b5-815e-b89b57a703c1 req-77f04ed2-fc11-4f14-b7fd-187fb05b2104 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] No waiting events found dispatching network-vif-unplugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:35:51 user nova-compute[72849]: DEBUG nova.compute.manager [req-cf9a1d2a-45a1-46b5-815e-b89b57a703c1 req-77f04ed2-fc11-4f14-b7fd-187fb05b2104 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received event network-vif-unplugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:35:52 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Instance destroyed successfully.
Aug 15 16:35:52 user nova-compute[72849]: DEBUG nova.objects.instance [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'resources' on Instance uuid b15c5692-8c0c-4bf0-a79f-b7813e71de9a {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:35:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1766183368',display_name='tempest-ServerRescueNegativeTestJSON-server-1766183368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1766183368',id=33,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZDWB8vYJ27BLEDjq1jEjY2KBJTj8cjBkEkfTH18cdJZ7J3D5uI+izIwW8NIAiqaP6OwefzK28im3ocei5k8arru3mLNz50MNQwsuj3glrLSKYBFwn1qRB4crV/gOKF0w==',key_name='tempest-keypair-357165589',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:31:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63fff6abd55f4552b56b7f80f3b19990',ramdisk_id='',reservation_id='r-7uw01kyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-817230683',owner_user_name='tempest-ServerRescueNegativeTestJSON-817230683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6bc0fd1358a42debf05e9bc43b8e329',uuid=b15c5692-8c0c-4bf0-a79f-b7813e71de9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "address": "fa:16:3e:8a:41:62", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183f8f-93", "ovs_interfaceid": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:35:52 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converting VIF {"id": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "address": "fa:16:3e:8a:41:62", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183f8f-93", "ovs_interfaceid": "b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:35:52 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:41:62,bridge_name='br-int',has_traffic_filtering=True,id=b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0183f8f-93') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:35:52 user nova-compute[72849]: DEBUG os_vif [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:41:62,bridge_name='br-int',has_traffic_filtering=True,id=b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0183f8f-93') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:35:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0183f8f-93, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:35:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:35:52 user nova-compute[72849]: INFO os_vif [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:41:62,bridge_name='br-int',has_traffic_filtering=True,id=b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0183f8f-93')
Aug 15 16:35:52 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Deleting instance files /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a_del
Aug 15 16:35:52 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Deletion of /opt/stack/data/nova/instances/b15c5692-8c0c-4bf0-a79f-b7813e71de9a_del complete
Aug 15 16:35:52 user nova-compute[72849]: INFO nova.compute.manager [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 16:35:52 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:35:52 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:35:52 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:35:52 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Successfully updated port: 6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:35:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "refresh_cache-f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:35:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquired lock "refresh_cache-f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:35:52 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:35:52 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.network.neutron [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Updating instance_info_cache with network_info: [{"id": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "address": "fa:16:3e:47:9f:55", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f0cc2-52", "ovs_interfaceid": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Releasing lock "refresh_cache-f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Instance network_info: |[{"id": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "address": "fa:16:3e:47:9f:55", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f0cc2-52", "ovs_interfaceid": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Start _get_guest_xml network_info=[{"id": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "address": "fa:16:3e:47:9f:55", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f0cc2-52", "ovs_interfaceid": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:35:53 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:35:53 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:35:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1758508923',display_name='tempest-AttachVolumeTestJSON-server-1758508923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1758508923',id=38,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvsW4NBeZj8MwEhQQg18STpkR+st2miL/ypJoJIHKlGEleqeVzXx8Q86JNVDbUaH8iUlFlTezNlxjRhswf3N5T/wZ6ZmiSsi6TdRH9qLyb67jizoRR68RBBQ5AlP6UjiA==',key_name='tempest-keypair-774079099',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='607d6d3506de49549888f16d06829c89',ramdisk_id='',reservation_id='r-7k4nhc39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1114163063',owner_user_name='tempest-AttachVolumeTestJSON-1114163063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abdcfedce2124d86a0df67571fdfcde9',uuid=f2f0b640-e9ae-43ba-a175-a9ab87d30c8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "address": "fa:16:3e:47:9f:55", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f0cc2-52", "ovs_interfaceid": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converting VIF {"id": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "address": "fa:16:3e:47:9f:55", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f0cc2-52", "ovs_interfaceid": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4f0cc2-52') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.objects.instance [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'pci_devices' on Instance uuid f2f0b640-e9ae-43ba-a175-a9ab87d30c8b {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:35:53 user nova-compute[72849]:   <uuid>f2f0b640-e9ae-43ba-a175-a9ab87d30c8b</uuid>
Aug 15 16:35:53 user nova-compute[72849]:   <name>instance-00000026</name>
Aug 15 16:35:53 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:35:53 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:35:53 user nova-compute[72849]:   <metadata>
Aug 15 16:35:53 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:35:53 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:35:53 user nova-compute[72849]:       <nova:name>tempest-AttachVolumeTestJSON-server-1758508923</nova:name>
Aug 15 16:35:53 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:35:53</nova:creationTime>
Aug 15 16:35:53 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:35:53 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:35:53 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:35:53 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:35:53 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:35:53 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:35:53 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:35:53 user nova-compute[72849]:       <nova:owner>
Aug 15 16:35:53 user nova-compute[72849]:         <nova:user uuid="abdcfedce2124d86a0df67571fdfcde9">tempest-AttachVolumeTestJSON-1114163063-project-member</nova:user>
Aug 15 16:35:53 user nova-compute[72849]:         <nova:project uuid="607d6d3506de49549888f16d06829c89">tempest-AttachVolumeTestJSON-1114163063</nova:project>
Aug 15 16:35:53 user nova-compute[72849]:       </nova:owner>
Aug 15 16:35:53 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:35:53 user nova-compute[72849]:       <nova:ports>
Aug 15 16:35:53 user nova-compute[72849]:         <nova:port uuid="6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f">
Aug 15 16:35:53 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 16:35:53 user nova-compute[72849]:         </nova:port>
Aug 15 16:35:53 user nova-compute[72849]:       </nova:ports>
Aug 15 16:35:53 user nova-compute[72849]:     </nova:instance>
Aug 15 16:35:53 user nova-compute[72849]:   </metadata>
Aug 15 16:35:53 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:35:53 user nova-compute[72849]:     <system>
Aug 15 16:35:53 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:35:53 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:35:53 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:35:53 user nova-compute[72849]:       <entry name="serial">f2f0b640-e9ae-43ba-a175-a9ab87d30c8b</entry>
Aug 15 16:35:53 user nova-compute[72849]:       <entry name="uuid">f2f0b640-e9ae-43ba-a175-a9ab87d30c8b</entry>
Aug 15 16:35:53 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:35:53 user nova-compute[72849]:     </system>
Aug 15 16:35:53 user nova-compute[72849]:   </sysinfo>
Aug 15 16:35:53 user nova-compute[72849]:   <os>
Aug 15 16:35:53 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:35:53 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:35:53 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:35:53 user nova-compute[72849]:   </os>
Aug 15 16:35:53 user nova-compute[72849]:   <features>
Aug 15 16:35:53 user nova-compute[72849]:     <acpi/>
Aug 15 16:35:53 user nova-compute[72849]:     <apic/>
Aug 15 16:35:53 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:35:53 user nova-compute[72849]:   </features>
Aug 15 16:35:53 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:35:53 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:35:53 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:35:53 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:35:53 user nova-compute[72849]:   </clock>
Aug 15 16:35:53 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:35:53 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:35:53 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:35:53 user nova-compute[72849]:   </cpu>
Aug 15 16:35:53 user nova-compute[72849]:   <devices>
Aug 15 16:35:53 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:35:53 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:35:53 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/disk"/>
Aug 15 16:35:53 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:35:53 user nova-compute[72849]:     </disk>
Aug 15 16:35:53 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:35:53 user nova-compute[72849]:       <mac address="fa:16:3e:47:9f:55"/>
Aug 15 16:35:53 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:35:53 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:35:53 user nova-compute[72849]:       <target dev="tap6a4f0cc2-52"/>
Aug 15 16:35:53 user nova-compute[72849]:     </interface>
Aug 15 16:35:53 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:35:53 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/console.log" append="off"/>
Aug 15 16:35:53 user nova-compute[72849]:     </serial>
Aug 15 16:35:53 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:35:53 user nova-compute[72849]:     <video>
Aug 15 16:35:53 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:35:53 user nova-compute[72849]:     </video>
Aug 15 16:35:53 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:35:53 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:35:53 user nova-compute[72849]:     </rng>
Aug 15 16:35:53 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:35:53 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:35:53 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:35:53 user nova-compute[72849]:     </memballoon>
Aug 15 16:35:53 user nova-compute[72849]:   </devices>
Aug 15 16:35:53 user nova-compute[72849]: </domain>
Aug 15 16:35:53 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:35:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1758508923',display_name='tempest-AttachVolumeTestJSON-server-1758508923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1758508923',id=38,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvsW4NBeZj8MwEhQQg18STpkR+st2miL/ypJoJIHKlGEleqeVzXx8Q86JNVDbUaH8iUlFlTezNlxjRhswf3N5T/wZ6ZmiSsi6TdRH9qLyb67jizoRR68RBBQ5AlP6UjiA==',key_name='tempest-keypair-774079099',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='607d6d3506de49549888f16d06829c89',ramdisk_id='',reservation_id='r-7k4nhc39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1114163063',owner_user_name='tempest-AttachVolumeTestJSON-1114163063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abdcfedce2124d86a0df67571fdfcde9',uuid=f2f0b640-e9ae-43ba-a175-a9ab87d30c8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "address": "fa:16:3e:47:9f:55", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f0cc2-52", "ovs_interfaceid": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converting VIF {"id": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "address": "fa:16:3e:47:9f:55", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f0cc2-52", "ovs_interfaceid": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4f0cc2-52') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG os_vif [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4f0cc2-52') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a4f0cc2-52, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a4f0cc2-52, col_values=(('external_ids', {'iface-id': '6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:9f:55', 'vm-uuid': 'f2f0b640-e9ae-43ba-a175-a9ab87d30c8b'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:53 user nova-compute[72849]: INFO os_vif [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4f0cc2-52')
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] No VIF found with MAC fa:16:3e:47:9f:55, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:35:53 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Took 1.19 seconds to deallocate network for instance.
Aug 15 16:35:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:53 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Deleted allocations for instance b15c5692-8c0c-4bf0-a79f-b7813e71de9a
Aug 15 16:35:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-99a2d4b8-1717-4cc8-8358-48ab88e3be1d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.491s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-1768c93a-fe70-454d-b34d-eeca64f40ca4 req-5c2d7d8d-7d75-480d-982f-71334f4a6819 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received event network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1768c93a-fe70-454d-b34d-eeca64f40ca4 req-5c2d7d8d-7d75-480d-982f-71334f4a6819 service nova] Acquiring lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1768c93a-fe70-454d-b34d-eeca64f40ca4 req-5c2d7d8d-7d75-480d-982f-71334f4a6819 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1768c93a-fe70-454d-b34d-eeca64f40ca4 req-5c2d7d8d-7d75-480d-982f-71334f4a6819 service nova] Lock "b15c5692-8c0c-4bf0-a79f-b7813e71de9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-1768c93a-fe70-454d-b34d-eeca64f40ca4 req-5c2d7d8d-7d75-480d-982f-71334f4a6819 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] No waiting events found dispatching network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:35:53 user nova-compute[72849]: WARNING nova.compute.manager [req-1768c93a-fe70-454d-b34d-eeca64f40ca4 req-5c2d7d8d-7d75-480d-982f-71334f4a6819 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received unexpected event network-vif-plugged-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 for instance with vm_state deleted and task_state None.
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-1768c93a-fe70-454d-b34d-eeca64f40ca4 req-5c2d7d8d-7d75-480d-982f-71334f4a6819 service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Received event network-changed-6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-1768c93a-fe70-454d-b34d-eeca64f40ca4 req-5c2d7d8d-7d75-480d-982f-71334f4a6819 service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Refreshing instance network info cache due to event network-changed-6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1768c93a-fe70-454d-b34d-eeca64f40ca4 req-5c2d7d8d-7d75-480d-982f-71334f4a6819 service nova] Acquiring lock "refresh_cache-f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1768c93a-fe70-454d-b34d-eeca64f40ca4 req-5c2d7d8d-7d75-480d-982f-71334f4a6819 service nova] Acquired lock "refresh_cache-f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:35:53 user nova-compute[72849]: DEBUG nova.network.neutron [req-1768c93a-fe70-454d-b34d-eeca64f40ca4 req-5c2d7d8d-7d75-480d-982f-71334f4a6819 service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Refreshing network info cache for port 6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:35:54 user nova-compute[72849]: DEBUG nova.network.neutron [req-1768c93a-fe70-454d-b34d-eeca64f40ca4 req-5c2d7d8d-7d75-480d-982f-71334f4a6819 service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Updated VIF entry in instance network info cache for port 6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:35:54 user nova-compute[72849]: DEBUG nova.network.neutron [req-1768c93a-fe70-454d-b34d-eeca64f40ca4 req-5c2d7d8d-7d75-480d-982f-71334f4a6819 service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Updating instance_info_cache with network_info: [{"id": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "address": "fa:16:3e:47:9f:55", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f0cc2-52", "ovs_interfaceid": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:35:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1768c93a-fe70-454d-b34d-eeca64f40ca4 req-5c2d7d8d-7d75-480d-982f-71334f4a6819 service nova] Releasing lock "refresh_cache-f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:35:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-1768c93a-fe70-454d-b34d-eeca64f40ca4 req-5c2d7d8d-7d75-480d-982f-71334f4a6819 service nova] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Received event network-vif-deleted-b0183f8f-9341-4c1e-b8d8-dd9961dfd3a9 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-27976664-ef6d-49d2-a401-6dbfd5eadb4f req-c76e51b5-7400-4868-947d-53643e8b8836 service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Received event network-vif-plugged-6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-27976664-ef6d-49d2-a401-6dbfd5eadb4f req-c76e51b5-7400-4868-947d-53643e8b8836 service nova] Acquiring lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-27976664-ef6d-49d2-a401-6dbfd5eadb4f req-c76e51b5-7400-4868-947d-53643e8b8836 service nova] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-27976664-ef6d-49d2-a401-6dbfd5eadb4f req-c76e51b5-7400-4868-947d-53643e8b8836 service nova] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-27976664-ef6d-49d2-a401-6dbfd5eadb4f req-c76e51b5-7400-4868-947d-53643e8b8836 service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] No waiting events found dispatching network-vif-plugged-6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:35:54 user nova-compute[72849]: WARNING nova.compute.manager [req-27976664-ef6d-49d2-a401-6dbfd5eadb4f req-c76e51b5-7400-4868-947d-53643e8b8836 service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Received unexpected event network-vif-plugged-6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f for instance with vm_state building and task_state spawning.
Aug 15 16:35:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:56 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117356.7400744, f2f0b640-e9ae-43ba-a175-a9ab87d30c8b => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:35:56 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] VM Resumed (Lifecycle Event)
Aug 15 16:35:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:35:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:35:56 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Instance spawned successfully.
Aug 15 16:35:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:35:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:35:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:35:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:35:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:35:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:35:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:35:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:35:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:35:56 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:35:56 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117356.7430844, f2f0b640-e9ae-43ba-a175-a9ab87d30c8b => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:35:56 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] VM Started (Lifecycle Event)
Aug 15 16:35:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:35:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:35:56 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:35:56 user nova-compute[72849]: INFO nova.compute.manager [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Took 6.92 seconds to spawn the instance on the hypervisor.
Aug 15 16:35:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:35:56 user nova-compute[72849]: INFO nova.compute.manager [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Took 7.66 seconds to build instance.
Aug 15 16:35:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c5c9fd55-de8e-4f47-8e23-c32583e06184 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.758s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:56 user nova-compute[72849]: DEBUG nova.compute.manager [req-64dd4601-b992-4ca7-958a-eb45981b5085 req-f1b9d49f-763b-48e7-a070-67459c3c6ea4 service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Received event network-vif-plugged-6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:35:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-64dd4601-b992-4ca7-958a-eb45981b5085 req-f1b9d49f-763b-48e7-a070-67459c3c6ea4 service nova] Acquiring lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:35:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-64dd4601-b992-4ca7-958a-eb45981b5085 req-f1b9d49f-763b-48e7-a070-67459c3c6ea4 service nova] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:35:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-64dd4601-b992-4ca7-958a-eb45981b5085 req-f1b9d49f-763b-48e7-a070-67459c3c6ea4 service nova] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:35:56 user nova-compute[72849]: DEBUG nova.compute.manager [req-64dd4601-b992-4ca7-958a-eb45981b5085 req-f1b9d49f-763b-48e7-a070-67459c3c6ea4 service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] No waiting events found dispatching network-vif-plugged-6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:35:56 user nova-compute[72849]: WARNING nova.compute.manager [req-64dd4601-b992-4ca7-958a-eb45981b5085 req-f1b9d49f-763b-48e7-a070-67459c3c6ea4 service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Received unexpected event network-vif-plugged-6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f for instance with vm_state active and task_state None.
Aug 15 16:35:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:35:58 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117343.9685721, 388aa265-fc0a-4928-935e-5e04e65199f6 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:35:58 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] VM Stopped (Lifecycle Event)
Aug 15 16:35:58 user nova-compute[72849]: DEBUG nova.compute.manager [None req-e0762e4e-7705-4adf-b6f0-702cd3ca1e0d None None] [instance: 388aa265-fc0a-4928-935e-5e04e65199f6] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:35:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:04 user nova-compute[72849]: DEBUG nova.compute.manager [req-fc59296a-808a-4a0e-835e-b297e41576c3 req-6e89f9e8-26c6-49d4-a6ed-bac8ce585653 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received event network-changed-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:36:04 user nova-compute[72849]: DEBUG nova.compute.manager [req-fc59296a-808a-4a0e-835e-b297e41576c3 req-6e89f9e8-26c6-49d4-a6ed-bac8ce585653 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Refreshing instance network info cache due to event network-changed-cb180f95-0817-4f21-807c-4a96a65e4062. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:36:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fc59296a-808a-4a0e-835e-b297e41576c3 req-6e89f9e8-26c6-49d4-a6ed-bac8ce585653 service nova] Acquiring lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:36:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fc59296a-808a-4a0e-835e-b297e41576c3 req-6e89f9e8-26c6-49d4-a6ed-bac8ce585653 service nova] Acquired lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:36:04 user nova-compute[72849]: DEBUG nova.network.neutron [req-fc59296a-808a-4a0e-835e-b297e41576c3 req-6e89f9e8-26c6-49d4-a6ed-bac8ce585653 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Refreshing network info cache for port cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:36:04 user nova-compute[72849]: DEBUG nova.network.neutron [req-fc59296a-808a-4a0e-835e-b297e41576c3 req-6e89f9e8-26c6-49d4-a6ed-bac8ce585653 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Updated VIF entry in instance network info cache for port cb180f95-0817-4f21-807c-4a96a65e4062. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:36:04 user nova-compute[72849]: DEBUG nova.network.neutron [req-fc59296a-808a-4a0e-835e-b297e41576c3 req-6e89f9e8-26c6-49d4-a6ed-bac8ce585653 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Updating instance_info_cache with network_info: [{"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:36:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fc59296a-808a-4a0e-835e-b297e41576c3 req-6e89f9e8-26c6-49d4-a6ed-bac8ce585653 service nova] Releasing lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:36:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:06 user nova-compute[72849]: INFO nova.compute.manager [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Terminating instance
Aug 15 16:36:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:36:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:06 user nova-compute[72849]: DEBUG nova.compute.manager [req-9a140f90-39da-47d1-9466-e71304e40db9 req-44084899-8413-42db-a141-0e0267f41be3 service nova] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Received event network-vif-unplugged-88628ea8-908b-47c2-bdfd-6e8525d88c0b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:36:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9a140f90-39da-47d1-9466-e71304e40db9 req-44084899-8413-42db-a141-0e0267f41be3 service nova] Acquiring lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9a140f90-39da-47d1-9466-e71304e40db9 req-44084899-8413-42db-a141-0e0267f41be3 service nova] Lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9a140f90-39da-47d1-9466-e71304e40db9 req-44084899-8413-42db-a141-0e0267f41be3 service nova] Lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:06 user nova-compute[72849]: DEBUG nova.compute.manager [req-9a140f90-39da-47d1-9466-e71304e40db9 req-44084899-8413-42db-a141-0e0267f41be3 service nova] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] No waiting events found dispatching network-vif-unplugged-88628ea8-908b-47c2-bdfd-6e8525d88c0b {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:36:06 user nova-compute[72849]: DEBUG nova.compute.manager [req-9a140f90-39da-47d1-9466-e71304e40db9 req-44084899-8413-42db-a141-0e0267f41be3 service nova] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Received event network-vif-unplugged-88628ea8-908b-47c2-bdfd-6e8525d88c0b for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:36:07 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117352.066834, b15c5692-8c0c-4bf0-a79f-b7813e71de9a => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:36:07 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] VM Stopped (Lifecycle Event)
Aug 15 16:36:07 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Instance destroyed successfully.
Aug 15 16:36:07 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lazy-loading 'resources' on Instance uuid 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:36:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:16:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-256210150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-256210150',id=1,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:16:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f51f800c0ca74e149a2f8ed9718b221f',ramdisk_id='',reservation_id='r-2nxyf40q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:18:23Z,user_data=None,user_id='cd6279423b7f43c4aac7956aec43efdd',uuid=56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "address": "fa:16:3e:18:f5:fe", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88628ea8-90", "ovs_interfaceid": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:36:07 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converting VIF {"id": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "address": "fa:16:3e:18:f5:fe", "network": {"id": "c4efa438-ef7b-4b1f-8748-def9604a0673", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751247564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51f800c0ca74e149a2f8ed9718b221f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88628ea8-90", "ovs_interfaceid": "88628ea8-908b-47c2-bdfd-6e8525d88c0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:36:07 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:f5:fe,bridge_name='br-int',has_traffic_filtering=True,id=88628ea8-908b-47c2-bdfd-6e8525d88c0b,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88628ea8-90') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:36:07 user nova-compute[72849]: DEBUG os_vif [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:f5:fe,bridge_name='br-int',has_traffic_filtering=True,id=88628ea8-908b-47c2-bdfd-6e8525d88c0b,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88628ea8-90') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:36:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88628ea8-90, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:36:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:36:07 user nova-compute[72849]: INFO os_vif [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:f5:fe,bridge_name='br-int',has_traffic_filtering=True,id=88628ea8-908b-47c2-bdfd-6e8525d88c0b,network=Network(c4efa438-ef7b-4b1f-8748-def9604a0673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88628ea8-90')
Aug 15 16:36:07 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Deleting instance files /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d_del
Aug 15 16:36:07 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Deletion of /opt/stack/data/nova/instances/56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d_del complete
Aug 15 16:36:07 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f6d0d5b8-3621-4a71-9d1a-6293e30f00e5 None None] [instance: b15c5692-8c0c-4bf0-a79f-b7813e71de9a] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:36:07 user nova-compute[72849]: INFO nova.compute.manager [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 15 16:36:07 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:36:07 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:36:07 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:36:07 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:36:07 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Took 0.72 seconds to deallocate network for instance.
Aug 15 16:36:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:08 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:36:08 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:36:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:08 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Deleted allocations for instance 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d
Aug 15 16:36:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ebb978a8-d9be-43ac-8e83-1b996ab8e5b4 tempest-ServerBootFromVolumeStableRescueTest-1207284584 tempest-ServerBootFromVolumeStableRescueTest-1207284584-project-member] Lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.884s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-fda2e45a-7a14-4065-a4c6-089d651d1fbb req-4110c5fc-e7f3-4321-9171-3aa01ac039c0 service nova] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Received event network-vif-plugged-88628ea8-908b-47c2-bdfd-6e8525d88c0b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:36:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fda2e45a-7a14-4065-a4c6-089d651d1fbb req-4110c5fc-e7f3-4321-9171-3aa01ac039c0 service nova] Acquiring lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fda2e45a-7a14-4065-a4c6-089d651d1fbb req-4110c5fc-e7f3-4321-9171-3aa01ac039c0 service nova] Lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fda2e45a-7a14-4065-a4c6-089d651d1fbb req-4110c5fc-e7f3-4321-9171-3aa01ac039c0 service nova] Lock "56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-fda2e45a-7a14-4065-a4c6-089d651d1fbb req-4110c5fc-e7f3-4321-9171-3aa01ac039c0 service nova] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] No waiting events found dispatching network-vif-plugged-88628ea8-908b-47c2-bdfd-6e8525d88c0b {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:36:08 user nova-compute[72849]: WARNING nova.compute.manager [req-fda2e45a-7a14-4065-a4c6-089d651d1fbb req-4110c5fc-e7f3-4321-9171-3aa01ac039c0 service nova] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Received unexpected event network-vif-plugged-88628ea8-908b-47c2-bdfd-6e8525d88c0b for instance with vm_state deleted and task_state None.
Aug 15 16:36:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-fda2e45a-7a14-4065-a4c6-089d651d1fbb req-4110c5fc-e7f3-4321-9171-3aa01ac039c0 service nova] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Received event network-vif-deleted-88628ea8-908b-47c2-bdfd-6e8525d88c0b {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:36:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "4b9f21bc-836f-4095-9eb3-d3971d418363" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:09 user nova-compute[72849]: INFO nova.compute.manager [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Shelving
Aug 15 16:36:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-d4913a76-2cc3-45c0-be2c-7f05ef726d4e req-d0d59738-e573-4aa1-9be2-26045a1ff2ba service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received event network-vif-unplugged-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:36:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d4913a76-2cc3-45c0-be2c-7f05ef726d4e req-d0d59738-e573-4aa1-9be2-26045a1ff2ba service nova] Acquiring lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d4913a76-2cc3-45c0-be2c-7f05ef726d4e req-d0d59738-e573-4aa1-9be2-26045a1ff2ba service nova] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d4913a76-2cc3-45c0-be2c-7f05ef726d4e req-d0d59738-e573-4aa1-9be2-26045a1ff2ba service nova] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-d4913a76-2cc3-45c0-be2c-7f05ef726d4e req-d0d59738-e573-4aa1-9be2-26045a1ff2ba service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] No waiting events found dispatching network-vif-unplugged-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:36:09 user nova-compute[72849]: WARNING nova.compute.manager [req-d4913a76-2cc3-45c0-be2c-7f05ef726d4e req-d0d59738-e573-4aa1-9be2-26045a1ff2ba service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received unexpected event network-vif-unplugged-cb180f95-0817-4f21-807c-4a96a65e4062 for instance with vm_state active and task_state shelving.
Aug 15 16:36:09 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Instance destroyed successfully.
Aug 15 16:36:09 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Beginning cold snapshot process
Aug 15 16:36:10 user nova-compute[72849]: DEBUG nova.privsep.utils [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72849) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 16:36:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk /opt/stack/data/nova/instances/snapshots/tmp9aip_w4n/580af01ae3b242369979ae5726fe0698 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk /opt/stack/data/nova/instances/snapshots/tmp9aip_w4n/580af01ae3b242369979ae5726fe0698" returned: 0 in 0.429s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:10 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Snapshot extracted, beginning image upload
Aug 15 16:36:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-4e197237-4085-46eb-bc2b-9e88be1b6fbd req-5b98824b-4220-4148-94b4-f31a17afe2fd service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received event network-vif-plugged-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:36:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4e197237-4085-46eb-bc2b-9e88be1b6fbd req-5b98824b-4220-4148-94b4-f31a17afe2fd service nova] Acquiring lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4e197237-4085-46eb-bc2b-9e88be1b6fbd req-5b98824b-4220-4148-94b4-f31a17afe2fd service nova] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4e197237-4085-46eb-bc2b-9e88be1b6fbd req-5b98824b-4220-4148-94b4-f31a17afe2fd service nova] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-4e197237-4085-46eb-bc2b-9e88be1b6fbd req-5b98824b-4220-4148-94b4-f31a17afe2fd service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] No waiting events found dispatching network-vif-plugged-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:36:11 user nova-compute[72849]: WARNING nova.compute.manager [req-4e197237-4085-46eb-bc2b-9e88be1b6fbd req-5b98824b-4220-4148-94b4-f31a17afe2fd service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received unexpected event network-vif-plugged-cb180f95-0817-4f21-807c-4a96a65e4062 for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 16:36:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:13 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Snapshot image upload complete
Aug 15 16:36:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:36:13 user nova-compute[72849]: INFO nova.compute.manager [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Shelve offloading
Aug 15 16:36:13 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Instance destroyed successfully.
Aug 15 16:36:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:36:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:36:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquired lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:36:13 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:36:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:14 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Updating instance_info_cache with network_info: [{"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:36:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Releasing lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:36:15 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Instance destroyed successfully.
Aug 15 16:36:15 user nova-compute[72849]: DEBUG nova.objects.instance [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'resources' on Instance uuid 4b9f21bc-836f-4095-9eb3-d3971d418363 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:34:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1489512197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1489512197',id=36,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe+X3TlJY7viy6yCC4qfoaJNUF0aD42WXrGPlRjIPb89wzbqYH9zALZJ5CRJe4p1pdHW/9jzBSM0IPaTRUdlDyBTE1hky/6604FqoKqX9DPrfM+jFneqscMa1UPBBiqoQ==',key_name='tempest-keypair-1622612503',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:34:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1bb636c3c71c479d90cf2e170db941e1',ramdisk_id='',reservation_id='r-ti7scmj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1263463439',owner_user_name='tempest-AttachVolumeShelveTestJSON-1263463439-project-member',shelved_at='2023-08-15T16:36:13.361270',shelved_host='user',shelved_image_id='7681b178-f6df-4e08-8bf7-9bfc816167ed'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:36:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867f247fc90437899a13a7451a3249a',uuid=4b9f21bc-836f-4095-9eb3-d3971d418363,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converting VIF {"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:b5:7a,bridge_name='br-int',has_traffic_filtering=True,id=cb180f95-0817-4f21-807c-4a96a65e4062,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb180f95-08') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG os_vif [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:b5:7a,bridge_name='br-int',has_traffic_filtering=True,id=cb180f95-0817-4f21-807c-4a96a65e4062,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb180f95-08') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb180f95-08, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-f9f06776-cc5f-4695-81aa-e713c8150c0e req-e8fb2add-eb74-459e-8e71-7278b95c96b7 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received event network-changed-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-f9f06776-cc5f-4695-81aa-e713c8150c0e req-e8fb2add-eb74-459e-8e71-7278b95c96b7 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Refreshing instance network info cache due to event network-changed-cb180f95-0817-4f21-807c-4a96a65e4062. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f9f06776-cc5f-4695-81aa-e713c8150c0e req-e8fb2add-eb74-459e-8e71-7278b95c96b7 service nova] Acquiring lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f9f06776-cc5f-4695-81aa-e713c8150c0e req-e8fb2add-eb74-459e-8e71-7278b95c96b7 service nova] Acquired lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG nova.network.neutron [req-f9f06776-cc5f-4695-81aa-e713c8150c0e req-e8fb2add-eb74-459e-8e71-7278b95c96b7 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Refreshing network info cache for port cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:36:15 user nova-compute[72849]: INFO os_vif [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:b5:7a,bridge_name='br-int',has_traffic_filtering=True,id=cb180f95-0817-4f21-807c-4a96a65e4062,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb180f95-08')
Aug 15 16:36:15 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Deleting instance files /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363_del
Aug 15 16:36:15 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Deletion of /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363_del complete
Aug 15 16:36:15 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Deleted allocations for instance 4b9f21bc-836f-4095-9eb3-d3971d418363
Aug 15 16:36:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG nova.objects.instance [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'numa_topology' on Instance uuid 4b9f21bc-836f-4095-9eb3-d3971d418363 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a14e72d5-7cc2-4334-a8d1-b71b34d55087 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.480s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG nova.network.neutron [req-f9f06776-cc5f-4695-81aa-e713c8150c0e req-e8fb2add-eb74-459e-8e71-7278b95c96b7 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Updated VIF entry in instance network info cache for port cb180f95-0817-4f21-807c-4a96a65e4062. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG nova.network.neutron [req-f9f06776-cc5f-4695-81aa-e713c8150c0e req-e8fb2add-eb74-459e-8e71-7278b95c96b7 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Updating instance_info_cache with network_info: [{"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapcb180f95-08", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f9f06776-cc5f-4695-81aa-e713c8150c0e req-e8fb2add-eb74-459e-8e71-7278b95c96b7 service nova] Releasing lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:15 user nova-compute[72849]: INFO nova.compute.manager [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Terminating instance
Aug 15 16:36:15 user nova-compute[72849]: DEBUG nova.compute.manager [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:36:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:16 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Instance destroyed successfully.
Aug 15 16:36:16 user nova-compute[72849]: DEBUG nova.objects.instance [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'resources' on Instance uuid c313dd0f-12a8-46e1-8443-31a3abfac0ab {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:36:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:33:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1279941866',display_name='tempest-AttachVolumeNegativeTest-server-1279941866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1279941866',id=35,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVTLnwCWR14rqb7+1lYuoasp48GYs5PD3svZ9Xp3VeWkj+p04cVCfsZ8wyrVenylv1NmVBRnHiXuOgUDPJwDwnC8iqHdF/jM6NCQ56NZsjBGB8ua/a797HDB4bj9uJ5bQ==',key_name='tempest-keypair-1791302560',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:33:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0ddd223976e4b13a3b6a5638846f83a',ramdisk_id='',reservation_id='r-rgkike6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-693282259',owner_user_name='tempest-AttachVolumeNegativeTest-693282259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:33:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e99eefba54014b9ea83f1611b02efaad',uuid=c313dd0f-12a8-46e1-8443-31a3abfac0ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "address": "fa:16:3e:e6:27:9b", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0a1cb3-01", "ovs_interfaceid": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:36:16 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converting VIF {"id": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "address": "fa:16:3e:e6:27:9b", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0a1cb3-01", "ovs_interfaceid": "ff0a1cb3-0154-4850-aaac-558f01cbe112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:36:16 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:27:9b,bridge_name='br-int',has_traffic_filtering=True,id=ff0a1cb3-0154-4850-aaac-558f01cbe112,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0a1cb3-01') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:36:16 user nova-compute[72849]: DEBUG os_vif [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:27:9b,bridge_name='br-int',has_traffic_filtering=True,id=ff0a1cb3-0154-4850-aaac-558f01cbe112,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0a1cb3-01') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:36:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff0a1cb3-01, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:36:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:36:16 user nova-compute[72849]: INFO os_vif [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:27:9b,bridge_name='br-int',has_traffic_filtering=True,id=ff0a1cb3-0154-4850-aaac-558f01cbe112,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0a1cb3-01')
Aug 15 16:36:16 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Deleting instance files /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab_del
Aug 15 16:36:16 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Deletion of /opt/stack/data/nova/instances/c313dd0f-12a8-46e1-8443-31a3abfac0ab_del complete
Aug 15 16:36:16 user nova-compute[72849]: INFO nova.compute.manager [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 15 16:36:16 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:36:16 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:36:16 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:36:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-a4d4de82-5c67-41f0-8360-953bcd9fbd2a req-e68072a9-0091-420e-9c9f-db1ce7baac89 service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Received event network-vif-unplugged-ff0a1cb3-0154-4850-aaac-558f01cbe112 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:36:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a4d4de82-5c67-41f0-8360-953bcd9fbd2a req-e68072a9-0091-420e-9c9f-db1ce7baac89 service nova] Acquiring lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a4d4de82-5c67-41f0-8360-953bcd9fbd2a req-e68072a9-0091-420e-9c9f-db1ce7baac89 service nova] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a4d4de82-5c67-41f0-8360-953bcd9fbd2a req-e68072a9-0091-420e-9c9f-db1ce7baac89 service nova] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-a4d4de82-5c67-41f0-8360-953bcd9fbd2a req-e68072a9-0091-420e-9c9f-db1ce7baac89 service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] No waiting events found dispatching network-vif-unplugged-ff0a1cb3-0154-4850-aaac-558f01cbe112 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:36:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-a4d4de82-5c67-41f0-8360-953bcd9fbd2a req-e68072a9-0091-420e-9c9f-db1ce7baac89 service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Received event network-vif-unplugged-ff0a1cb3-0154-4850-aaac-558f01cbe112 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:36:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-a4d4de82-5c67-41f0-8360-953bcd9fbd2a req-e68072a9-0091-420e-9c9f-db1ce7baac89 service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Received event network-vif-plugged-ff0a1cb3-0154-4850-aaac-558f01cbe112 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:36:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a4d4de82-5c67-41f0-8360-953bcd9fbd2a req-e68072a9-0091-420e-9c9f-db1ce7baac89 service nova] Acquiring lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a4d4de82-5c67-41f0-8360-953bcd9fbd2a req-e68072a9-0091-420e-9c9f-db1ce7baac89 service nova] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a4d4de82-5c67-41f0-8360-953bcd9fbd2a req-e68072a9-0091-420e-9c9f-db1ce7baac89 service nova] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-a4d4de82-5c67-41f0-8360-953bcd9fbd2a req-e68072a9-0091-420e-9c9f-db1ce7baac89 service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] No waiting events found dispatching network-vif-plugged-ff0a1cb3-0154-4850-aaac-558f01cbe112 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:36:17 user nova-compute[72849]: WARNING nova.compute.manager [req-a4d4de82-5c67-41f0-8360-953bcd9fbd2a req-e68072a9-0091-420e-9c9f-db1ce7baac89 service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Received unexpected event network-vif-plugged-ff0a1cb3-0154-4850-aaac-558f01cbe112 for instance with vm_state active and task_state deleting.
Aug 15 16:36:17 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:36:17 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Took 0.87 seconds to deallocate network for instance.
Aug 15 16:36:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:18 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:36:18 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:36:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:18 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Deleted allocations for instance c313dd0f-12a8-46e1-8443-31a3abfac0ab
Aug 15 16:36:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e568688d-ce10-48e8-8d85-88915bb09e15 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "c313dd0f-12a8-46e1-8443-31a3abfac0ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.243s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-9eec2899-c94e-4c6b-8e41-611bfd4e2c4e req-c2eb1571-2bb7-4cec-84d7-3b45a3d7e04b service nova] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Received event network-vif-deleted-ff0a1cb3-0154-4850-aaac-558f01cbe112 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:36:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:22 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117367.0654318, 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:36:22 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] VM Stopped (Lifecycle Event)
Aug 15 16:36:22 user nova-compute[72849]: DEBUG nova.compute.manager [None req-f03961bc-bd6c-4d62-bed1-64001e1329f7 None None] [instance: 56b6dc4d-d4a8-44c1-a31b-fdd5ee2b147d] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:36:23 user nova-compute[72849]: DEBUG nova.compute.manager [req-e6456bde-ad7b-4288-b7d1-5bee925f79db req-f7bc784b-40b2-4da8-8637-2b02b1a704ff service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Received event network-changed-de3685be-4bbe-4c94-b193-49797916f7cc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:36:23 user nova-compute[72849]: DEBUG nova.compute.manager [req-e6456bde-ad7b-4288-b7d1-5bee925f79db req-f7bc784b-40b2-4da8-8637-2b02b1a704ff service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Refreshing instance network info cache due to event network-changed-de3685be-4bbe-4c94-b193-49797916f7cc. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:36:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e6456bde-ad7b-4288-b7d1-5bee925f79db req-f7bc784b-40b2-4da8-8637-2b02b1a704ff service nova] Acquiring lock "refresh_cache-f0007ddd-f25d-4708-b617-d98728f6ffcc" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:36:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e6456bde-ad7b-4288-b7d1-5bee925f79db req-f7bc784b-40b2-4da8-8637-2b02b1a704ff service nova] Acquired lock "refresh_cache-f0007ddd-f25d-4708-b617-d98728f6ffcc" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:36:23 user nova-compute[72849]: DEBUG nova.network.neutron [req-e6456bde-ad7b-4288-b7d1-5bee925f79db req-f7bc784b-40b2-4da8-8637-2b02b1a704ff service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Refreshing network info cache for port de3685be-4bbe-4c94-b193-49797916f7cc {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG nova.network.neutron [req-e6456bde-ad7b-4288-b7d1-5bee925f79db req-f7bc784b-40b2-4da8-8637-2b02b1a704ff service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Updated VIF entry in instance network info cache for port de3685be-4bbe-4c94-b193-49797916f7cc. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG nova.network.neutron [req-e6456bde-ad7b-4288-b7d1-5bee925f79db req-f7bc784b-40b2-4da8-8637-2b02b1a704ff service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Updating instance_info_cache with network_info: [{"id": "de3685be-4bbe-4c94-b193-49797916f7cc", "address": "fa:16:3e:b0:a4:25", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3685be-4b", "ovs_interfaceid": "de3685be-4bbe-4c94-b193-49797916f7cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "f0007ddd-f25d-4708-b617-d98728f6ffcc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e6456bde-ad7b-4288-b7d1-5bee925f79db req-f7bc784b-40b2-4da8-8637-2b02b1a704ff service nova] Releasing lock "refresh_cache-f0007ddd-f25d-4708-b617-d98728f6ffcc" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG nova.objects.instance [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lazy-loading 'flavor' on Instance uuid f0007ddd-f25d-4708-b617-d98728f6ffcc {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "f0007ddd-f25d-4708-b617-d98728f6ffcc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:24 user nova-compute[72849]: INFO nova.compute.manager [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Attaching volume 61332c55-778d-4283-ac6c-f62b4c666e2b to /dev/vdb
Aug 15 16:36:24 user nova-compute[72849]: DEBUG os_brick.utils [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aab05e-7be1-4083-9327-cb9d523dad61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51363e8-583e-45e5-9c36-96c36e18be0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb7afdf-8670-492c-8cad-e75da7a91e5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9fe32e-b80e-47a0-bdb3-f94f13e0fc8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:36:24 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:36:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0299aa-589a-4347-9aad-c16b6d613b20]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG os_brick.utils [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Updating existing volume attachment record: be635c0f-2bec-4a96-a5a2-e282ef1e4e6a {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:36:24 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117369.6819916, 4b9f21bc-836f-4095-9eb3-d3971d418363 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:36:24 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] VM Stopped (Lifecycle Event)
Aug 15 16:36:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-df662727-73ea-47c3-ac9b-4fe4d9e0be8b None None] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:36:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:31 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117376.8891363, c313dd0f-12a8-46e1-8443-31a3abfac0ab => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:36:31 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] VM Stopped (Lifecycle Event)
Aug 15 16:36:31 user nova-compute[72849]: DEBUG nova.compute.manager [None req-fbfe5179-8f4b-4a31-9087-35826c04ec12 None None] [instance: c313dd0f-12a8-46e1-8443-31a3abfac0ab] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:36:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZegoLTpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:36:33 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:36:33 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:36:33 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[deeb52fd-4936-400b-a1ce-65d77f147d64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:36:33 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[661125c1-68b0-409a-8c66-e26c8564d016]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b] added
Aug 15 16:36:33 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[993d2c57-e3dd-4b47-ae90-d4443e64b693]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6135376b-261f-431e-b612-e53a711a81c4]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZegoLTpq {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZegoLTpq" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31bdf0b-c0d5-4964-aa18-2532743fdab0]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZegoLTpq'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d885d803-b2ed-450d-adaa-5b7c9c4a0526]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0eee6e-f748-4527-86e7-ec22023150da]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:36:33 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:36:33 user nova-compute[72849]:  {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:36:33 user nova-compute[72849]: WARNING os_brick.initiator.connectors.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 16:36:33 user nova-compute[72849]: 
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5addcfdd-7049-440d-9d71-1709bb01e363]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b, portal: 172.16.0.220,3260]
Aug 15 16:36:33 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b, portal: 172.16.0.220,3260] successful.
Aug 15 16:36:33 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d4b10d-a3d3-4c30-841a-76fbe546e618]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b060d1-5d29-4724-95ea-1aa27e4624ae]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b (non-flash)
Aug 15 16:36:33 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b (non-flash)
Aug 15 16:36:33 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a312645a-f5b1-4803-af21-18bed9daf4fb]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:33 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:36:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:34 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:36:34 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:36:34 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:36:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZegoLTpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:36:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:36:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23136663532376264', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:36:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136663532376264', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:36:34 user nova-compute[72849]: DEBUG nova.objects.instance [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lazy-loading 'flavor' on Instance uuid f0007ddd-f25d-4708-b617-d98728f6ffcc {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:36:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:36:34 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:36:34 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:36:34 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:36:34 user nova-compute[72849]:   <serial>61332c55-778d-4283-ac6c-f62b4c666e2b</serial>
Aug 15 16:36:34 user nova-compute[72849]: </disk>
Aug 15 16:36:34 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:36:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:36:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:36:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] No VIF found with MAC fa:16:3e:b0:a4:25, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:36:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e0b24083-054b-4ddc-b2b2-122ff4cafcc7 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.664s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:35 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:36:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:36:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:36:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Didn't find any instances for network info cache update. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 16:36:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:36:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:36:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "f0007ddd-f25d-4708-b617-d98728f6ffcc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:37 user nova-compute[72849]: INFO nova.compute.manager [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Detaching volume 61332c55-778d-4283-ac6c-f62b4c666e2b
Aug 15 16:36:37 user nova-compute[72849]: INFO nova.virt.block_device [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Attempting to driver detach volume 61332c55-778d-4283-ac6c-f62b4c666e2b from mountpoint /dev/vdb
Aug 15 16:36:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Attempting to detach device vdb from instance f0007ddd-f25d-4708-b617-d98728f6ffcc from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:36:37 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:36:37 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:36:37 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:36:37 user nova-compute[72849]:   <serial>61332c55-778d-4283-ac6c-f62b4c666e2b</serial>
Aug 15 16:36:37 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:36:37 user nova-compute[72849]: </disk>
Aug 15 16:36:37 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:36:37 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Successfully detached device vdb from instance f0007ddd-f25d-4708-b617-d98728f6ffcc from the persistent domain config.
Aug 15 16:36:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0007ddd-f25d-4708-b617-d98728f6ffcc from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:36:37 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:36:37 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:36:37 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:36:37 user nova-compute[72849]:   <serial>61332c55-778d-4283-ac6c-f62b4c666e2b</serial>
Aug 15 16:36:37 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:36:37 user nova-compute[72849]: </disk>
Aug 15 16:36:37 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692117397.4747343, f0007ddd-f25d-4708-b617-d98728f6ffcc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0007ddd-f25d-4708-b617-d98728f6ffcc {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:36:37 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Successfully detached device vdb from instance f0007ddd-f25d-4708-b617-d98728f6ffcc from the live domain config.
Aug 15 16:36:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZegoLTpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:36:37 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:36:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4485053-e652-452e-83dc-46095dda929b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbdbee4-7b33-4cac-ac38-af1273997432]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b (non-flash)
Aug 15 16:36:37 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b (non-flash)
Aug 15 16:36:37 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3583eb910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e08412e-cf86-4ce2-9af8-eb77bd9d5a55]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[297bc61b-54e9-4fa7-be75-f314812d5f7b]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adf193e-8884-490c-b8ca-fedf89898cfa]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc60b39d-05ef-4d41-8181-f79c3486d531]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9b200e-6902-4252-83d4-f2940ecf7a58]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd60dc5-2802-42a7-9765-f7d7337668b9]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b, portal: 172.16.0.220,3260]
Aug 15 16:36:37 user nova-compute[72849]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b, portal: 172.16.0.220,3260] successful.
Aug 15 16:36:37 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61332c55-778d-4283-ac6c-f62b4c666e2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[34402450-5a57-4adc-a920-f50fe28b73e9]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] <== disconnect_volume: return (275ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:36:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:36:38 user nova-compute[72849]: DEBUG nova.objects.instance [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lazy-loading 'flavor' on Instance uuid f0007ddd-f25d-4708-b617-d98728f6ffcc {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:36:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2c464482-2ba6-49ce-aa0b-7c1c23ab2734 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.709s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:39 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:36:39 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:36:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:39 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:36:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:39 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:40 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:41 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:36:41 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:36:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8194MB free_disk=25.284297943115234GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:36:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc521d87-09aa-44ba-a87c-1cd5517b3707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:36:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 46f0aa43-e313-4aff-bacc-aa5290193b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:36:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f0007ddd-f25d-4708-b617-d98728f6ffcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:36:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f2f0b640-e9ae-43ba-a175-a9ab87d30c8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:36:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:36:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:36:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:41 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:36:42 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:36:42 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:36:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:44 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:36:44 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:36:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "46f0aa43-e313-4aff-bacc-aa5290193b00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:54 user nova-compute[72849]: INFO nova.compute.manager [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Terminating instance
Aug 15 16:36:54 user nova-compute[72849]: DEBUG nova.compute.manager [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-3d64c623-da18-4a87-af63-0c5d30099f1f req-dc342510-4a5a-405f-bf05-18a007423e07 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Received event network-vif-unplugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3d64c623-da18-4a87-af63-0c5d30099f1f req-dc342510-4a5a-405f-bf05-18a007423e07 service nova] Acquiring lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3d64c623-da18-4a87-af63-0c5d30099f1f req-dc342510-4a5a-405f-bf05-18a007423e07 service nova] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3d64c623-da18-4a87-af63-0c5d30099f1f req-dc342510-4a5a-405f-bf05-18a007423e07 service nova] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-3d64c623-da18-4a87-af63-0c5d30099f1f req-dc342510-4a5a-405f-bf05-18a007423e07 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] No waiting events found dispatching network-vif-unplugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-3d64c623-da18-4a87-af63-0c5d30099f1f req-dc342510-4a5a-405f-bf05-18a007423e07 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Received event network-vif-unplugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:55 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Instance destroyed successfully.
Aug 15 16:36:55 user nova-compute[72849]: DEBUG nova.objects.instance [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'resources' on Instance uuid 46f0aa43-e313-4aff-bacc-aa5290193b00 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:20:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1098266755',display_name='tempest-ServerRescueNegativeTestJSON-server-1098266755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1098266755',id=17,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:22:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63fff6abd55f4552b56b7f80f3b19990',ramdisk_id='',reservation_id='r-0yzyeyqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-817230683',owner_user_name='tempest-ServerRescueNegativeTestJSON-817230683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:22:33Z,user_data=None,user_id='a6bc0fd1358a42debf05e9bc43b8e329',uuid=46f0aa43-e313-4aff-bacc-aa5290193b00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "address": "fa:16:3e:dc:17:58", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6eba8c-01", "ovs_interfaceid": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converting VIF {"id": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "address": "fa:16:3e:dc:17:58", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6eba8c-01", "ovs_interfaceid": "2e6eba8c-01a5-4e16-95da-51ce996ed2eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:17:58,bridge_name='br-int',has_traffic_filtering=True,id=2e6eba8c-01a5-4e16-95da-51ce996ed2eb,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6eba8c-01') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG os_vif [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:17:58,bridge_name='br-int',has_traffic_filtering=True,id=2e6eba8c-01a5-4e16-95da-51ce996ed2eb,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6eba8c-01') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e6eba8c-01, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:36:55 user nova-compute[72849]: INFO os_vif [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:17:58,bridge_name='br-int',has_traffic_filtering=True,id=2e6eba8c-01a5-4e16-95da-51ce996ed2eb,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6eba8c-01')
Aug 15 16:36:55 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Deleting instance files /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00_del
Aug 15 16:36:55 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Deletion of /opt/stack/data/nova/instances/46f0aa43-e313-4aff-bacc-aa5290193b00_del complete
Aug 15 16:36:55 user nova-compute[72849]: INFO nova.compute.manager [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 15 16:36:55 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:36:55 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:36:56 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:36:56 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Took 0.73 seconds to deallocate network for instance.
Aug 15 16:36:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:56 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:36:56 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:36:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:56 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Deleted allocations for instance 46f0aa43-e313-4aff-bacc-aa5290193b00
Aug 15 16:36:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Acquiring lock "5a4db694-b564-43b5-829c-08b9d54effed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "5a4db694-b564-43b5-829c-08b9d54effed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:36:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d901bc4c-4060-4ea5-b26b-b29115d1727d tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.816s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:36:57 user nova-compute[72849]: INFO nova.compute.claims [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Claim successful on node user
Aug 15 16:36:57 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-171c2f68-8fe6-42cc-bb6e-2adb52b26294 req-f7bd397d-53cc-4571-85f7-e4a11b14a0f5 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Received event network-vif-plugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-171c2f68-8fe6-42cc-bb6e-2adb52b26294 req-f7bd397d-53cc-4571-85f7-e4a11b14a0f5 service nova] Acquiring lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-171c2f68-8fe6-42cc-bb6e-2adb52b26294 req-f7bd397d-53cc-4571-85f7-e4a11b14a0f5 service nova] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-171c2f68-8fe6-42cc-bb6e-2adb52b26294 req-f7bd397d-53cc-4571-85f7-e4a11b14a0f5 service nova] Lock "46f0aa43-e313-4aff-bacc-aa5290193b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-171c2f68-8fe6-42cc-bb6e-2adb52b26294 req-f7bd397d-53cc-4571-85f7-e4a11b14a0f5 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] No waiting events found dispatching network-vif-plugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:36:57 user nova-compute[72849]: WARNING nova.compute.manager [req-171c2f68-8fe6-42cc-bb6e-2adb52b26294 req-f7bd397d-53cc-4571-85f7-e4a11b14a0f5 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Received unexpected event network-vif-plugged-2e6eba8c-01a5-4e16-95da-51ce996ed2eb for instance with vm_state deleted and task_state None.
Aug 15 16:36:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-171c2f68-8fe6-42cc-bb6e-2adb52b26294 req-f7bd397d-53cc-4571-85f7-e4a11b14a0f5 service nova] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Received event network-vif-deleted-2e6eba8c-01a5-4e16-95da-51ce996ed2eb {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG nova.network.neutron [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:36:57 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:36:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:36:57 user nova-compute[72849]: INFO nova.virt.block_device [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Booting with volume 3d0389bc-18c0-4d5f-84b8-45c822757bac at /dev/vda
Aug 15 16:36:57 user nova-compute[72849]: DEBUG nova.policy [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88a41ce4f3804e209615d11dd8c8e429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8257d7b72b2043fca341cffe932713cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG os_brick.utils [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0120c007-5766-4d1b-bc1d-14ea494d9472]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[425e6c8c-da7a-4e0e-87c0-459a99fe7dbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf751141-3011-4182-b988-ecf83b619cf4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[df219db0-ecc4-44d5-b586-4df9c9447065]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:36:57 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:36:57 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8b57a9-6efe-4c0c-96f7-0980e0fd00a7]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG os_brick.utils [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:36:57 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Updating existing volume attachment record: 38895d96-6ad4-4678-ab2a-32735b4a71d1 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:36:58 user nova-compute[72849]: DEBUG nova.network.neutron [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Successfully created port: 0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:36:58 user nova-compute[72849]: DEBUG nova.network.neutron [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Successfully updated port: 0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:36:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Acquiring lock "refresh_cache-5a4db694-b564-43b5-829c-08b9d54effed" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:36:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Acquired lock "refresh_cache-5a4db694-b564-43b5-829c-08b9d54effed" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:36:58 user nova-compute[72849]: DEBUG nova.network.neutron [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:36:58 user nova-compute[72849]: DEBUG nova.network.neutron [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:36:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:36:59 user nova-compute[72849]: DEBUG nova.network.neutron [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Updating instance_info_cache with network_info: [{"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:36:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Releasing lock "refresh_cache-5a4db694-b564-43b5-829c-08b9d54effed" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:36:59 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Instance network_info: |[{"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:36:59 user nova-compute[72849]: DEBUG nova.compute.manager [req-444ed204-95be-40cd-a39f-4469c7d3d218 req-e17a3ce4-4b66-49b1-b537-f82b43f75fe5 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received event network-changed-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:36:59 user nova-compute[72849]: DEBUG nova.compute.manager [req-444ed204-95be-40cd-a39f-4469c7d3d218 req-e17a3ce4-4b66-49b1-b537-f82b43f75fe5 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Refreshing instance network info cache due to event network-changed-0e61cd59-e467-4ca6-8758-161710ac94c2. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:36:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-444ed204-95be-40cd-a39f-4469c7d3d218 req-e17a3ce4-4b66-49b1-b537-f82b43f75fe5 service nova] Acquiring lock "refresh_cache-5a4db694-b564-43b5-829c-08b9d54effed" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:36:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-444ed204-95be-40cd-a39f-4469c7d3d218 req-e17a3ce4-4b66-49b1-b537-f82b43f75fe5 service nova] Acquired lock "refresh_cache-5a4db694-b564-43b5-829c-08b9d54effed" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:36:59 user nova-compute[72849]: DEBUG nova.network.neutron [req-444ed204-95be-40cd-a39f-4469c7d3d218 req-e17a3ce4-4b66-49b1-b537-f82b43f75fe5 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Refreshing network info cache for port 0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:36:59 user nova-compute[72849]: DEBUG nova.network.neutron [req-444ed204-95be-40cd-a39f-4469c7d3d218 req-e17a3ce4-4b66-49b1-b537-f82b43f75fe5 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Updated VIF entry in instance network info cache for port 0e61cd59-e467-4ca6-8758-161710ac94c2. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:36:59 user nova-compute[72849]: DEBUG nova.network.neutron [req-444ed204-95be-40cd-a39f-4469c7d3d218 req-e17a3ce4-4b66-49b1-b537-f82b43f75fe5 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Updating instance_info_cache with network_info: [{"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:36:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-444ed204-95be-40cd-a39f-4469c7d3d218 req-e17a3ce4-4b66-49b1-b537-f82b43f75fe5 service nova] Releasing lock "refresh_cache-5a4db694-b564-43b5-829c-08b9d54effed" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:37:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:37:06 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Creating image(s)
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Did not create local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Ensure instance console log exists: /opt/stack/data/nova/instances/5a4db694-b564-43b5-829c-08b9d54effed/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Start _get_guest_xml network_info=[{"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTGyIOie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5a4db694-b564-43b5-829c-08b9d54effed', 'attached_at': '', 'detached_at': '', 'volume_id': '3d0389bc-18c0-4d5f-84b8-45c822757bac', 'serial': '3d0389bc-18c0-4d5f-84b8-45c822757bac'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '38895d96-6ad4-4678-ab2a-32735b4a71d1', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:37:06 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:37:06 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTGyIOie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:37:06 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:37:06 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:37:06 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[50475f7e-92a0-42e1-8241-60f4ecab48e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:37:06 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[776dfab9-e489-47bf-b52d-ada4450f81a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac] added
Aug 15 16:37:06 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d2366d-6286-4e2a-923b-782439730734]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[257a0b63-22c7-4495-aa5e-1b785017c980]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTGyIOie {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTGyIOie" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[69214ee9-f2dd-49e3-9ead-cd0fc8265b85]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qTGyIOie'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed819ca9-4c24-4781-9cde-e7b2889bfae7]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc0a9f6-3825-40d6-a4c0-11faf3c616b1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:37:06 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:37:06 user nova-compute[72849]:  {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:37:06 user nova-compute[72849]: WARNING os_brick.initiator.connectors.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 16:37:06 user nova-compute[72849]: 
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5081ea5-588d-4aa1-891b-9f86361f69af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac, portal: 172.16.0.220,3260]
Aug 15 16:37:06 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac, portal: 172.16.0.220,3260] successful.
Aug 15 16:37:06 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf55d74-474b-482c-9528-e7061d986e41]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff0de73-210d-4483-bd5d-e860d6bbc8fd]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:37:06 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:37:06 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[895a3b6c-0eea-47d2-ba26-47103e01f877]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:37:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTGyIOie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26433633966616666', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433633966616666', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1342883923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1342883923',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJatHR/jzIF+/y3DqPp6PgoaFfCxIRfWdAZfYQXri5QfeGqkdcwqS7G+66L7VfNSltp49OU15mHeogEdXsLwa5QNi2gL6qLyKw28X/fFcTOinCo13zoXRe1m1pZG99ND3A==',key_name='tempest-keypair-1009687442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8257d7b72b2043fca341cffe932713cd',ramdisk_id='',reservation_id='r-mmdj3s06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1860304746',owner_user_name='tempest-ServerActionsV293TestJSON-1860304746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:36:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88a41ce4f3804e209615d11dd8c8e429',uuid=5a4db694-b564-43b5-829c-08b9d54effed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Converting VIF {"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=0e61cd59-e467-4ca6-8758-161710ac94c2,network=Network(d451ff25-a96a-43d5-b481-90e37add5577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e61cd59-e4') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG nova.objects.instance [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a4db694-b564-43b5-829c-08b9d54effed {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:37:07 user nova-compute[72849]:   <uuid>5a4db694-b564-43b5-829c-08b9d54effed</uuid>
Aug 15 16:37:07 user nova-compute[72849]:   <name>instance-00000027</name>
Aug 15 16:37:07 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:37:07 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:37:07 user nova-compute[72849]:   <metadata>
Aug 15 16:37:07 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:37:07 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:37:07 user nova-compute[72849]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1342883923</nova:name>
Aug 15 16:37:07 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:37:06</nova:creationTime>
Aug 15 16:37:07 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:37:07 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:37:07 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:37:07 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:37:07 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:37:07 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:37:07 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:37:07 user nova-compute[72849]:       <nova:owner>
Aug 15 16:37:07 user nova-compute[72849]:         <nova:user uuid="88a41ce4f3804e209615d11dd8c8e429">tempest-ServerActionsV293TestJSON-1860304746-project-member</nova:user>
Aug 15 16:37:07 user nova-compute[72849]:         <nova:project uuid="8257d7b72b2043fca341cffe932713cd">tempest-ServerActionsV293TestJSON-1860304746</nova:project>
Aug 15 16:37:07 user nova-compute[72849]:       </nova:owner>
Aug 15 16:37:07 user nova-compute[72849]:       <nova:ports>
Aug 15 16:37:07 user nova-compute[72849]:         <nova:port uuid="0e61cd59-e467-4ca6-8758-161710ac94c2">
Aug 15 16:37:07 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 16:37:07 user nova-compute[72849]:         </nova:port>
Aug 15 16:37:07 user nova-compute[72849]:       </nova:ports>
Aug 15 16:37:07 user nova-compute[72849]:     </nova:instance>
Aug 15 16:37:07 user nova-compute[72849]:   </metadata>
Aug 15 16:37:07 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:37:07 user nova-compute[72849]:     <system>
Aug 15 16:37:07 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:37:07 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:37:07 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:37:07 user nova-compute[72849]:       <entry name="serial">5a4db694-b564-43b5-829c-08b9d54effed</entry>
Aug 15 16:37:07 user nova-compute[72849]:       <entry name="uuid">5a4db694-b564-43b5-829c-08b9d54effed</entry>
Aug 15 16:37:07 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:37:07 user nova-compute[72849]:     </system>
Aug 15 16:37:07 user nova-compute[72849]:   </sysinfo>
Aug 15 16:37:07 user nova-compute[72849]:   <os>
Aug 15 16:37:07 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:37:07 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:37:07 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:37:07 user nova-compute[72849]:   </os>
Aug 15 16:37:07 user nova-compute[72849]:   <features>
Aug 15 16:37:07 user nova-compute[72849]:     <acpi/>
Aug 15 16:37:07 user nova-compute[72849]:     <apic/>
Aug 15 16:37:07 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:37:07 user nova-compute[72849]:   </features>
Aug 15 16:37:07 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:37:07 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:37:07 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:37:07 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:37:07 user nova-compute[72849]:   </clock>
Aug 15 16:37:07 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:37:07 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:37:07 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:37:07 user nova-compute[72849]:   </cpu>
Aug 15 16:37:07 user nova-compute[72849]:   <devices>
Aug 15 16:37:07 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:37:07 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:37:07 user nova-compute[72849]:       <source dev="/dev/sdb"/>
Aug 15 16:37:07 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:37:07 user nova-compute[72849]:       <serial>3d0389bc-18c0-4d5f-84b8-45c822757bac</serial>
Aug 15 16:37:07 user nova-compute[72849]:     </disk>
Aug 15 16:37:07 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:37:07 user nova-compute[72849]:       <mac address="fa:16:3e:12:d0:38"/>
Aug 15 16:37:07 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:37:07 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:37:07 user nova-compute[72849]:       <target dev="tap0e61cd59-e4"/>
Aug 15 16:37:07 user nova-compute[72849]:     </interface>
Aug 15 16:37:07 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:37:07 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/5a4db694-b564-43b5-829c-08b9d54effed/console.log" append="off"/>
Aug 15 16:37:07 user nova-compute[72849]:     </serial>
Aug 15 16:37:07 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:37:07 user nova-compute[72849]:     <video>
Aug 15 16:37:07 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:37:07 user nova-compute[72849]:     </video>
Aug 15 16:37:07 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:37:07 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:37:07 user nova-compute[72849]:     </rng>
Aug 15 16:37:07 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:37:07 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:37:07 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:37:07 user nova-compute[72849]:     </memballoon>
Aug 15 16:37:07 user nova-compute[72849]:   </devices>
Aug 15 16:37:07 user nova-compute[72849]: </domain>
Aug 15 16:37:07 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1342883923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1342883923',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJatHR/jzIF+/y3DqPp6PgoaFfCxIRfWdAZfYQXri5QfeGqkdcwqS7G+66L7VfNSltp49OU15mHeogEdXsLwa5QNi2gL6qLyKw28X/fFcTOinCo13zoXRe1m1pZG99ND3A==',key_name='tempest-keypair-1009687442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8257d7b72b2043fca341cffe932713cd',ramdisk_id='',reservation_id='r-mmdj3s06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1860304746',owner_user_name='tempest-ServerActionsV293TestJSON-1860304746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:36:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88a41ce4f3804e209615d11dd8c8e429',uuid=5a4db694-b564-43b5-829c-08b9d54effed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Converting VIF {"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=0e61cd59-e467-4ca6-8758-161710ac94c2,network=Network(d451ff25-a96a-43d5-b481-90e37add5577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e61cd59-e4') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG os_vif [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=0e61cd59-e467-4ca6-8758-161710ac94c2,network=Network(d451ff25-a96a-43d5-b481-90e37add5577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e61cd59-e4') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e61cd59-e4, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e61cd59-e4, col_values=(('external_ids', {'iface-id': '0e61cd59-e467-4ca6-8758-161710ac94c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:d0:38', 'vm-uuid': '5a4db694-b564-43b5-829c-08b9d54effed'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:07 user nova-compute[72849]: INFO os_vif [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=0e61cd59-e467-4ca6-8758-161710ac94c2,network=Network(d451ff25-a96a-43d5-b481-90e37add5577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e61cd59-e4')
Aug 15 16:37:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:37:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] No VIF found with MAC fa:16:3e:12:d0:38, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:37:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-e7ddd612-d1c1-4559-9b8c-17c8262cee66 req-fa08137f-8807-4950-ac66-44c2b48bad7c service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received event network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:37:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e7ddd612-d1c1-4559-9b8c-17c8262cee66 req-fa08137f-8807-4950-ac66-44c2b48bad7c service nova] Acquiring lock "5a4db694-b564-43b5-829c-08b9d54effed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e7ddd612-d1c1-4559-9b8c-17c8262cee66 req-fa08137f-8807-4950-ac66-44c2b48bad7c service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e7ddd612-d1c1-4559-9b8c-17c8262cee66 req-fa08137f-8807-4950-ac66-44c2b48bad7c service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-e7ddd612-d1c1-4559-9b8c-17c8262cee66 req-fa08137f-8807-4950-ac66-44c2b48bad7c service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] No waiting events found dispatching network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:37:09 user nova-compute[72849]: WARNING nova.compute.manager [req-e7ddd612-d1c1-4559-9b8c-17c8262cee66 req-fa08137f-8807-4950-ac66-44c2b48bad7c service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received unexpected event network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 for instance with vm_state building and task_state spawning.
Aug 15 16:37:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "3c433846-35b4-4d82-beae-5a18f5f069fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:37:10 user nova-compute[72849]: INFO nova.compute.claims [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Claim successful on node user
Aug 15 16:37:10 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117415.5108807, 46f0aa43-e313-4aff-bacc-aa5290193b00 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:37:10 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] VM Stopped (Lifecycle Event)
Aug 15 16:37:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a2a941ec-c132-4d98-9ee1-b02703698201 None None] [instance: 46f0aa43-e313-4aff-bacc-aa5290193b00] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG nova.network.neutron [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:37:10 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:37:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG nova.policy [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e99eefba54014b9ea83f1611b02efaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ddd223976e4b13a3b6a5638846f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:37:10 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Creating image(s)
Aug 15 16:37:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "/opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "/opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.174s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.172s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk 1073741824" returned: 0 in 0.063s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117431.4253087, 5a4db694-b564-43b5-829c-08b9d54effed => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:37:11 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] VM Resumed (Lifecycle Event)
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:37:11 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Instance spawned successfully.
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.network.neutron [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Successfully created port: ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:37:11 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117431.4255536, 5a4db694-b564-43b5-829c-08b9d54effed => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:37:11 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] VM Started (Lifecycle Event)
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.204s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-88eb933d-72e1-4fdd-826b-24ccba8c7dec req-4fc7850a-8198-4564-918a-b86728ef99f8 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received event network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-88eb933d-72e1-4fdd-826b-24ccba8c7dec req-4fc7850a-8198-4564-918a-b86728ef99f8 service nova] Acquiring lock "5a4db694-b564-43b5-829c-08b9d54effed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-88eb933d-72e1-4fdd-826b-24ccba8c7dec req-4fc7850a-8198-4564-918a-b86728ef99f8 service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-88eb933d-72e1-4fdd-826b-24ccba8c7dec req-4fc7850a-8198-4564-918a-b86728ef99f8 service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-88eb933d-72e1-4fdd-826b-24ccba8c7dec req-4fc7850a-8198-4564-918a-b86728ef99f8 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] No waiting events found dispatching network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:37:11 user nova-compute[72849]: WARNING nova.compute.manager [req-88eb933d-72e1-4fdd-826b-24ccba8c7dec req-4fc7850a-8198-4564-918a-b86728ef99f8 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received unexpected event network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 for instance with vm_state building and task_state spawning.
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:37:11 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:37:11 user nova-compute[72849]: INFO nova.compute.manager [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Took 5.39 seconds to spawn the instance on the hypervisor.
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Cannot resize image /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.objects.instance [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'migration_context' on Instance uuid 3c433846-35b4-4d82-beae-5a18f5f069fe {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Ensure instance console log exists: /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:11 user nova-compute[72849]: INFO nova.compute.manager [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Took 14.82 seconds to build instance.
Aug 15 16:37:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0cad6fb2-b8bb-4a8e-8fa8-a30fab7d687d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "5a4db694-b564-43b5-829c-08b9d54effed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.123s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:12 user nova-compute[72849]: DEBUG nova.network.neutron [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Successfully updated port: ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:37:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "refresh_cache-3c433846-35b4-4d82-beae-5a18f5f069fe" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:37:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquired lock "refresh_cache-3c433846-35b4-4d82-beae-5a18f5f069fe" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:37:12 user nova-compute[72849]: DEBUG nova.network.neutron [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:37:12 user nova-compute[72849]: DEBUG nova.network.neutron [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:37:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-cc7782f6-9553-4bce-a439-458622bd11d5 req-49fb486a-106f-4f84-85a0-4a4deb319d90 service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Received event network-changed-ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:37:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-cc7782f6-9553-4bce-a439-458622bd11d5 req-49fb486a-106f-4f84-85a0-4a4deb319d90 service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Refreshing instance network info cache due to event network-changed-ba949ad9-bb5b-4a82-aa8e-f1294ad3e565. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:37:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-cc7782f6-9553-4bce-a439-458622bd11d5 req-49fb486a-106f-4f84-85a0-4a4deb319d90 service nova] Acquiring lock "refresh_cache-3c433846-35b4-4d82-beae-5a18f5f069fe" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:37:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.network.neutron [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Updating instance_info_cache with network_info: [{"id": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "address": "fa:16:3e:52:f9:b8", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba949ad9-bb", "ovs_interfaceid": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Releasing lock "refresh_cache-3c433846-35b4-4d82-beae-5a18f5f069fe" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Instance network_info: |[{"id": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "address": "fa:16:3e:52:f9:b8", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba949ad9-bb", "ovs_interfaceid": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-cc7782f6-9553-4bce-a439-458622bd11d5 req-49fb486a-106f-4f84-85a0-4a4deb319d90 service nova] Acquired lock "refresh_cache-3c433846-35b4-4d82-beae-5a18f5f069fe" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.network.neutron [req-cc7782f6-9553-4bce-a439-458622bd11d5 req-49fb486a-106f-4f84-85a0-4a4deb319d90 service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Refreshing network info cache for port ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Start _get_guest_xml network_info=[{"id": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "address": "fa:16:3e:52:f9:b8", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba949ad9-bb", "ovs_interfaceid": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:37:13 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:37:13 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:37:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2079133067',display_name='tempest-AttachVolumeNegativeTest-server-2079133067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2079133067',id=40,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaCpDcrOR1fk6HtClYSb54ORvkR2STo4v69GKOQxiGb166RNujKAT2h4at4NJqzLbfiajLfqgURf0e/O1XUM4E7duGxwsaqG8t9eV9+iDhemxfphexBAJu11/3KrsfhxA==',key_name='tempest-keypair-332137571',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0ddd223976e4b13a3b6a5638846f83a',ramdisk_id='',reservation_id='r-q0w10add',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-693282259',owner_user_name='tempest-AttachVolumeNegativeTest-693282259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e99eefba54014b9ea83f1611b02efaad',uuid=3c433846-35b4-4d82-beae-5a18f5f069fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "address": "fa:16:3e:52:f9:b8", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba949ad9-bb", "ovs_interfaceid": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converting VIF {"id": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "address": "fa:16:3e:52:f9:b8", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba949ad9-bb", "ovs_interfaceid": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=ba949ad9-bb5b-4a82-aa8e-f1294ad3e565,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba949ad9-bb') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.objects.instance [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c433846-35b4-4d82-beae-5a18f5f069fe {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:37:13 user nova-compute[72849]:   <uuid>3c433846-35b4-4d82-beae-5a18f5f069fe</uuid>
Aug 15 16:37:13 user nova-compute[72849]:   <name>instance-00000028</name>
Aug 15 16:37:13 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:37:13 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:37:13 user nova-compute[72849]:   <metadata>
Aug 15 16:37:13 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:37:13 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:37:13 user nova-compute[72849]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2079133067</nova:name>
Aug 15 16:37:13 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:37:13</nova:creationTime>
Aug 15 16:37:13 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:37:13 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:37:13 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:37:13 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:37:13 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:37:13 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:37:13 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:37:13 user nova-compute[72849]:       <nova:owner>
Aug 15 16:37:13 user nova-compute[72849]:         <nova:user uuid="e99eefba54014b9ea83f1611b02efaad">tempest-AttachVolumeNegativeTest-693282259-project-member</nova:user>
Aug 15 16:37:13 user nova-compute[72849]:         <nova:project uuid="d0ddd223976e4b13a3b6a5638846f83a">tempest-AttachVolumeNegativeTest-693282259</nova:project>
Aug 15 16:37:13 user nova-compute[72849]:       </nova:owner>
Aug 15 16:37:13 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:37:13 user nova-compute[72849]:       <nova:ports>
Aug 15 16:37:13 user nova-compute[72849]:         <nova:port uuid="ba949ad9-bb5b-4a82-aa8e-f1294ad3e565">
Aug 15 16:37:13 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 16:37:13 user nova-compute[72849]:         </nova:port>
Aug 15 16:37:13 user nova-compute[72849]:       </nova:ports>
Aug 15 16:37:13 user nova-compute[72849]:     </nova:instance>
Aug 15 16:37:13 user nova-compute[72849]:   </metadata>
Aug 15 16:37:13 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:37:13 user nova-compute[72849]:     <system>
Aug 15 16:37:13 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:37:13 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:37:13 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:37:13 user nova-compute[72849]:       <entry name="serial">3c433846-35b4-4d82-beae-5a18f5f069fe</entry>
Aug 15 16:37:13 user nova-compute[72849]:       <entry name="uuid">3c433846-35b4-4d82-beae-5a18f5f069fe</entry>
Aug 15 16:37:13 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:37:13 user nova-compute[72849]:     </system>
Aug 15 16:37:13 user nova-compute[72849]:   </sysinfo>
Aug 15 16:37:13 user nova-compute[72849]:   <os>
Aug 15 16:37:13 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:37:13 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:37:13 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:37:13 user nova-compute[72849]:   </os>
Aug 15 16:37:13 user nova-compute[72849]:   <features>
Aug 15 16:37:13 user nova-compute[72849]:     <acpi/>
Aug 15 16:37:13 user nova-compute[72849]:     <apic/>
Aug 15 16:37:13 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:37:13 user nova-compute[72849]:   </features>
Aug 15 16:37:13 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:37:13 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:37:13 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:37:13 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:37:13 user nova-compute[72849]:   </clock>
Aug 15 16:37:13 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:37:13 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:37:13 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:37:13 user nova-compute[72849]:   </cpu>
Aug 15 16:37:13 user nova-compute[72849]:   <devices>
Aug 15 16:37:13 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:37:13 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:37:13 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk"/>
Aug 15 16:37:13 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:37:13 user nova-compute[72849]:     </disk>
Aug 15 16:37:13 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:37:13 user nova-compute[72849]:       <mac address="fa:16:3e:52:f9:b8"/>
Aug 15 16:37:13 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:37:13 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:37:13 user nova-compute[72849]:       <target dev="tapba949ad9-bb"/>
Aug 15 16:37:13 user nova-compute[72849]:     </interface>
Aug 15 16:37:13 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:37:13 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/console.log" append="off"/>
Aug 15 16:37:13 user nova-compute[72849]:     </serial>
Aug 15 16:37:13 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:37:13 user nova-compute[72849]:     <video>
Aug 15 16:37:13 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:37:13 user nova-compute[72849]:     </video>
Aug 15 16:37:13 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:37:13 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:37:13 user nova-compute[72849]:     </rng>
Aug 15 16:37:13 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:37:13 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:37:13 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:37:13 user nova-compute[72849]:     </memballoon>
Aug 15 16:37:13 user nova-compute[72849]:   </devices>
Aug 15 16:37:13 user nova-compute[72849]: </domain>
Aug 15 16:37:13 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:37:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2079133067',display_name='tempest-AttachVolumeNegativeTest-server-2079133067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2079133067',id=40,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaCpDcrOR1fk6HtClYSb54ORvkR2STo4v69GKOQxiGb166RNujKAT2h4at4NJqzLbfiajLfqgURf0e/O1XUM4E7duGxwsaqG8t9eV9+iDhemxfphexBAJu11/3KrsfhxA==',key_name='tempest-keypair-332137571',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0ddd223976e4b13a3b6a5638846f83a',ramdisk_id='',reservation_id='r-q0w10add',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-693282259',owner_user_name='tempest-AttachVolumeNegativeTest-693282259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e99eefba54014b9ea83f1611b02efaad',uuid=3c433846-35b4-4d82-beae-5a18f5f069fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "address": "fa:16:3e:52:f9:b8", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba949ad9-bb", "ovs_interfaceid": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converting VIF {"id": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "address": "fa:16:3e:52:f9:b8", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba949ad9-bb", "ovs_interfaceid": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=ba949ad9-bb5b-4a82-aa8e-f1294ad3e565,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba949ad9-bb') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG os_vif [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=ba949ad9-bb5b-4a82-aa8e-f1294ad3e565,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba949ad9-bb') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba949ad9-bb, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba949ad9-bb, col_values=(('external_ids', {'iface-id': 'ba949ad9-bb5b-4a82-aa8e-f1294ad3e565', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:f9:b8', 'vm-uuid': '3c433846-35b4-4d82-beae-5a18f5f069fe'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:13 user nova-compute[72849]: INFO os_vif [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=ba949ad9-bb5b-4a82-aa8e-f1294ad3e565,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba949ad9-bb')
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] No VIF found with MAC fa:16:3e:52:f9:b8, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.network.neutron [req-cc7782f6-9553-4bce-a439-458622bd11d5 req-49fb486a-106f-4f84-85a0-4a4deb319d90 service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Updated VIF entry in instance network info cache for port ba949ad9-bb5b-4a82-aa8e-f1294ad3e565. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG nova.network.neutron [req-cc7782f6-9553-4bce-a439-458622bd11d5 req-49fb486a-106f-4f84-85a0-4a4deb319d90 service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Updating instance_info_cache with network_info: [{"id": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "address": "fa:16:3e:52:f9:b8", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba949ad9-bb", "ovs_interfaceid": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:37:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-cc7782f6-9553-4bce-a439-458622bd11d5 req-49fb486a-106f-4f84-85a0-4a4deb319d90 service nova] Releasing lock "refresh_cache-3c433846-35b4-4d82-beae-5a18f5f069fe" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:37:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:14 user nova-compute[72849]: DEBUG nova.compute.manager [req-dbcda1c9-d9a9-40c5-9b5a-40bf68f18a3a req-cbdc7478-dd1e-41e6-a63c-ccb1cb4c8c7a service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Received event network-vif-plugged-ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:37:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-dbcda1c9-d9a9-40c5-9b5a-40bf68f18a3a req-cbdc7478-dd1e-41e6-a63c-ccb1cb4c8c7a service nova] Acquiring lock "3c433846-35b4-4d82-beae-5a18f5f069fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-dbcda1c9-d9a9-40c5-9b5a-40bf68f18a3a req-cbdc7478-dd1e-41e6-a63c-ccb1cb4c8c7a service nova] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-dbcda1c9-d9a9-40c5-9b5a-40bf68f18a3a req-cbdc7478-dd1e-41e6-a63c-ccb1cb4c8c7a service nova] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:14 user nova-compute[72849]: DEBUG nova.compute.manager [req-dbcda1c9-d9a9-40c5-9b5a-40bf68f18a3a req-cbdc7478-dd1e-41e6-a63c-ccb1cb4c8c7a service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] No waiting events found dispatching network-vif-plugged-ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:37:14 user nova-compute[72849]: WARNING nova.compute.manager [req-dbcda1c9-d9a9-40c5-9b5a-40bf68f18a3a req-cbdc7478-dd1e-41e6-a63c-ccb1cb4c8c7a service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Received unexpected event network-vif-plugged-ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 for instance with vm_state building and task_state spawning.
Aug 15 16:37:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:16 user nova-compute[72849]: DEBUG nova.compute.manager [req-ee102393-39ab-4d72-b6e9-10cb68a89663 req-7ef68c38-ac94-4152-9a00-b17457ccc2ad service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Received event network-vif-plugged-ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:37:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ee102393-39ab-4d72-b6e9-10cb68a89663 req-7ef68c38-ac94-4152-9a00-b17457ccc2ad service nova] Acquiring lock "3c433846-35b4-4d82-beae-5a18f5f069fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ee102393-39ab-4d72-b6e9-10cb68a89663 req-7ef68c38-ac94-4152-9a00-b17457ccc2ad service nova] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ee102393-39ab-4d72-b6e9-10cb68a89663 req-7ef68c38-ac94-4152-9a00-b17457ccc2ad service nova] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:16 user nova-compute[72849]: DEBUG nova.compute.manager [req-ee102393-39ab-4d72-b6e9-10cb68a89663 req-7ef68c38-ac94-4152-9a00-b17457ccc2ad service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] No waiting events found dispatching network-vif-plugged-ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:37:16 user nova-compute[72849]: WARNING nova.compute.manager [req-ee102393-39ab-4d72-b6e9-10cb68a89663 req-7ef68c38-ac94-4152-9a00-b17457ccc2ad service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Received unexpected event network-vif-plugged-ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 for instance with vm_state building and task_state spawning.
Aug 15 16:37:17 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117437.0832343, 3c433846-35b4-4d82-beae-5a18f5f069fe => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:37:17 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] VM Resumed (Lifecycle Event)
Aug 15 16:37:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:37:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:37:17 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Instance spawned successfully.
Aug 15 16:37:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:37:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:37:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:37:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:37:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:37:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:37:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:37:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:37:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:37:17 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:37:17 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117437.0874336, 3c433846-35b4-4d82-beae-5a18f5f069fe => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:37:17 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] VM Started (Lifecycle Event)
Aug 15 16:37:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:37:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:37:17 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:37:17 user nova-compute[72849]: INFO nova.compute.manager [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Took 6.31 seconds to spawn the instance on the hypervisor.
Aug 15 16:37:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:37:17 user nova-compute[72849]: INFO nova.compute.manager [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Took 6.94 seconds to build instance.
Aug 15 16:37:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43435c6d-cb6a-4a1d-b26c-3d10937729ca tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.041s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:37:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:37:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:37:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:37:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:35 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:37:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:37:35 user nova-compute[72849]: INFO nova.compute.manager [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] instance snapshotting
Aug 15 16:37:35 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Beginning live snapshot process
Aug 15 16:37:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json -f qcow2 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json -f qcow2 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:37:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.171s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2k518ljo/519a5bd17d9d4cb3b37f3ca71318b3a5.delta 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:37:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2k518ljo/519a5bd17d9d4cb3b37f3ca71318b3a5.delta 1073741824" returned: 0 in 0.048s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:36 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 16:37:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:37:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72849) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 16:37:37 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 16:37:37 user nova-compute[72849]: DEBUG nova.privsep.utils [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72849) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 16:37:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2k518ljo/519a5bd17d9d4cb3b37f3ca71318b3a5.delta /opt/stack/data/nova/instances/snapshots/tmp2k518ljo/519a5bd17d9d4cb3b37f3ca71318b3a5 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:38 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:37:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:37:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:37:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2k518ljo/519a5bd17d9d4cb3b37f3ca71318b3a5.delta /opt/stack/data/nova/instances/snapshots/tmp2k518ljo/519a5bd17d9d4cb3b37f3ca71318b3a5" returned: 0 in 0.712s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:38 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Snapshot extracted, beginning image upload
Aug 15 16:37:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:37:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:37:38 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:37:38 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid cc521d87-09aa-44ba-a87c-1cd5517b3707 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:37:39 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Updating instance_info_cache with network_info: [{"id": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "address": "fa:16:3e:ca:d6:ea", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010fd638-d6", "ovs_interfaceid": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:37:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-cc521d87-09aa-44ba-a87c-1cd5517b3707" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:37:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:37:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:39 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:37:39 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:37:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:37:41 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Snapshot image upload complete
Aug 15 16:37:41 user nova-compute[72849]: INFO nova.compute.manager [None req-bc64e0af-3f18-4b6c-825a-6f122471febf tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Took 5.56 seconds to snapshot the instance on the hypervisor.
Aug 15 16:37:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-20761876-c90f-4ecd-b83b-e79b08bef6d1 req-cdd80a20-f78e-48cc-89aa-0a055ac934b1 service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Received event network-changed-6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:37:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-20761876-c90f-4ecd-b83b-e79b08bef6d1 req-cdd80a20-f78e-48cc-89aa-0a055ac934b1 service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Refreshing instance network info cache due to event network-changed-6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:37:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-20761876-c90f-4ecd-b83b-e79b08bef6d1 req-cdd80a20-f78e-48cc-89aa-0a055ac934b1 service nova] Acquiring lock "refresh_cache-f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:37:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-20761876-c90f-4ecd-b83b-e79b08bef6d1 req-cdd80a20-f78e-48cc-89aa-0a055ac934b1 service nova] Acquired lock "refresh_cache-f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:37:41 user nova-compute[72849]: DEBUG nova.network.neutron [req-20761876-c90f-4ecd-b83b-e79b08bef6d1 req-cdd80a20-f78e-48cc-89aa-0a055ac934b1 service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Refreshing network info cache for port 6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:37:41 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:37:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:41 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:37:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:41 user nova-compute[72849]: DEBUG nova.network.neutron [req-20761876-c90f-4ecd-b83b-e79b08bef6d1 req-cdd80a20-f78e-48cc-89aa-0a055ac934b1 service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Updated VIF entry in instance network info cache for port 6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:37:41 user nova-compute[72849]: DEBUG nova.network.neutron [req-20761876-c90f-4ecd-b83b-e79b08bef6d1 req-cdd80a20-f78e-48cc-89aa-0a055ac934b1 service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Updating instance_info_cache with network_info: [{"id": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "address": "fa:16:3e:47:9f:55", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f0cc2-52", "ovs_interfaceid": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:37:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-20761876-c90f-4ecd-b83b-e79b08bef6d1 req-cdd80a20-f78e-48cc-89aa-0a055ac934b1 service nova] Releasing lock "refresh_cache-f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:37:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "0bddec9f-7eec-44b1-9a56-44d09512c456" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:43 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:37:43 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:37:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=7947MB free_disk=25.23068618774414GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc521d87-09aa-44ba-a87c-1cd5517b3707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f0007ddd-f25d-4708-b617-d98728f6ffcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f2f0b640-e9ae-43ba-a175-a9ab87d30c8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 5a4db694-b564-43b5-829c-08b9d54effed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 3c433846-35b4-4d82-beae-5a18f5f069fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0bddec9f-7eec-44b1-9a56-44d09512c456 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing inventories for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating ProviderTree inventory for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating inventory in ProviderTree for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing aggregate associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, aggregates: None {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 16:37:43 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing trait associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.625s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.352s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:37:44 user nova-compute[72849]: INFO nova.compute.claims [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Claim successful on node user
Aug 15 16:37:44 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:37:44 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:37:44 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG nova.policy [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97a15b3aa0e9432da4b36d52bba1a9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535e7bf486d84793aafc48b88712daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:37:44 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Creating image(s)
Aug 15 16:37:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "/opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "/opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "/opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "ad73ea786b3e534ec57424e6d8bc48dfd91cc784" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "ad73ea786b3e534ec57424e6d8bc48dfd91cc784" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784.part --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:45 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:37:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:45 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:37:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:45 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Successfully created port: 2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:37:45 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'flavor' on Instance uuid f2f0b640-e9ae-43ba-a175-a9ab87d30c8b {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:37:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "cc521d87-09aa-44ba-a87c-1cd5517b3707" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:45 user nova-compute[72849]: INFO nova.compute.manager [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Terminating instance
Aug 15 16:37:45 user nova-compute[72849]: DEBUG nova.compute.manager [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:37:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784.part --force-share --output=json" returned: 0 in 0.175s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:45 user nova-compute[72849]: DEBUG nova.virt.images [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] bd5c5fb4-905c-42c5-b836-3a0660bee99b was qcow2, converting to raw {{(pid=72849) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 16:37:45 user nova-compute[72849]: DEBUG nova.privsep.utils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72849) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 16:37:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784.part /opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784.converted {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:46 user nova-compute[72849]: INFO nova.compute.manager [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Attaching volume b1e2ce9a-e923-4633-bdec-a686473d26bf to /dev/vdb
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG os_brick.utils [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] There are 0 instances to clean {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b489d53e-92ce-4836-bb8a-091543ee99b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG nova.compute.manager [req-87072123-7ca1-41ff-8903-fae2fb54e2aa req-7714c62b-3ed1-4877-b9b4-14207e210156 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received event network-vif-unplugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87072123-7ca1-41ff-8903-fae2fb54e2aa req-7714c62b-3ed1-4877-b9b4-14207e210156 service nova] Acquiring lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87072123-7ca1-41ff-8903-fae2fb54e2aa req-7714c62b-3ed1-4877-b9b4-14207e210156 service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-87072123-7ca1-41ff-8903-fae2fb54e2aa req-7714c62b-3ed1-4877-b9b4-14207e210156 service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG nova.compute.manager [req-87072123-7ca1-41ff-8903-fae2fb54e2aa req-7714c62b-3ed1-4877-b9b4-14207e210156 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] No waiting events found dispatching network-vif-unplugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG nova.compute.manager [req-87072123-7ca1-41ff-8903-fae2fb54e2aa req-7714c62b-3ed1-4877-b9b4-14207e210156 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received event network-vif-unplugged-010fd638-d6f5-40be-b322-8d3f7b1d29de for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[54911db9-2afc-4231-beac-289fb627d1ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[382c3419-6904-4964-8a33-eeb5a183afda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[696ce277-d71c-4ca2-9148-2e8c4eb05d5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:46 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Instance destroyed successfully.
Aug 15 16:37:46 user nova-compute[72849]: DEBUG nova.objects.instance [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lazy-loading 'resources' on Instance uuid cc521d87-09aa-44ba-a87c-1cd5517b3707 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:37:46 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b74876-aa4d-4876-97fe-e7c20d75ebb1]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG os_brick.utils [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] <== get_connector_properties: return (285ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Updating existing volume attachment record: 3d32d21f-ec89-41ac-be8e-915c1334eb54 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:20:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1632196122',display_name='tempest-ServerRescueNegativeTestJSON-server-1632196122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1632196122',id=16,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:25:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63fff6abd55f4552b56b7f80f3b19990',ramdisk_id='',reservation_id='r-3orjfdvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-817230683',owner_user_name='tempest-ServerRescueNegativeTestJSON-817230683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:27:20Z,user_data=None,user_id='a6bc0fd1358a42debf05e9bc43b8e329',uuid=cc521d87-09aa-44ba-a87c-1cd5517b3707,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "address": "fa:16:3e:ca:d6:ea", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010fd638-d6", "ovs_interfaceid": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converting VIF {"id": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "address": "fa:16:3e:ca:d6:ea", "network": {"id": "cfa51eb9-1304-4858-aaa6-5a54b943aae1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085142826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fff6abd55f4552b56b7f80f3b19990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010fd638-d6", "ovs_interfaceid": "010fd638-d6f5-40be-b322-8d3f7b1d29de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:d6:ea,bridge_name='br-int',has_traffic_filtering=True,id=010fd638-d6f5-40be-b322-8d3f7b1d29de,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010fd638-d6') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG os_vif [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:d6:ea,bridge_name='br-int',has_traffic_filtering=True,id=010fd638-d6f5-40be-b322-8d3f7b1d29de,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010fd638-d6') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784.part /opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784.converted" returned: 0 in 0.667s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784.converted --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap010fd638-d6, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:37:46 user nova-compute[72849]: INFO os_vif [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:d6:ea,bridge_name='br-int',has_traffic_filtering=True,id=010fd638-d6f5-40be-b322-8d3f7b1d29de,network=Network(cfa51eb9-1304-4858-aaa6-5a54b943aae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010fd638-d6')
Aug 15 16:37:46 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Deleting instance files /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707_del
Aug 15 16:37:46 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Deletion of /opt/stack/data/nova/instances/cc521d87-09aa-44ba-a87c-1cd5517b3707_del complete
Aug 15 16:37:46 user nova-compute[72849]: INFO nova.compute.manager [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784.converted --force-share --output=json" returned: 0 in 0.221s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "ad73ea786b3e534ec57424e6d8bc48dfd91cc784" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.116s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784 --force-share --output=json" returned: 0 in 0.190s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "ad73ea786b3e534ec57424e6d8bc48dfd91cc784" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "ad73ea786b3e534ec57424e6d8bc48dfd91cc784" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784 --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784,backing_fmt=raw /opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784,backing_fmt=raw /opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/disk 1073741824" returned: 0 in 0.064s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "ad73ea786b3e534ec57424e6d8bc48dfd91cc784" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784 --force-share --output=json" returned: 0 in 0.186s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:47 user nova-compute[72849]: DEBUG nova.objects.instance [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lazy-loading 'migration_context' on Instance uuid 0bddec9f-7eec-44b1-9a56-44d09512c456 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:37:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:37:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Ensure instance console log exists: /opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:37:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:37:48 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Took 1.20 seconds to deallocate network for instance.
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.compute.manager [req-10a17c3d-672f-4570-b545-b44d9b195295 req-3f3d44a8-3ad5-4d8f-bc2b-bcc80f6778d1 service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received event network-vif-deleted-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Successfully updated port: 2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "refresh_cache-0bddec9f-7eec-44b1-9a56-44d09512c456" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquired lock "refresh_cache-0bddec9f-7eec-44b1-9a56-44d09512c456" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.compute.manager [req-668a2ca3-2813-47b8-aa26-98ae82940345 req-f4f804ce-66ba-47fc-bb47-82e08588e54d service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received event network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-668a2ca3-2813-47b8-aa26-98ae82940345 req-f4f804ce-66ba-47fc-bb47-82e08588e54d service nova] Acquiring lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-668a2ca3-2813-47b8-aa26-98ae82940345 req-f4f804ce-66ba-47fc-bb47-82e08588e54d service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-668a2ca3-2813-47b8-aa26-98ae82940345 req-f4f804ce-66ba-47fc-bb47-82e08588e54d service nova] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.compute.manager [req-668a2ca3-2813-47b8-aa26-98ae82940345 req-f4f804ce-66ba-47fc-bb47-82e08588e54d service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] No waiting events found dispatching network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:37:48 user nova-compute[72849]: WARNING nova.compute.manager [req-668a2ca3-2813-47b8-aa26-98ae82940345 req-f4f804ce-66ba-47fc-bb47-82e08588e54d service nova] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Received unexpected event network-vif-plugged-010fd638-d6f5-40be-b322-8d3f7b1d29de for instance with vm_state deleted and task_state None.
Aug 15 16:37:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:48 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Deleted allocations for instance cc521d87-09aa-44ba-a87c-1cd5517b3707
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.network.neutron [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Updating instance_info_cache with network_info: [{"id": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "address": "fa:16:3e:7d:86:81", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2913e4f1-8c", "ovs_interfaceid": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Releasing lock "refresh_cache-0bddec9f-7eec-44b1-9a56-44d09512c456" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Instance network_info: |[{"id": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "address": "fa:16:3e:7d:86:81", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2913e4f1-8c", "ovs_interfaceid": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Start _get_guest_xml network_info=[{"id": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "address": "fa:16:3e:7d:86:81", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2913e4f1-8c", "ovs_interfaceid": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='192d4331c953e55c7aaff7b2be3d2f4a',container_format='bare',created_at=2023-08-15T16:37:35Z,direct_url=<?>,disk_format='qcow2',id=bd5c5fb4-905c-42c5-b836-3a0660bee99b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-997621184',owner='535e7bf486d84793aafc48b88712daf5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T16:37:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'bd5c5fb4-905c-42c5-b836-3a0660bee99b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a4aed94-1e9b-4f0c-b237-1c334a6f726a tempest-ServerRescueNegativeTestJSON-817230683 tempest-ServerRescueNegativeTestJSON-817230683-project-member] Lock "cc521d87-09aa-44ba-a87c-1cd5517b3707" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.612s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:48 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:37:48 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='192d4331c953e55c7aaff7b2be3d2f4a',container_format='bare',created_at=2023-08-15T16:37:35Z,direct_url=<?>,disk_format='qcow2',id=bd5c5fb4-905c-42c5-b836-3a0660bee99b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-997621184',owner='535e7bf486d84793aafc48b88712daf5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T16:37:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:37:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1731701630',display_name='tempest-TestStampPattern-server-1731701630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1731701630',id=41,image_ref='bd5c5fb4-905c-42c5-b836-3a0660bee99b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMi45qmqS3JUOsCtLhOHr8dN0lAxTLLIGCYJEIKxFLRznYZlSyGaG7loxy0DXCnWZwO5buUhd7UKGlCKbbX0UVLrUyKLyamZajv/9tO6pGG+kS70g0npId3SIuDJieSVQ==',key_name='tempest-TestStampPattern-336120091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='535e7bf486d84793aafc48b88712daf5',ramdisk_id='',reservation_id='r-to4nvgww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f0007ddd-f25d-4708-b617-d98728f6ffcc',image_min_disk='1',image_min_ram='0',image_owner_id='535e7bf486d84793aafc48b88712daf5',image_owner_project_name='tempest-TestStampPattern-1132040334',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1132040334-project-member',image_user_id='97a15b3aa0e9432da4b36d52bba1a9a8',network_allocated='True',owner_project_name='tempest-TestStampPattern-1132040334',owner_user_name='tempest-TestStampPattern-1132040334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:37:45Z,user_data=None,user_id='97a15b3aa0e9432da4b36d52bba1a9a8',uuid=0bddec9f-7eec-44b1-9a56-44d09512c456,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "address": "fa:16:3e:7d:86:81", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2913e4f1-8c", "ovs_interfaceid": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Converting VIF {"id": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "address": "fa:16:3e:7d:86:81", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2913e4f1-8c", "ovs_interfaceid": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:86:81,bridge_name='br-int',has_traffic_filtering=True,id=2913e4f1-8c8c-4ac7-a159-835838a33e70,network=Network(07227fb5-780c-4de1-8211-f2ac91fd1908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2913e4f1-8c') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.objects.instance [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bddec9f-7eec-44b1-9a56-44d09512c456 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:37:48 user nova-compute[72849]:   <uuid>0bddec9f-7eec-44b1-9a56-44d09512c456</uuid>
Aug 15 16:37:48 user nova-compute[72849]:   <name>instance-00000029</name>
Aug 15 16:37:48 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:37:48 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:37:48 user nova-compute[72849]:   <metadata>
Aug 15 16:37:48 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:37:48 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:37:48 user nova-compute[72849]:       <nova:name>tempest-TestStampPattern-server-1731701630</nova:name>
Aug 15 16:37:48 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:37:48</nova:creationTime>
Aug 15 16:37:48 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:37:48 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:37:48 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:37:48 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:37:48 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:37:48 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:37:48 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:37:48 user nova-compute[72849]:       <nova:owner>
Aug 15 16:37:48 user nova-compute[72849]:         <nova:user uuid="97a15b3aa0e9432da4b36d52bba1a9a8">tempest-TestStampPattern-1132040334-project-member</nova:user>
Aug 15 16:37:48 user nova-compute[72849]:         <nova:project uuid="535e7bf486d84793aafc48b88712daf5">tempest-TestStampPattern-1132040334</nova:project>
Aug 15 16:37:48 user nova-compute[72849]:       </nova:owner>
Aug 15 16:37:48 user nova-compute[72849]:       <nova:root type="image" uuid="bd5c5fb4-905c-42c5-b836-3a0660bee99b"/>
Aug 15 16:37:48 user nova-compute[72849]:       <nova:ports>
Aug 15 16:37:48 user nova-compute[72849]:         <nova:port uuid="2913e4f1-8c8c-4ac7-a159-835838a33e70">
Aug 15 16:37:48 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 16:37:48 user nova-compute[72849]:         </nova:port>
Aug 15 16:37:48 user nova-compute[72849]:       </nova:ports>
Aug 15 16:37:48 user nova-compute[72849]:     </nova:instance>
Aug 15 16:37:48 user nova-compute[72849]:   </metadata>
Aug 15 16:37:48 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:37:48 user nova-compute[72849]:     <system>
Aug 15 16:37:48 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:37:48 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:37:48 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:37:48 user nova-compute[72849]:       <entry name="serial">0bddec9f-7eec-44b1-9a56-44d09512c456</entry>
Aug 15 16:37:48 user nova-compute[72849]:       <entry name="uuid">0bddec9f-7eec-44b1-9a56-44d09512c456</entry>
Aug 15 16:37:48 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:37:48 user nova-compute[72849]:     </system>
Aug 15 16:37:48 user nova-compute[72849]:   </sysinfo>
Aug 15 16:37:48 user nova-compute[72849]:   <os>
Aug 15 16:37:48 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:37:48 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:37:48 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:37:48 user nova-compute[72849]:   </os>
Aug 15 16:37:48 user nova-compute[72849]:   <features>
Aug 15 16:37:48 user nova-compute[72849]:     <acpi/>
Aug 15 16:37:48 user nova-compute[72849]:     <apic/>
Aug 15 16:37:48 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:37:48 user nova-compute[72849]:   </features>
Aug 15 16:37:48 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:37:48 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:37:48 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:37:48 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:37:48 user nova-compute[72849]:   </clock>
Aug 15 16:37:48 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:37:48 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:37:48 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:37:48 user nova-compute[72849]:   </cpu>
Aug 15 16:37:48 user nova-compute[72849]:   <devices>
Aug 15 16:37:48 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:37:48 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:37:48 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/disk"/>
Aug 15 16:37:48 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:37:48 user nova-compute[72849]:     </disk>
Aug 15 16:37:48 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:37:48 user nova-compute[72849]:       <mac address="fa:16:3e:7d:86:81"/>
Aug 15 16:37:48 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:37:48 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:37:48 user nova-compute[72849]:       <target dev="tap2913e4f1-8c"/>
Aug 15 16:37:48 user nova-compute[72849]:     </interface>
Aug 15 16:37:48 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:37:48 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/console.log" append="off"/>
Aug 15 16:37:48 user nova-compute[72849]:     </serial>
Aug 15 16:37:48 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:37:48 user nova-compute[72849]:     <video>
Aug 15 16:37:48 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:37:48 user nova-compute[72849]:     </video>
Aug 15 16:37:48 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:37:48 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:37:48 user nova-compute[72849]:     </rng>
Aug 15 16:37:48 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:37:48 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:37:48 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:37:48 user nova-compute[72849]:     </memballoon>
Aug 15 16:37:48 user nova-compute[72849]:   </devices>
Aug 15 16:37:48 user nova-compute[72849]: </domain>
Aug 15 16:37:48 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:37:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1731701630',display_name='tempest-TestStampPattern-server-1731701630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1731701630',id=41,image_ref='bd5c5fb4-905c-42c5-b836-3a0660bee99b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMi45qmqS3JUOsCtLhOHr8dN0lAxTLLIGCYJEIKxFLRznYZlSyGaG7loxy0DXCnWZwO5buUhd7UKGlCKbbX0UVLrUyKLyamZajv/9tO6pGG+kS70g0npId3SIuDJieSVQ==',key_name='tempest-TestStampPattern-336120091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='535e7bf486d84793aafc48b88712daf5',ramdisk_id='',reservation_id='r-to4nvgww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f0007ddd-f25d-4708-b617-d98728f6ffcc',image_min_disk='1',image_min_ram='0',image_owner_id='535e7bf486d84793aafc48b88712daf5',image_owner_project_name='tempest-TestStampPattern-1132040334',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1132040334-project-member',image_user_id='97a15b3aa0e9432da4b36d52bba1a9a8',network_allocated='True',owner_project_name='tempest-TestStampPattern-1132040334',owner_user_name='tempest-TestStampPattern-1132040334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:37:45Z,user_data=None,user_id='97a15b3aa0e9432da4b36d52bba1a9a8',uuid=0bddec9f-7eec-44b1-9a56-44d09512c456,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "address": "fa:16:3e:7d:86:81", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2913e4f1-8c", "ovs_interfaceid": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Converting VIF {"id": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "address": "fa:16:3e:7d:86:81", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2913e4f1-8c", "ovs_interfaceid": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:86:81,bridge_name='br-int',has_traffic_filtering=True,id=2913e4f1-8c8c-4ac7-a159-835838a33e70,network=Network(07227fb5-780c-4de1-8211-f2ac91fd1908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2913e4f1-8c') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG os_vif [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:86:81,bridge_name='br-int',has_traffic_filtering=True,id=2913e4f1-8c8c-4ac7-a159-835838a33e70,network=Network(07227fb5-780c-4de1-8211-f2ac91fd1908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2913e4f1-8c') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2913e4f1-8c, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2913e4f1-8c, col_values=(('external_ids', {'iface-id': '2913e4f1-8c8c-4ac7-a159-835838a33e70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:86:81', 'vm-uuid': '0bddec9f-7eec-44b1-9a56-44d09512c456'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:48 user nova-compute[72849]: INFO os_vif [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:86:81,bridge_name='br-int',has_traffic_filtering=True,id=2913e4f1-8c8c-4ac7-a159-835838a33e70,network=Network(07227fb5-780c-4de1-8211-f2ac91fd1908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2913e4f1-8c')
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:37:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] No VIF found with MAC fa:16:3e:7d:86:81, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:37:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:50 user nova-compute[72849]: DEBUG nova.compute.manager [req-f803d3eb-a375-41af-8c5a-f714132f4430 req-e76f9d30-ccec-4816-9987-b334e28c8311 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Received event network-changed-2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:37:50 user nova-compute[72849]: DEBUG nova.compute.manager [req-f803d3eb-a375-41af-8c5a-f714132f4430 req-e76f9d30-ccec-4816-9987-b334e28c8311 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Refreshing instance network info cache due to event network-changed-2913e4f1-8c8c-4ac7-a159-835838a33e70. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:37:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f803d3eb-a375-41af-8c5a-f714132f4430 req-e76f9d30-ccec-4816-9987-b334e28c8311 service nova] Acquiring lock "refresh_cache-0bddec9f-7eec-44b1-9a56-44d09512c456" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:37:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f803d3eb-a375-41af-8c5a-f714132f4430 req-e76f9d30-ccec-4816-9987-b334e28c8311 service nova] Acquired lock "refresh_cache-0bddec9f-7eec-44b1-9a56-44d09512c456" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:37:50 user nova-compute[72849]: DEBUG nova.network.neutron [req-f803d3eb-a375-41af-8c5a-f714132f4430 req-e76f9d30-ccec-4816-9987-b334e28c8311 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Refreshing network info cache for port 2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:37:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:50 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:37:50 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72849) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 16:37:50 user nova-compute[72849]: DEBUG nova.network.neutron [req-f803d3eb-a375-41af-8c5a-f714132f4430 req-e76f9d30-ccec-4816-9987-b334e28c8311 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Updated VIF entry in instance network info cache for port 2913e4f1-8c8c-4ac7-a159-835838a33e70. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:37:50 user nova-compute[72849]: DEBUG nova.network.neutron [req-f803d3eb-a375-41af-8c5a-f714132f4430 req-e76f9d30-ccec-4816-9987-b334e28c8311 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Updating instance_info_cache with network_info: [{"id": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "address": "fa:16:3e:7d:86:81", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2913e4f1-8c", "ovs_interfaceid": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:37:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f803d3eb-a375-41af-8c5a-f714132f4430 req-e76f9d30-ccec-4816-9987-b334e28c8311 service nova] Releasing lock "refresh_cache-0bddec9f-7eec-44b1-9a56-44d09512c456" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:37:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-4d2befa0-f164-477c-a61b-a4eecc802375 req-4d20e63f-b858-4fe1-8f41-f56ba036c3ca service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Received event network-vif-plugged-2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:37:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4d2befa0-f164-477c-a61b-a4eecc802375 req-4d20e63f-b858-4fe1-8f41-f56ba036c3ca service nova] Acquiring lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4d2befa0-f164-477c-a61b-a4eecc802375 req-4d20e63f-b858-4fe1-8f41-f56ba036c3ca service nova] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4d2befa0-f164-477c-a61b-a4eecc802375 req-4d20e63f-b858-4fe1-8f41-f56ba036c3ca service nova] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-4d2befa0-f164-477c-a61b-a4eecc802375 req-4d20e63f-b858-4fe1-8f41-f56ba036c3ca service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] No waiting events found dispatching network-vif-plugged-2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:37:52 user nova-compute[72849]: WARNING nova.compute.manager [req-4d2befa0-f164-477c-a61b-a4eecc802375 req-4d20e63f-b858-4fe1-8f41-f56ba036c3ca service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Received unexpected event network-vif-plugged-2913e4f1-8c8c-4ac7-a159-835838a33e70 for instance with vm_state building and task_state spawning.
Aug 15 16:37:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-4d2befa0-f164-477c-a61b-a4eecc802375 req-4d20e63f-b858-4fe1-8f41-f56ba036c3ca service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Received event network-vif-plugged-2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:37:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4d2befa0-f164-477c-a61b-a4eecc802375 req-4d20e63f-b858-4fe1-8f41-f56ba036c3ca service nova] Acquiring lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:37:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4d2befa0-f164-477c-a61b-a4eecc802375 req-4d20e63f-b858-4fe1-8f41-f56ba036c3ca service nova] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:37:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4d2befa0-f164-477c-a61b-a4eecc802375 req-4d20e63f-b858-4fe1-8f41-f56ba036c3ca service nova] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-4d2befa0-f164-477c-a61b-a4eecc802375 req-4d20e63f-b858-4fe1-8f41-f56ba036c3ca service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] No waiting events found dispatching network-vif-plugged-2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:37:52 user nova-compute[72849]: WARNING nova.compute.manager [req-4d2befa0-f164-477c-a61b-a4eecc802375 req-4d20e63f-b858-4fe1-8f41-f56ba036c3ca service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Received unexpected event network-vif-plugged-2913e4f1-8c8c-4ac7-a159-835838a33e70 for instance with vm_state building and task_state spawning.
Aug 15 16:37:52 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117472.4071088, 0bddec9f-7eec-44b1-9a56-44d09512c456 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:37:52 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] VM Resumed (Lifecycle Event)
Aug 15 16:37:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:37:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:37:52 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Instance spawned successfully.
Aug 15 16:37:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:37:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:37:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:37:52 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:37:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:37:52 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:37:52 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117472.412558, 0bddec9f-7eec-44b1-9a56-44d09512c456 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:37:52 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] VM Started (Lifecycle Event)
Aug 15 16:37:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:37:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:37:52 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:37:52 user nova-compute[72849]: INFO nova.compute.manager [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Took 7.75 seconds to spawn the instance on the hypervisor.
Aug 15 16:37:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:37:52 user nova-compute[72849]: INFO nova.compute.manager [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Took 9.04 seconds to build instance.
Aug 15 16:37:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a43b876d-db6d-4c78-94e0-b349f8a503bb tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.152s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:37:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egkUEcXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:37:55 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:37:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:37:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:37:55 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:37:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:37:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:37:55 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:37:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bde9ee1-bed3-4048-b312-5d2e2820be3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:37:56 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8daf630c-ab83-425b-a3f3-9093003205b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf] added
Aug 15 16:37:56 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdca9fe8-ce30-431a-a63e-a9bef9b3ff32]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0453eada-d858-478f-8d3a-c9e40087c3a1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egkUEcXN {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egkUEcXN" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cb2b7b-cb2a-4bba-b5b7-4363040a7771]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'egkUEcXN'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8157cacf-816e-4d16-bc9d-9405ab50e600]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e4f38d-0374-4b67-a022-fd165ea94e19]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:37:56 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:37:56 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cba0b8a-162f-461c-98c0-75bcb153a74a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf, portal: 172.16.0.220,3260]
Aug 15 16:37:56 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf, portal: 172.16.0.220,3260] successful.
Aug 15 16:37:56 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec109abf-04c6-406e-a44f-212aa0972d08]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[960626ab-0be6-4b4c-bb60-810226f8b881]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:37:56 user nova-compute[72849]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf (non-flash)
Aug 15 16:37:56 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:37:56 user nova-compute[72849]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf (non-flash)
Aug 15 16:37:56 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0f51c3-4afb-490a-bd67-951f91fc2f6a]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:37:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egkUEcXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:37:57 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:37:57 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23333373465343932', 'path': '/dev/sdc'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:37:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333373465343932', 'path': '/dev/sdc'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:37:57 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'flavor' on Instance uuid f2f0b640-e9ae-43ba-a175-a9ab87d30c8b {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:37:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:37:57 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:37:57 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:37:57 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:37:57 user nova-compute[72849]:   <serial>b1e2ce9a-e923-4633-bdec-a686473d26bf</serial>
Aug 15 16:37:57 user nova-compute[72849]: </disk>
Aug 15 16:37:57 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:37:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:37:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:37:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] No VIF found with MAC fa:16:3e:47:9f:55, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:37:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ac9689de-2979-48f1-b6f9-c427a2b8c5ab tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.699s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:37:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:37:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:01 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117466.532013, cc521d87-09aa-44ba-a87c-1cd5517b3707 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:38:01 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] VM Stopped (Lifecycle Event)
Aug 15 16:38:01 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5aa899ad-1d64-409d-8981-177977168885 None None] [instance: cc521d87-09aa-44ba-a87c-1cd5517b3707] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:38:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "4b9f21bc-836f-4095-9eb3-d3971d418363" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:02 user nova-compute[72849]: INFO nova.compute.manager [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Unshelving
Aug 15 16:38:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:02 user nova-compute[72849]: DEBUG nova.objects.instance [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'pci_requests' on Instance uuid 4b9f21bc-836f-4095-9eb3-d3971d418363 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:38:02 user nova-compute[72849]: DEBUG nova.objects.instance [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'numa_topology' on Instance uuid 4b9f21bc-836f-4095-9eb3-d3971d418363 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:38:02 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:38:02 user nova-compute[72849]: INFO nova.compute.claims [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Claim successful on node user
Aug 15 16:38:02 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:38:02 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:38:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:02 user nova-compute[72849]: INFO nova.network.neutron [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Updating port cb180f95-0817-4f21-807c-4a96a65e4062 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG nova.objects.instance [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'flavor' on Instance uuid f2f0b640-e9ae-43ba-a175-a9ab87d30c8b {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:03 user nova-compute[72849]: INFO nova.compute.manager [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Attaching volume 9d7ad6d6-8835-4387-9aa8-aad2d05c609e to /dev/vdc
Aug 15 16:38:03 user nova-compute[72849]: DEBUG os_brick.utils [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b3d13f-1a84-4ca4-b1dd-952615437dc7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bf8dde-e295-4729-abd4-aa1ff8b612bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[399f7b78-8740-48b4-b984-4c8e24b3e063]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[66af5c93-d540-4f7a-bc41-098d0260cfbd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:38:03 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f089b9d-b88a-4d4f-ab24-8c4ca4e8c51b]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG os_brick.utils [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Updating existing volume attachment record: 42280d5e-d2c0-4a9e-a737-a16cd32277f8 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquired lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:38:03 user nova-compute[72849]: DEBUG nova.network.neutron [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:38:04 user nova-compute[72849]: DEBUG nova.compute.manager [req-df7371f9-0f62-4c5f-826c-7c3dc19f9d8c req-82e8dfc5-df1b-40b8-aed5-845b43a81416 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received event network-changed-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:38:04 user nova-compute[72849]: DEBUG nova.compute.manager [req-df7371f9-0f62-4c5f-826c-7c3dc19f9d8c req-82e8dfc5-df1b-40b8-aed5-845b43a81416 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Refreshing instance network info cache due to event network-changed-cb180f95-0817-4f21-807c-4a96a65e4062. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:38:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-df7371f9-0f62-4c5f-826c-7c3dc19f9d8c req-82e8dfc5-df1b-40b8-aed5-845b43a81416 service nova] Acquiring lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:38:04 user nova-compute[72849]: DEBUG nova.network.neutron [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Updating instance_info_cache with network_info: [{"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:38:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Releasing lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:38:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:38:04 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Creating image(s)
Aug 15 16:38:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "/opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "/opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:04 user nova-compute[72849]: DEBUG nova.objects.instance [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4b9f21bc-836f-4095-9eb3-d3971d418363 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:38:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-df7371f9-0f62-4c5f-826c-7c3dc19f9d8c req-82e8dfc5-df1b-40b8-aed5-845b43a81416 service nova] Acquired lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:38:04 user nova-compute[72849]: DEBUG nova.network.neutron [req-df7371f9-0f62-4c5f-826c-7c3dc19f9d8c req-82e8dfc5-df1b-40b8-aed5-845b43a81416 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Refreshing network info cache for port cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:38:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "80c52bfad9db378496e6680225be6aad486b5858" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "80c52bfad9db378496e6680225be6aad486b5858" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858.part --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858.part --force-share --output=json" returned: 0 in 0.190s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:05 user nova-compute[72849]: DEBUG nova.virt.images [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] 7681b178-f6df-4e08-8bf7-9bfc816167ed was qcow2, converting to raw {{(pid=72849) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 16:38:05 user nova-compute[72849]: DEBUG nova.privsep.utils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72849) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 16:38:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858.part /opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858.converted {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:06 user nova-compute[72849]: DEBUG nova.network.neutron [req-df7371f9-0f62-4c5f-826c-7c3dc19f9d8c req-82e8dfc5-df1b-40b8-aed5-845b43a81416 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Updated VIF entry in instance network info cache for port cb180f95-0817-4f21-807c-4a96a65e4062. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:38:06 user nova-compute[72849]: DEBUG nova.network.neutron [req-df7371f9-0f62-4c5f-826c-7c3dc19f9d8c req-82e8dfc5-df1b-40b8-aed5-845b43a81416 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Updating instance_info_cache with network_info: [{"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:38:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-df7371f9-0f62-4c5f-826c-7c3dc19f9d8c req-82e8dfc5-df1b-40b8-aed5-845b43a81416 service nova] Releasing lock "refresh_cache-4b9f21bc-836f-4095-9eb3-d3971d418363" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:38:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858.part /opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858.converted" returned: 0 in 0.604s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858.converted --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "80c52bfad9db378496e6680225be6aad486b5858" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.240s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858 --force-share --output=json" returned: 0 in 0.184s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "80c52bfad9db378496e6680225be6aad486b5858" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "80c52bfad9db378496e6680225be6aad486b5858" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858 --force-share --output=json" returned: 0 in 0.173s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858,backing_fmt=raw /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858,backing_fmt=raw /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk 1073741824" returned: 0 in 0.055s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "80c52bfad9db378496e6680225be6aad486b5858" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858 --force-share --output=json" returned: 0 in 0.203s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:07 user nova-compute[72849]: DEBUG nova.objects.instance [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'migration_context' on Instance uuid 4b9f21bc-836f-4095-9eb3-d3971d418363 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:38:07 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Rebasing disk image.
Aug 15 16:38:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.200s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 -F raw /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:38:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 -F raw /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk" returned: 0 in 2.541s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Ensure instance console log exists: /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Start _get_guest_xml network_info=[{"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1f2c5704e245a12c0eb7f765cafebcf0',container_format='bare',created_at=2023-08-15T16:36:09Z,direct_url=<?>,disk_format='qcow2',id=7681b178-f6df-4e08-8bf7-9bfc816167ed,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1489512197-shelved',owner='1bb636c3c71c479d90cf2e170db941e1',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-15T16:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:38:10 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:38:10 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1f2c5704e245a12c0eb7f765cafebcf0',container_format='bare',created_at=2023-08-15T16:36:09Z,direct_url=<?>,disk_format='qcow2',id=7681b178-f6df-4e08-8bf7-9bfc816167ed,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1489512197-shelved',owner='1bb636c3c71c479d90cf2e170db941e1',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-15T16:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.objects.instance [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4b9f21bc-836f-4095-9eb3-d3971d418363 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T16:34:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1489512197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1489512197',id=36,image_ref='7681b178-f6df-4e08-8bf7-9bfc816167ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1622612503',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:34:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1bb636c3c71c479d90cf2e170db941e1',ramdisk_id='',reservation_id='r-ti7scmj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1263463439',owner_user_name='tempest-AttachVolumeShelveTestJSON-1263463439-project-member',shelved_at='2023-08-15T16:36:13.361270',shelved_host='user',shelved_image_id='7681b178-f6df-4e08-8bf7-9bfc816167ed'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:38:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867f247fc90437899a13a7451a3249a',uuid=4b9f21bc-836f-4095-9eb3-d3971d418363,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converting VIF {"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:b5:7a,bridge_name='br-int',has_traffic_filtering=True,id=cb180f95-0817-4f21-807c-4a96a65e4062,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb180f95-08') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.objects.instance [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b9f21bc-836f-4095-9eb3-d3971d418363 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:38:10 user nova-compute[72849]:   <uuid>4b9f21bc-836f-4095-9eb3-d3971d418363</uuid>
Aug 15 16:38:10 user nova-compute[72849]:   <name>instance-00000024</name>
Aug 15 16:38:10 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:38:10 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:38:10 user nova-compute[72849]:   <metadata>
Aug 15 16:38:10 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:38:10 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:38:10 user nova-compute[72849]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1489512197</nova:name>
Aug 15 16:38:10 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:38:10</nova:creationTime>
Aug 15 16:38:10 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:38:10 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:38:10 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:38:10 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:38:10 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:38:10 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:38:10 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:38:10 user nova-compute[72849]:       <nova:owner>
Aug 15 16:38:10 user nova-compute[72849]:         <nova:user uuid="e867f247fc90437899a13a7451a3249a">tempest-AttachVolumeShelveTestJSON-1263463439-project-member</nova:user>
Aug 15 16:38:10 user nova-compute[72849]:         <nova:project uuid="1bb636c3c71c479d90cf2e170db941e1">tempest-AttachVolumeShelveTestJSON-1263463439</nova:project>
Aug 15 16:38:10 user nova-compute[72849]:       </nova:owner>
Aug 15 16:38:10 user nova-compute[72849]:       <nova:root type="image" uuid="7681b178-f6df-4e08-8bf7-9bfc816167ed"/>
Aug 15 16:38:10 user nova-compute[72849]:       <nova:ports>
Aug 15 16:38:10 user nova-compute[72849]:         <nova:port uuid="cb180f95-0817-4f21-807c-4a96a65e4062">
Aug 15 16:38:10 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:38:10 user nova-compute[72849]:         </nova:port>
Aug 15 16:38:10 user nova-compute[72849]:       </nova:ports>
Aug 15 16:38:10 user nova-compute[72849]:     </nova:instance>
Aug 15 16:38:10 user nova-compute[72849]:   </metadata>
Aug 15 16:38:10 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:38:10 user nova-compute[72849]:     <system>
Aug 15 16:38:10 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:38:10 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:38:10 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:38:10 user nova-compute[72849]:       <entry name="serial">4b9f21bc-836f-4095-9eb3-d3971d418363</entry>
Aug 15 16:38:10 user nova-compute[72849]:       <entry name="uuid">4b9f21bc-836f-4095-9eb3-d3971d418363</entry>
Aug 15 16:38:10 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:38:10 user nova-compute[72849]:     </system>
Aug 15 16:38:10 user nova-compute[72849]:   </sysinfo>
Aug 15 16:38:10 user nova-compute[72849]:   <os>
Aug 15 16:38:10 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:38:10 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:38:10 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:38:10 user nova-compute[72849]:   </os>
Aug 15 16:38:10 user nova-compute[72849]:   <features>
Aug 15 16:38:10 user nova-compute[72849]:     <acpi/>
Aug 15 16:38:10 user nova-compute[72849]:     <apic/>
Aug 15 16:38:10 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:38:10 user nova-compute[72849]:   </features>
Aug 15 16:38:10 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:38:10 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:38:10 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:38:10 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:38:10 user nova-compute[72849]:   </clock>
Aug 15 16:38:10 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:38:10 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:38:10 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:38:10 user nova-compute[72849]:   </cpu>
Aug 15 16:38:10 user nova-compute[72849]:   <devices>
Aug 15 16:38:10 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:38:10 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:38:10 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk"/>
Aug 15 16:38:10 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:38:10 user nova-compute[72849]:     </disk>
Aug 15 16:38:10 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:38:10 user nova-compute[72849]:       <mac address="fa:16:3e:ea:b5:7a"/>
Aug 15 16:38:10 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:38:10 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:38:10 user nova-compute[72849]:       <target dev="tapcb180f95-08"/>
Aug 15 16:38:10 user nova-compute[72849]:     </interface>
Aug 15 16:38:10 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:38:10 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/console.log" append="off"/>
Aug 15 16:38:10 user nova-compute[72849]:     </serial>
Aug 15 16:38:10 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:38:10 user nova-compute[72849]:     <video>
Aug 15 16:38:10 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:38:10 user nova-compute[72849]:     </video>
Aug 15 16:38:10 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:38:10 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:38:10 user nova-compute[72849]:     </rng>
Aug 15 16:38:10 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:38:10 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:38:10 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:38:10 user nova-compute[72849]:     </memballoon>
Aug 15 16:38:10 user nova-compute[72849]:   </devices>
Aug 15 16:38:10 user nova-compute[72849]: </domain>
Aug 15 16:38:10 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T16:34:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1489512197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1489512197',id=36,image_ref='7681b178-f6df-4e08-8bf7-9bfc816167ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1622612503',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:34:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1bb636c3c71c479d90cf2e170db941e1',ramdisk_id='',reservation_id='r-ti7scmj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1263463439',owner_user_name='tempest-AttachVolumeShelveTestJSON-1263463439-project-member',shelved_at='2023-08-15T16:36:13.361270',shelved_host='user',shelved_image_id='7681b178-f6df-4e08-8bf7-9bfc816167ed'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:38:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867f247fc90437899a13a7451a3249a',uuid=4b9f21bc-836f-4095-9eb3-d3971d418363,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converting VIF {"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:b5:7a,bridge_name='br-int',has_traffic_filtering=True,id=cb180f95-0817-4f21-807c-4a96a65e4062,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb180f95-08') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG os_vif [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:b5:7a,bridge_name='br-int',has_traffic_filtering=True,id=cb180f95-0817-4f21-807c-4a96a65e4062,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb180f95-08') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb180f95-08, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb180f95-08, col_values=(('external_ids', {'iface-id': 'cb180f95-0817-4f21-807c-4a96a65e4062', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:b5:7a', 'vm-uuid': '4b9f21bc-836f-4095-9eb3-d3971d418363'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:10 user nova-compute[72849]: INFO os_vif [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:b5:7a,bridge_name='br-int',has_traffic_filtering=True,id=cb180f95-0817-4f21-807c-4a96a65e4062,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb180f95-08')
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:38:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] No VIF found with MAC fa:16:3e:ea:b5:7a, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:38:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-6eb02511-29cd-455a-af2c-99fb6359ea91 req-19916239-703a-4ef8-93d7-6fe00157805e service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received event network-vif-plugged-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:38:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6eb02511-29cd-455a-af2c-99fb6359ea91 req-19916239-703a-4ef8-93d7-6fe00157805e service nova] Acquiring lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6eb02511-29cd-455a-af2c-99fb6359ea91 req-19916239-703a-4ef8-93d7-6fe00157805e service nova] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6eb02511-29cd-455a-af2c-99fb6359ea91 req-19916239-703a-4ef8-93d7-6fe00157805e service nova] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-6eb02511-29cd-455a-af2c-99fb6359ea91 req-19916239-703a-4ef8-93d7-6fe00157805e service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] No waiting events found dispatching network-vif-plugged-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:38:12 user nova-compute[72849]: WARNING nova.compute.manager [req-6eb02511-29cd-455a-af2c-99fb6359ea91 req-19916239-703a-4ef8-93d7-6fe00157805e service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received unexpected event network-vif-plugged-cb180f95-0817-4f21-807c-4a96a65e4062 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 16:38:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTjuZhqJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:38:13 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:38:13 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:38:13 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c443bef-7fb8-4d03-a045-7801e9a35eb6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:38:13 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e952c56-eeb7-45ba-9277-ba63a23eb694]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e] added
Aug 15 16:38:13 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f0961e-c23e-46c3-8eaf-455930bad603]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c69f7c5-0a12-4bce-a014-36f7b5974774]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HTjuZhqJ {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HTjuZhqJ" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[891f0cc9-1e46-4b40-aa85-c1d7681e4f1f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HTjuZhqJ'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd4436d-f101-4478-9c97-f624a73bf3e3]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[170cfa00-1756-42df-9190-df2978b5caef]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:38:13 user nova-compute[72849]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf (non-flash)
Aug 15 16:38:13 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:38:13 user nova-compute[72849]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf (non-flash)
Aug 15 16:38:13 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0738ee-da64-4bd8-bc2a-682cb4cefdbf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e, portal: 172.16.0.220,3260]
Aug 15 16:38:13 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e, portal: 172.16.0.220,3260] successful.
Aug 15 16:38:13 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85c3fcc-e60c-4b8b-95c6-159d64f284af]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed83eae3-b57b-4f64-aa61-fa1e84eb0c38]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:38:13 user nova-compute[72849]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf (non-flash)
Aug 15 16:38:13 user nova-compute[72849]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e (non-flash)
Aug 15 16:38:13 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:38:13 user nova-compute[72849]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf (non-flash)
Aug 15 16:38:13 user nova-compute[72849]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e (non-flash)
Aug 15 16:38:13 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d4cb6f-646c-48f7-bcd3-603104ca06b1]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:13 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: None {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:38:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:14 user nova-compute[72849]: DEBUG nova.compute.manager [req-994a7a31-8229-4338-99c2-4da49ca2f0b3 req-f04108c3-92c1-4d89-88fa-51e3b5e210c9 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received event network-vif-plugged-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:38:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-994a7a31-8229-4338-99c2-4da49ca2f0b3 req-f04108c3-92c1-4d89-88fa-51e3b5e210c9 service nova] Acquiring lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-994a7a31-8229-4338-99c2-4da49ca2f0b3 req-f04108c3-92c1-4d89-88fa-51e3b5e210c9 service nova] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-994a7a31-8229-4338-99c2-4da49ca2f0b3 req-f04108c3-92c1-4d89-88fa-51e3b5e210c9 service nova] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:14 user nova-compute[72849]: DEBUG nova.compute.manager [req-994a7a31-8229-4338-99c2-4da49ca2f0b3 req-f04108c3-92c1-4d89-88fa-51e3b5e210c9 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] No waiting events found dispatching network-vif-plugged-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:38:14 user nova-compute[72849]: WARNING nova.compute.manager [req-994a7a31-8229-4338-99c2-4da49ca2f0b3 req-f04108c3-92c1-4d89-88fa-51e3b5e210c9 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received unexpected event network-vif-plugged-cb180f95-0817-4f21-807c-4a96a65e4062 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 16:38:14 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117494.193844, 4b9f21bc-836f-4095-9eb3-d3971d418363 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:38:14 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] VM Resumed (Lifecycle Event)
Aug 15 16:38:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:38:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:38:14 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Instance spawned successfully.
Aug 15 16:38:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:38:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:38:14 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:38:14 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117494.1952417, 4b9f21bc-836f-4095-9eb3-d3971d418363 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:38:14 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] VM Started (Lifecycle Event)
Aug 15 16:38:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:38:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:38:14 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:38:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:38:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-65fc8202-812e-4888-9edc-cb6215298803 tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.179s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:14 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:38:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTjuZhqJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:38:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:38:14 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26633623139353431', 'path': '/dev/sdd'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:38:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633623139353431', 'path': '/dev/sdd'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:38:14 user nova-compute[72849]: DEBUG nova.objects.instance [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'flavor' on Instance uuid f2f0b640-e9ae-43ba-a175-a9ab87d30c8b {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:38:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:38:14 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:38:14 user nova-compute[72849]:   <source dev="/dev/sdd"/>
Aug 15 16:38:14 user nova-compute[72849]:   <target dev="vdc" bus="virtio"/>
Aug 15 16:38:14 user nova-compute[72849]:   <serial>9d7ad6d6-8835-4387-9aa8-aad2d05c609e</serial>
Aug 15 16:38:14 user nova-compute[72849]: </disk>
Aug 15 16:38:14 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:38:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:38:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:38:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:38:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] No VIF found with MAC fa:16:3e:47:9f:55, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:38:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f63f9901-e37f-4898-a5aa-caee8f0975a4 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.926s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:16 user nova-compute[72849]: INFO nova.compute.manager [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Detaching volume b1e2ce9a-e923-4633-bdec-a686473d26bf
Aug 15 16:38:16 user nova-compute[72849]: INFO nova.virt.block_device [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Attempting to driver detach volume b1e2ce9a-e923-4633-bdec-a686473d26bf from mountpoint /dev/vdb
Aug 15 16:38:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Attempting to detach device vdb from instance f2f0b640-e9ae-43ba-a175-a9ab87d30c8b from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:38:16 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:38:16 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:38:16 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:38:16 user nova-compute[72849]:   <serial>b1e2ce9a-e923-4633-bdec-a686473d26bf</serial>
Aug 15 16:38:16 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:38:16 user nova-compute[72849]: </disk>
Aug 15 16:38:16 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:38:16 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Successfully detached device vdb from instance f2f0b640-e9ae-43ba-a175-a9ab87d30c8b from the persistent domain config.
Aug 15 16:38:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f2f0b640-e9ae-43ba-a175-a9ab87d30c8b from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:38:16 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:38:16 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:38:16 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:38:16 user nova-compute[72849]:   <serial>b1e2ce9a-e923-4633-bdec-a686473d26bf</serial>
Aug 15 16:38:16 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:38:16 user nova-compute[72849]: </disk>
Aug 15 16:38:16 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692117496.6422315, f2f0b640-e9ae-43ba-a175-a9ab87d30c8b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f2f0b640-e9ae-43ba-a175-a9ab87d30c8b {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:38:16 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Successfully detached device vdb from instance f2f0b640-e9ae-43ba-a175-a9ab87d30c8b from the live domain config.
Aug 15 16:38:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egkUEcXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:38:16 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:38:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b698a718-c322-45ec-818a-a372c33a3c31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba531e8c-4e92-4891-92c2-8b8882c429b8]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:38:16 user nova-compute[72849]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf (non-flash)
Aug 15 16:38:16 user nova-compute[72849]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e (non-flash)
Aug 15 16:38:16 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:38:16 user nova-compute[72849]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf (non-flash)
Aug 15 16:38:16 user nova-compute[72849]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e (non-flash)
Aug 15 16:38:16 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3387a0280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf'): ({'sdc'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Removing single pathed devices sdc {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8618946-6bc8-4595-ab91-c90861fdc7a1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0438c979-e1e0-4767-a969-4bad4c36cb85]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Flushing IO for device /dev/sdc {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a3076a-c155-4bfb-810e-3251d8ec5163]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[79549cf6-e70a-4fc8-b284-96a9f31c39d5]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf1344a-952c-47cf-b89f-dd66c2982324]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[17667be2-4e90-414d-88a5-5221676f6468]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf, portal: 172.16.0.220,3260]
Aug 15 16:38:16 user nova-compute[72849]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf, portal: 172.16.0.220,3260] successful.
Aug 15 16:38:16 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2ce9a-e923-4633-bdec-a686473d26bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[192069c2-f6c0-48b0-9afc-99d3f5bb78c5]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] <== disconnect_volume: return (306ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:38:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:38:17 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'flavor' on Instance uuid f2f0b640-e9ae-43ba-a175-a9ab87d30c8b {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:38:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73a498fc-fdb6-4238-813b-ab2c8ae7bd2e tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.772s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:18 user nova-compute[72849]: INFO nova.compute.manager [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Detaching volume 9d7ad6d6-8835-4387-9aa8-aad2d05c609e
Aug 15 16:38:18 user nova-compute[72849]: INFO nova.virt.block_device [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Attempting to driver detach volume 9d7ad6d6-8835-4387-9aa8-aad2d05c609e from mountpoint /dev/vdc
Aug 15 16:38:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Attempting to detach device vdc from instance f2f0b640-e9ae-43ba-a175-a9ab87d30c8b from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:38:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:38:18 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:38:18 user nova-compute[72849]:   <source dev="/dev/sdd"/>
Aug 15 16:38:18 user nova-compute[72849]:   <target dev="vdc" bus="virtio"/>
Aug 15 16:38:18 user nova-compute[72849]:   <serial>9d7ad6d6-8835-4387-9aa8-aad2d05c609e</serial>
Aug 15 16:38:18 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 16:38:18 user nova-compute[72849]: </disk>
Aug 15 16:38:18 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:38:18 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Successfully detached device vdc from instance f2f0b640-e9ae-43ba-a175-a9ab87d30c8b from the persistent domain config.
Aug 15 16:38:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f2f0b640-e9ae-43ba-a175-a9ab87d30c8b from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:38:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:38:18 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:38:18 user nova-compute[72849]:   <source dev="/dev/sdd"/>
Aug 15 16:38:18 user nova-compute[72849]:   <target dev="vdc" bus="virtio"/>
Aug 15 16:38:18 user nova-compute[72849]:   <serial>9d7ad6d6-8835-4387-9aa8-aad2d05c609e</serial>
Aug 15 16:38:18 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 16:38:18 user nova-compute[72849]: </disk>
Aug 15 16:38:18 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692117499.0180466, f2f0b640-e9ae-43ba-a175-a9ab87d30c8b => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f2f0b640-e9ae-43ba-a175-a9ab87d30c8b {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:38:19 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Successfully detached device vdc from instance f2f0b640-e9ae-43ba-a175-a9ab87d30c8b from the live domain config.
Aug 15 16:38:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTjuZhqJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:38:19 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:38:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c5059b-9cf7-4137-968c-1525b550ce9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c85d3b-92b1-4803-a99f-d7e4f6d8e183]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:38:19 user nova-compute[72849]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e (non-flash)
Aug 15 16:38:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:38:19 user nova-compute[72849]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e (non-flash)
Aug 15 16:38:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3780b9b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e'): ({'sdd'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Removing single pathed devices sdd {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[be578a3c-0f71-4890-93af-1e59078e3aa3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[395e87c3-9b50-477f-85cb-0538b17e68f4]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Flushing IO for device /dev/sdd {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[913963e5-366d-49ad-9a96-8b15fcf8d8e5]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ab48ad-dc26-472f-83f0-be99c63ad694]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] SCSI volumes sdd have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edd445c-d1fb-4a1a-ac8b-46c70650135f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4567d976-a077-4ba5-8084-d96439be5bd4]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e, portal: 172.16.0.220,3260]
Aug 15 16:38:19 user nova-compute[72849]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e, portal: 172.16.0.220,3260] successful.
Aug 15 16:38:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ad6d6-8835-4387-9aa8-aad2d05c609e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa70c4c-f061-48dc-af2b-78efd6f00cd4]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] <== disconnect_volume: return (303ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:38:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:38:20 user nova-compute[72849]: DEBUG nova.objects.instance [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'flavor' on Instance uuid f2f0b640-e9ae-43ba-a175-a9ab87d30c8b {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:38:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0171f507-3639-4701-a4e1-8de32029dde7 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.718s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:21 user nova-compute[72849]: INFO nova.compute.manager [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Terminating instance
Aug 15 16:38:21 user nova-compute[72849]: DEBUG nova.compute.manager [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:38:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-c3b5676c-5d95-4e33-94df-bbd4bf15df4d req-6d303269-be7c-419b-8fc1-a729d96a842d service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Received event network-vif-unplugged-6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:38:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c3b5676c-5d95-4e33-94df-bbd4bf15df4d req-6d303269-be7c-419b-8fc1-a729d96a842d service nova] Acquiring lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c3b5676c-5d95-4e33-94df-bbd4bf15df4d req-6d303269-be7c-419b-8fc1-a729d96a842d service nova] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c3b5676c-5d95-4e33-94df-bbd4bf15df4d req-6d303269-be7c-419b-8fc1-a729d96a842d service nova] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-c3b5676c-5d95-4e33-94df-bbd4bf15df4d req-6d303269-be7c-419b-8fc1-a729d96a842d service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] No waiting events found dispatching network-vif-unplugged-6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:38:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-c3b5676c-5d95-4e33-94df-bbd4bf15df4d req-6d303269-be7c-419b-8fc1-a729d96a842d service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Received event network-vif-unplugged-6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:38:21 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Instance destroyed successfully.
Aug 15 16:38:21 user nova-compute[72849]: DEBUG nova.objects.instance [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lazy-loading 'resources' on Instance uuid f2f0b640-e9ae-43ba-a175-a9ab87d30c8b {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:38:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:35:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1758508923',display_name='tempest-AttachVolumeTestJSON-server-1758508923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1758508923',id=38,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvsW4NBeZj8MwEhQQg18STpkR+st2miL/ypJoJIHKlGEleqeVzXx8Q86JNVDbUaH8iUlFlTezNlxjRhswf3N5T/wZ6ZmiSsi6TdRH9qLyb67jizoRR68RBBQ5AlP6UjiA==',key_name='tempest-keypair-774079099',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:35:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='607d6d3506de49549888f16d06829c89',ramdisk_id='',reservation_id='r-7k4nhc39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1114163063',owner_user_name='tempest-AttachVolumeTestJSON-1114163063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:35:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abdcfedce2124d86a0df67571fdfcde9',uuid=f2f0b640-e9ae-43ba-a175-a9ab87d30c8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "address": "fa:16:3e:47:9f:55", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f0cc2-52", "ovs_interfaceid": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:38:21 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converting VIF {"id": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "address": "fa:16:3e:47:9f:55", "network": {"id": "f1b8d75b-ecdd-4920-9044-b1aef545acb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1448712887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "607d6d3506de49549888f16d06829c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4f0cc2-52", "ovs_interfaceid": "6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:38:22 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4f0cc2-52') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:38:22 user nova-compute[72849]: DEBUG os_vif [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4f0cc2-52') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:38:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a4f0cc2-52, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:38:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:38:22 user nova-compute[72849]: INFO os_vif [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f,network=Network(f1b8d75b-ecdd-4920-9044-b1aef545acb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4f0cc2-52')
Aug 15 16:38:22 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Deleting instance files /opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b_del
Aug 15 16:38:22 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Deletion of /opt/stack/data/nova/instances/f2f0b640-e9ae-43ba-a175-a9ab87d30c8b_del complete
Aug 15 16:38:22 user nova-compute[72849]: INFO nova.compute.manager [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 15 16:38:22 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:38:22 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:38:22 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:38:23 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:38:23 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Took 1.15 seconds to deallocate network for instance.
Aug 15 16:38:23 user nova-compute[72849]: DEBUG nova.compute.manager [req-b13130f5-cbf0-4bc0-853e-2db4befd9250 req-d069f753-a70b-469d-8bf7-f03bf653fdb7 service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Received event network-vif-deleted-6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:38:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:23 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:38:23 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:38:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:23 user nova-compute[72849]: DEBUG nova.compute.manager [req-be28d595-050b-4518-8dd9-24864d5a3ec9 req-8a81c91e-5193-4e6a-a905-fa234c0288ac service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Received event network-vif-plugged-6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:38:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-be28d595-050b-4518-8dd9-24864d5a3ec9 req-8a81c91e-5193-4e6a-a905-fa234c0288ac service nova] Acquiring lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-be28d595-050b-4518-8dd9-24864d5a3ec9 req-8a81c91e-5193-4e6a-a905-fa234c0288ac service nova] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-be28d595-050b-4518-8dd9-24864d5a3ec9 req-8a81c91e-5193-4e6a-a905-fa234c0288ac service nova] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:23 user nova-compute[72849]: DEBUG nova.compute.manager [req-be28d595-050b-4518-8dd9-24864d5a3ec9 req-8a81c91e-5193-4e6a-a905-fa234c0288ac service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] No waiting events found dispatching network-vif-plugged-6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:38:23 user nova-compute[72849]: WARNING nova.compute.manager [req-be28d595-050b-4518-8dd9-24864d5a3ec9 req-8a81c91e-5193-4e6a-a905-fa234c0288ac service nova] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Received unexpected event network-vif-plugged-6a4f0cc2-52b1-4fc0-b74b-24ae51cf351f for instance with vm_state deleted and task_state None.
Aug 15 16:38:23 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Deleted allocations for instance f2f0b640-e9ae-43ba-a175-a9ab87d30c8b
Aug 15 16:38:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1e8bbeb6-df9e-4d0d-87ea-635c2f6e23c6 tempest-AttachVolumeTestJSON-1114163063 tempest-AttachVolumeTestJSON-1114163063-project-member] Lock "f2f0b640-e9ae-43ba-a175-a9ab87d30c8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.580s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:38:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:38:36 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117501.97631, f2f0b640-e9ae-43ba-a175-a9ab87d30c8b => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:38:36 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] VM Stopped (Lifecycle Event)
Aug 15 16:38:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3310e681-4ab5-4efa-9c21-b7834a1f0b16 None None] [instance: f2f0b640-e9ae-43ba-a175-a9ab87d30c8b] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:38:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:38 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:38:38 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:38:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:38:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-f0007ddd-f25d-4708-b617-d98728f6ffcc" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:38:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-f0007ddd-f25d-4708-b617-d98728f6ffcc" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:38:38 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:38:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:39 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Updating instance_info_cache with network_info: [{"id": "de3685be-4bbe-4c94-b193-49797916f7cc", "address": "fa:16:3e:b0:a4:25", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3685be-4b", "ovs_interfaceid": "de3685be-4bbe-4c94-b193-49797916f7cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:38:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-f0007ddd-f25d-4708-b617-d98728f6ffcc" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:38:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:38:39 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:38:40 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:38:40 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:38:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:42 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:38:42 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:38:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:42 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:38:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:38:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:44 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:38:44 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:38:44 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8003MB free_disk=25.152889251708984GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:38:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:44 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f0007ddd-f25d-4708-b617-d98728f6ffcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:38:44 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 5a4db694-b564-43b5-829c-08b9d54effed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:38:44 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 3c433846-35b4-4d82-beae-5a18f5f069fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:38:44 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0bddec9f-7eec-44b1-9a56-44d09512c456 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:38:44 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 4b9f21bc-836f-4095-9eb3-d3971d418363 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:38:44 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:38:44 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:38:44 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:38:44 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:38:44 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:38:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:45 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:38:46 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:38:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:48 user nova-compute[72849]: DEBUG nova.compute.manager [req-df3efe83-0b55-4363-81d8-89ff2909e527 req-88e51f86-abb9-4a99-8e55-82a4a851e594 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received event network-changed-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:38:48 user nova-compute[72849]: DEBUG nova.compute.manager [req-df3efe83-0b55-4363-81d8-89ff2909e527 req-88e51f86-abb9-4a99-8e55-82a4a851e594 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Refreshing instance network info cache due to event network-changed-0e61cd59-e467-4ca6-8758-161710ac94c2. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:38:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-df3efe83-0b55-4363-81d8-89ff2909e527 req-88e51f86-abb9-4a99-8e55-82a4a851e594 service nova] Acquiring lock "refresh_cache-5a4db694-b564-43b5-829c-08b9d54effed" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:38:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-df3efe83-0b55-4363-81d8-89ff2909e527 req-88e51f86-abb9-4a99-8e55-82a4a851e594 service nova] Acquired lock "refresh_cache-5a4db694-b564-43b5-829c-08b9d54effed" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:38:48 user nova-compute[72849]: DEBUG nova.network.neutron [req-df3efe83-0b55-4363-81d8-89ff2909e527 req-88e51f86-abb9-4a99-8e55-82a4a851e594 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Refreshing network info cache for port 0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:38:48 user nova-compute[72849]: DEBUG nova.network.neutron [req-df3efe83-0b55-4363-81d8-89ff2909e527 req-88e51f86-abb9-4a99-8e55-82a4a851e594 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Updated VIF entry in instance network info cache for port 0e61cd59-e467-4ca6-8758-161710ac94c2. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:38:48 user nova-compute[72849]: DEBUG nova.network.neutron [req-df3efe83-0b55-4363-81d8-89ff2909e527 req-88e51f86-abb9-4a99-8e55-82a4a851e594 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Updating instance_info_cache with network_info: [{"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:38:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-df3efe83-0b55-4363-81d8-89ff2909e527 req-88e51f86-abb9-4a99-8e55-82a4a851e594 service nova] Releasing lock "refresh_cache-5a4db694-b564-43b5-829c-08b9d54effed" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:38:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:49 user nova-compute[72849]: INFO nova.compute.manager [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Rebuilding instance
Aug 15 16:38:49 user nova-compute[72849]: DEBUG nova.objects.instance [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5a4db694-b564-43b5-829c-08b9d54effed {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:38:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:38:49 user nova-compute[72849]: DEBUG nova.objects.instance [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lazy-loading 'pci_requests' on Instance uuid 5a4db694-b564-43b5-829c-08b9d54effed {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:38:49 user nova-compute[72849]: DEBUG nova.objects.instance [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a4db694-b564-43b5-829c-08b9d54effed {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:38:49 user nova-compute[72849]: DEBUG nova.objects.instance [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lazy-loading 'resources' on Instance uuid 5a4db694-b564-43b5-829c-08b9d54effed {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:38:49 user nova-compute[72849]: DEBUG nova.objects.instance [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lazy-loading 'migration_context' on Instance uuid 5a4db694-b564-43b5-829c-08b9d54effed {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:38:49 user nova-compute[72849]: DEBUG nova.objects.instance [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72849) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 16:38:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG nova.compute.manager [req-427bfcf0-0a96-463e-b5e0-f88a0512baa2 req-5911ba77-caf1-4378-82af-75470ca83acc service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received event network-vif-unplugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-427bfcf0-0a96-463e-b5e0-f88a0512baa2 req-5911ba77-caf1-4378-82af-75470ca83acc service nova] Acquiring lock "5a4db694-b564-43b5-829c-08b9d54effed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-427bfcf0-0a96-463e-b5e0-f88a0512baa2 req-5911ba77-caf1-4378-82af-75470ca83acc service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-427bfcf0-0a96-463e-b5e0-f88a0512baa2 req-5911ba77-caf1-4378-82af-75470ca83acc service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG nova.compute.manager [req-427bfcf0-0a96-463e-b5e0-f88a0512baa2 req-5911ba77-caf1-4378-82af-75470ca83acc service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] No waiting events found dispatching network-vif-unplugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:38:50 user nova-compute[72849]: WARNING nova.compute.manager [req-427bfcf0-0a96-463e-b5e0-f88a0512baa2 req-5911ba77-caf1-4378-82af-75470ca83acc service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received unexpected event network-vif-unplugged-0e61cd59-e467-4ca6-8758-161710ac94c2 for instance with vm_state active and task_state rebuilding.
Aug 15 16:38:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:50 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Instance destroyed successfully.
Aug 15 16:38:50 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Instance destroyed successfully.
Aug 15 16:38:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1620494619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1342883923',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJatHR/jzIF+/y3DqPp6PgoaFfCxIRfWdAZfYQXri5QfeGqkdcwqS7G+66L7VfNSltp49OU15mHeogEdXsLwa5QNi2gL6qLyKw28X/fFcTOinCo13zoXRe1m1pZG99ND3A==',key_name='tempest-keypair-1009687442',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:37:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8257d7b72b2043fca341cffe932713cd',ramdisk_id='',reservation_id='r-mmdj3s06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1860304746',owner_user_name='tempest-ServerActionsV293TestJSON-1860304746-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:38:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88a41ce4f3804e209615d11dd8c8e429',uuid=5a4db694-b564-43b5-829c-08b9d54effed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Converting VIF {"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=0e61cd59-e467-4ca6-8758-161710ac94c2,network=Network(d451ff25-a96a-43d5-b481-90e37add5577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e61cd59-e4') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_vif [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=0e61cd59-e467-4ca6-8758-161710ac94c2,network=Network(d451ff25-a96a-43d5-b481-90e37add5577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e61cd59-e4') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e61cd59-e4, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:38:50 user nova-compute[72849]: INFO os_vif [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=0e61cd59-e467-4ca6-8758-161710ac94c2,network=Network(d451ff25-a96a-43d5-b481-90e37add5577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e61cd59-e4')
Aug 15 16:38:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTGyIOie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:38:50 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[077ae909-aeef-4591-b001-35fb317c4b05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[139eff37-c4e3-4454-9293-349e43b904b0]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:38:50 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:38:50 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3780b80d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d23b8bc-9266-4dd3-866e-27ffd4416fbf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[011fadfc-b890-44dd-851b-11d43ad647fa]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8444be9d-66e5-4da1-8285-3f884b6f880b]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea4c526-5a66-434d-b6bc-f38c118f9d45]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOfae20468-d3c9faffba2209b1', '/dev/disk/by-id/scsi-26433633966616666', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fae20468') {{(pid=84060) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b42c5f-a675-4eea-bbd0-1005106a6565]: (4, None) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2f9636-22ac-4bf0-a53b-4be6c6ca6009]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[43af6d7b-43a3-48fd-8e31-446a93a8eb4b]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac, portal: 172.16.0.220,3260]
Aug 15 16:38:50 user nova-compute[72849]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac, portal: 172.16.0.220,3260] successful.
Aug 15 16:38:50 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[669f5aed-dc6e-4199-a2c4-56d7714340ca]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] <== disconnect_volume: return (302ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:38:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:38:50 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Deleting instance files /opt/stack/data/nova/instances/5a4db694-b564-43b5-829c-08b9d54effed_del
Aug 15 16:38:50 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Deletion of /opt/stack/data/nova/instances/5a4db694-b564-43b5-829c-08b9d54effed_del complete
Aug 15 16:38:51 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 5a4db694-b564-43b5-829c-08b9d54effed could not be found.
Aug 15 16:38:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:38:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTGyIOie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:38:51 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 16:38:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:38:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:38:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:38:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:51 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b16a49-f3f8-4c81-85e9-73e4dd6dedbe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:51 user nova-compute[72849]: WARNING os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 15 16:38:51 user nova-compute[72849]: : NotImplementedError
Aug 15 16:38:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:38:51 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:38:51 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0500bbbd-e0f7-4f4f-be53-a550d440e49f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:38:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:38:51 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:38:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:38:51 user nova-compute[72849]:  {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:38:51 user nova-compute[72849]: WARNING os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 16:38:51 user nova-compute[72849]: : NotImplementedError
Aug 15 16:38:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc35827db40>, {}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:38:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Disconnecting from: [] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:38:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.045s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:38:51 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] <== disconnect_volume: return (46ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:38:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:38:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Preparing to wait for external event volume-reimaged-3d0389bc-18c0-4d5f-84b8-45c822757bac {{(pid=72849) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 15 16:38:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Acquiring lock "5a4db694-b564-43b5-829c-08b9d54effed-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-992ed5b6-de2e-4dc5-9a7a-04f36cc49a6c req-74bc7c94-45eb-4e6f-993f-b5c3447b6e5f service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received event network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:38:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-992ed5b6-de2e-4dc5-9a7a-04f36cc49a6c req-74bc7c94-45eb-4e6f-993f-b5c3447b6e5f service nova] Acquiring lock "5a4db694-b564-43b5-829c-08b9d54effed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:38:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-992ed5b6-de2e-4dc5-9a7a-04f36cc49a6c req-74bc7c94-45eb-4e6f-993f-b5c3447b6e5f service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:38:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-992ed5b6-de2e-4dc5-9a7a-04f36cc49a6c req-74bc7c94-45eb-4e6f-993f-b5c3447b6e5f service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:38:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-992ed5b6-de2e-4dc5-9a7a-04f36cc49a6c req-74bc7c94-45eb-4e6f-993f-b5c3447b6e5f service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] No event matching network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 in dict_keys([('volume-reimaged', '3d0389bc-18c0-4d5f-84b8-45c822757bac')]) {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 15 16:38:52 user nova-compute[72849]: WARNING nova.compute.manager [req-992ed5b6-de2e-4dc5-9a7a-04f36cc49a6c req-74bc7c94-45eb-4e6f-993f-b5c3447b6e5f service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received unexpected event network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 for instance with vm_state active and task_state rebuilding.
Aug 15 16:38:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:38:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:01 user nova-compute[72849]: DEBUG nova.compute.manager [req-1573e381-d462-4da7-bca2-d096bef49a1a req-ba1e330b-24a9-44f9-a80e-991958e4713b service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Received event network-changed-ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:39:01 user nova-compute[72849]: DEBUG nova.compute.manager [req-1573e381-d462-4da7-bca2-d096bef49a1a req-ba1e330b-24a9-44f9-a80e-991958e4713b service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Refreshing instance network info cache due to event network-changed-ba949ad9-bb5b-4a82-aa8e-f1294ad3e565. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:39:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1573e381-d462-4da7-bca2-d096bef49a1a req-ba1e330b-24a9-44f9-a80e-991958e4713b service nova] Acquiring lock "refresh_cache-3c433846-35b4-4d82-beae-5a18f5f069fe" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:39:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1573e381-d462-4da7-bca2-d096bef49a1a req-ba1e330b-24a9-44f9-a80e-991958e4713b service nova] Acquired lock "refresh_cache-3c433846-35b4-4d82-beae-5a18f5f069fe" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:39:01 user nova-compute[72849]: DEBUG nova.network.neutron [req-1573e381-d462-4da7-bca2-d096bef49a1a req-ba1e330b-24a9-44f9-a80e-991958e4713b service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Refreshing network info cache for port ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:39:02 user nova-compute[72849]: DEBUG nova.network.neutron [req-1573e381-d462-4da7-bca2-d096bef49a1a req-ba1e330b-24a9-44f9-a80e-991958e4713b service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Updated VIF entry in instance network info cache for port ba949ad9-bb5b-4a82-aa8e-f1294ad3e565. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:39:02 user nova-compute[72849]: DEBUG nova.network.neutron [req-1573e381-d462-4da7-bca2-d096bef49a1a req-ba1e330b-24a9-44f9-a80e-991958e4713b service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Updating instance_info_cache with network_info: [{"id": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "address": "fa:16:3e:52:f9:b8", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba949ad9-bb", "ovs_interfaceid": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:39:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1573e381-d462-4da7-bca2-d096bef49a1a req-ba1e330b-24a9-44f9-a80e-991958e4713b service nova] Releasing lock "refresh_cache-3c433846-35b4-4d82-beae-5a18f5f069fe" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:39:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "3c433846-35b4-4d82-beae-5a18f5f069fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG nova.objects.instance [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'flavor' on Instance uuid 3c433846-35b4-4d82-beae-5a18f5f069fe {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117530.6216514, 5a4db694-b564-43b5-829c-08b9d54effed => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:39:05 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] VM Stopped (Lifecycle Event)
Aug 15 16:39:05 user nova-compute[72849]: DEBUG nova.compute.manager [None req-6803ab44-441f-48a2-9991-eeb2a3696bb9 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "3c433846-35b4-4d82-beae-5a18f5f069fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:05 user nova-compute[72849]: INFO nova.compute.manager [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Attaching volume 0361814d-be39-43dd-9c1e-36a36155cdd6 to /dev/vdb
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG nova.compute.manager [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG os_brick.utils [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b802c3-8b3a-4806-8d82-9b0621f15fd4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce25b1c1-8955-4c82-a23c-a355a6d5c408]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26b38a8-e4a6-4e7d-9ad0-1af6342a1a71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a15300-f9bc-4a54-ac37-cd27a016c0e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:39:05 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:39:05 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8ac461-31c5-400e-97fd-ffdbd3abe22a]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG os_brick.utils [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:39:05 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Updating existing volume attachment record: e36df14a-9882-4d4f-bb11-cac4f3150118 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:39:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:39:06 user nova-compute[72849]: INFO nova.compute.claims [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Claim successful on node user
Aug 15 16:39:06 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:39:06 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:39:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:39:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:39:06 user nova-compute[72849]: DEBUG nova.network.neutron [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:39:06 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:39:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:39:06 user nova-compute[72849]: DEBUG nova.policy [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdf8e22aac8640f0a9982f84f82c545b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5023408270042d1849f75aa91a764c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:39:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:39:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:39:06 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Creating image(s)
Aug 15 16:39:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "/opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "/opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.200s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk 1073741824" returned: 0 in 0.105s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.231s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:07 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:39:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:07 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Cannot resize image /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:39:07 user nova-compute[72849]: DEBUG nova.objects.instance [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lazy-loading 'migration_context' on Instance uuid ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:39:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:39:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Ensure instance console log exists: /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:39:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:07 user nova-compute[72849]: DEBUG nova.network.neutron [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Successfully created port: 6730cbf2-c90b-49ba-b2f7-085a3700cdc1 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.network.neutron [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Successfully updated port: 6730cbf2-c90b-49ba-b2f7-085a3700cdc1 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "refresh_cache-ff3d801d-ddc7-4f90-8cc8-a577d6482270" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquired lock "refresh_cache-ff3d801d-ddc7-4f90-8cc8-a577d6482270" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.network.neutron [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-a9dac4d6-76c9-4346-b541-06ea5bf11b2b req-0d542be6-dc55-46d4-8770-7f347068faaa service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Received event network-changed-6730cbf2-c90b-49ba-b2f7-085a3700cdc1 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-a9dac4d6-76c9-4346-b541-06ea5bf11b2b req-0d542be6-dc55-46d4-8770-7f347068faaa service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Refreshing instance network info cache due to event network-changed-6730cbf2-c90b-49ba-b2f7-085a3700cdc1. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a9dac4d6-76c9-4346-b541-06ea5bf11b2b req-0d542be6-dc55-46d4-8770-7f347068faaa service nova] Acquiring lock "refresh_cache-ff3d801d-ddc7-4f90-8cc8-a577d6482270" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.network.neutron [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.network.neutron [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Updating instance_info_cache with network_info: [{"id": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "address": "fa:16:3e:79:89:fb", "network": {"id": "e58f7f18-d91b-491d-a7df-8dcfd65e8c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1908380537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5023408270042d1849f75aa91a764c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730cbf2-c9", "ovs_interfaceid": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Releasing lock "refresh_cache-ff3d801d-ddc7-4f90-8cc8-a577d6482270" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.compute.manager [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Instance network_info: |[{"id": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "address": "fa:16:3e:79:89:fb", "network": {"id": "e58f7f18-d91b-491d-a7df-8dcfd65e8c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1908380537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5023408270042d1849f75aa91a764c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730cbf2-c9", "ovs_interfaceid": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a9dac4d6-76c9-4346-b541-06ea5bf11b2b req-0d542be6-dc55-46d4-8770-7f347068faaa service nova] Acquired lock "refresh_cache-ff3d801d-ddc7-4f90-8cc8-a577d6482270" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.network.neutron [req-a9dac4d6-76c9-4346-b541-06ea5bf11b2b req-0d542be6-dc55-46d4-8770-7f347068faaa service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Refreshing network info cache for port 6730cbf2-c90b-49ba-b2f7-085a3700cdc1 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Start _get_guest_xml network_info=[{"id": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "address": "fa:16:3e:79:89:fb", "network": {"id": "e58f7f18-d91b-491d-a7df-8dcfd65e8c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1908380537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5023408270042d1849f75aa91a764c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730cbf2-c9", "ovs_interfaceid": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:39:09 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:39:09 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1079645563',display_name='tempest-SnapshotDataIntegrityTests-server-1079645563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1079645563',id=42,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvnT+eAwlt9cDEjqLosifCxdPcXDVj0AGxz4cwnMnmBVXy4le3IAK9McncxpOpLoQ8qPGhfI3OlQoSvgL38O4KbPumZWqmX9HI8bENTvelG6Etcx0SBqdkYcFxQfctVhA==',key_name='tempest-keypair-620977284',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5023408270042d1849f75aa91a764c6',ramdisk_id='',reservation_id='r-t52ehmsa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1276713083',owner_user_name='tempest-SnapshotDataIntegrityTests-1276713083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:39:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdf8e22aac8640f0a9982f84f82c545b',uuid=ff3d801d-ddc7-4f90-8cc8-a577d6482270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "address": "fa:16:3e:79:89:fb", "network": {"id": "e58f7f18-d91b-491d-a7df-8dcfd65e8c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1908380537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5023408270042d1849f75aa91a764c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730cbf2-c9", "ovs_interfaceid": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Converting VIF {"id": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "address": "fa:16:3e:79:89:fb", "network": {"id": "e58f7f18-d91b-491d-a7df-8dcfd65e8c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1908380537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5023408270042d1849f75aa91a764c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730cbf2-c9", "ovs_interfaceid": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:89:fb,bridge_name='br-int',has_traffic_filtering=True,id=6730cbf2-c90b-49ba-b2f7-085a3700cdc1,network=Network(e58f7f18-d91b-491d-a7df-8dcfd65e8c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730cbf2-c9') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.objects.instance [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lazy-loading 'pci_devices' on Instance uuid ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:39:09 user nova-compute[72849]:   <uuid>ff3d801d-ddc7-4f90-8cc8-a577d6482270</uuid>
Aug 15 16:39:09 user nova-compute[72849]:   <name>instance-0000002a</name>
Aug 15 16:39:09 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:39:09 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:39:09 user nova-compute[72849]:   <metadata>
Aug 15 16:39:09 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:39:09 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:39:09 user nova-compute[72849]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1079645563</nova:name>
Aug 15 16:39:09 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:39:09</nova:creationTime>
Aug 15 16:39:09 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:39:09 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:39:09 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:39:09 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:39:09 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:39:09 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:39:09 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:39:09 user nova-compute[72849]:       <nova:owner>
Aug 15 16:39:09 user nova-compute[72849]:         <nova:user uuid="cdf8e22aac8640f0a9982f84f82c545b">tempest-SnapshotDataIntegrityTests-1276713083-project-member</nova:user>
Aug 15 16:39:09 user nova-compute[72849]:         <nova:project uuid="b5023408270042d1849f75aa91a764c6">tempest-SnapshotDataIntegrityTests-1276713083</nova:project>
Aug 15 16:39:09 user nova-compute[72849]:       </nova:owner>
Aug 15 16:39:09 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:39:09 user nova-compute[72849]:       <nova:ports>
Aug 15 16:39:09 user nova-compute[72849]:         <nova:port uuid="6730cbf2-c90b-49ba-b2f7-085a3700cdc1">
Aug 15 16:39:09 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 16:39:09 user nova-compute[72849]:         </nova:port>
Aug 15 16:39:09 user nova-compute[72849]:       </nova:ports>
Aug 15 16:39:09 user nova-compute[72849]:     </nova:instance>
Aug 15 16:39:09 user nova-compute[72849]:   </metadata>
Aug 15 16:39:09 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:39:09 user nova-compute[72849]:     <system>
Aug 15 16:39:09 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:39:09 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:39:09 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:39:09 user nova-compute[72849]:       <entry name="serial">ff3d801d-ddc7-4f90-8cc8-a577d6482270</entry>
Aug 15 16:39:09 user nova-compute[72849]:       <entry name="uuid">ff3d801d-ddc7-4f90-8cc8-a577d6482270</entry>
Aug 15 16:39:09 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:39:09 user nova-compute[72849]:     </system>
Aug 15 16:39:09 user nova-compute[72849]:   </sysinfo>
Aug 15 16:39:09 user nova-compute[72849]:   <os>
Aug 15 16:39:09 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:39:09 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:39:09 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:39:09 user nova-compute[72849]:   </os>
Aug 15 16:39:09 user nova-compute[72849]:   <features>
Aug 15 16:39:09 user nova-compute[72849]:     <acpi/>
Aug 15 16:39:09 user nova-compute[72849]:     <apic/>
Aug 15 16:39:09 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:39:09 user nova-compute[72849]:   </features>
Aug 15 16:39:09 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:39:09 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:39:09 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:39:09 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:39:09 user nova-compute[72849]:   </clock>
Aug 15 16:39:09 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:39:09 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:39:09 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:39:09 user nova-compute[72849]:   </cpu>
Aug 15 16:39:09 user nova-compute[72849]:   <devices>
Aug 15 16:39:09 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:39:09 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:39:09 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk"/>
Aug 15 16:39:09 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:39:09 user nova-compute[72849]:     </disk>
Aug 15 16:39:09 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:39:09 user nova-compute[72849]:       <mac address="fa:16:3e:79:89:fb"/>
Aug 15 16:39:09 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:39:09 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:39:09 user nova-compute[72849]:       <target dev="tap6730cbf2-c9"/>
Aug 15 16:39:09 user nova-compute[72849]:     </interface>
Aug 15 16:39:09 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:39:09 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/console.log" append="off"/>
Aug 15 16:39:09 user nova-compute[72849]:     </serial>
Aug 15 16:39:09 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:39:09 user nova-compute[72849]:     <video>
Aug 15 16:39:09 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:39:09 user nova-compute[72849]:     </video>
Aug 15 16:39:09 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:39:09 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:39:09 user nova-compute[72849]:     </rng>
Aug 15 16:39:09 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:39:09 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:39:09 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:39:09 user nova-compute[72849]:     </memballoon>
Aug 15 16:39:09 user nova-compute[72849]:   </devices>
Aug 15 16:39:09 user nova-compute[72849]: </domain>
Aug 15 16:39:09 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1079645563',display_name='tempest-SnapshotDataIntegrityTests-server-1079645563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1079645563',id=42,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvnT+eAwlt9cDEjqLosifCxdPcXDVj0AGxz4cwnMnmBVXy4le3IAK9McncxpOpLoQ8qPGhfI3OlQoSvgL38O4KbPumZWqmX9HI8bENTvelG6Etcx0SBqdkYcFxQfctVhA==',key_name='tempest-keypair-620977284',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5023408270042d1849f75aa91a764c6',ramdisk_id='',reservation_id='r-t52ehmsa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1276713083',owner_user_name='tempest-SnapshotDataIntegrityTests-1276713083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:39:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdf8e22aac8640f0a9982f84f82c545b',uuid=ff3d801d-ddc7-4f90-8cc8-a577d6482270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "address": "fa:16:3e:79:89:fb", "network": {"id": "e58f7f18-d91b-491d-a7df-8dcfd65e8c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1908380537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5023408270042d1849f75aa91a764c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730cbf2-c9", "ovs_interfaceid": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Converting VIF {"id": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "address": "fa:16:3e:79:89:fb", "network": {"id": "e58f7f18-d91b-491d-a7df-8dcfd65e8c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1908380537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5023408270042d1849f75aa91a764c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730cbf2-c9", "ovs_interfaceid": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:89:fb,bridge_name='br-int',has_traffic_filtering=True,id=6730cbf2-c90b-49ba-b2f7-085a3700cdc1,network=Network(e58f7f18-d91b-491d-a7df-8dcfd65e8c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730cbf2-c9') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG os_vif [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:89:fb,bridge_name='br-int',has_traffic_filtering=True,id=6730cbf2-c90b-49ba-b2f7-085a3700cdc1,network=Network(e58f7f18-d91b-491d-a7df-8dcfd65e8c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730cbf2-c9') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6730cbf2-c9, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6730cbf2-c9, col_values=(('external_ids', {'iface-id': '6730cbf2-c90b-49ba-b2f7-085a3700cdc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:89:fb', 'vm-uuid': 'ff3d801d-ddc7-4f90-8cc8-a577d6482270'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:09 user nova-compute[72849]: INFO os_vif [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:89:fb,bridge_name='br-int',has_traffic_filtering=True,id=6730cbf2-c90b-49ba-b2f7-085a3700cdc1,network=Network(e58f7f18-d91b-491d-a7df-8dcfd65e8c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730cbf2-c9')
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:39:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] No VIF found with MAC fa:16:3e:79:89:fb, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:39:10 user nova-compute[72849]: DEBUG nova.network.neutron [req-a9dac4d6-76c9-4346-b541-06ea5bf11b2b req-0d542be6-dc55-46d4-8770-7f347068faaa service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Updated VIF entry in instance network info cache for port 6730cbf2-c90b-49ba-b2f7-085a3700cdc1. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:39:10 user nova-compute[72849]: DEBUG nova.network.neutron [req-a9dac4d6-76c9-4346-b541-06ea5bf11b2b req-0d542be6-dc55-46d4-8770-7f347068faaa service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Updating instance_info_cache with network_info: [{"id": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "address": "fa:16:3e:79:89:fb", "network": {"id": "e58f7f18-d91b-491d-a7df-8dcfd65e8c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1908380537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5023408270042d1849f75aa91a764c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730cbf2-c9", "ovs_interfaceid": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:39:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a9dac4d6-76c9-4346-b541-06ea5bf11b2b req-0d542be6-dc55-46d4-8770-7f347068faaa service nova] Releasing lock "refresh_cache-ff3d801d-ddc7-4f90-8cc8-a577d6482270" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:39:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-03034178-1f05-4cc7-a631-62dfcc0c0272 req-d3d57ff8-772e-4950-8e94-102ff310197c service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received event volume-reimaged-3d0389bc-18c0-4d5f-84b8-45c822757bac {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:39:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-03034178-1f05-4cc7-a631-62dfcc0c0272 req-d3d57ff8-772e-4950-8e94-102ff310197c service nova] Acquiring lock "5a4db694-b564-43b5-829c-08b9d54effed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-03034178-1f05-4cc7-a631-62dfcc0c0272 req-d3d57ff8-772e-4950-8e94-102ff310197c service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-03034178-1f05-4cc7-a631-62dfcc0c0272 req-d3d57ff8-772e-4950-8e94-102ff310197c service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:10 user nova-compute[72849]: DEBUG nova.compute.manager [req-03034178-1f05-4cc7-a631-62dfcc0c0272 req-d3d57ff8-772e-4950-8e94-102ff310197c service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Processing event volume-reimaged-3d0389bc-18c0-4d5f-84b8-45c822757bac {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 15 16:39:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:39:10 user nova-compute[72849]: INFO nova.virt.block_device [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Booting with volume 3d0389bc-18c0-4d5f-84b8-45c822757bac at /dev/vda
Aug 15 16:39:11 user nova-compute[72849]: DEBUG os_brick.utils [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b56272d-4539-4e67-95e3-dd67789af17b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc42876-d373-4a76-855b-e09c1ea21b8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec046ca5-687c-468a-b3fb-541470384e15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ace94a-bc33-486b-a646-4d6a1ac7d81a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:39:11 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:39:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a8d5ac-219c-4bc1-bbcb-1414f85bc143]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG os_brick.utils [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Updating existing volume attachment record: d6a186b0-0785-477b-8174-6cd5a009058c {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-3251f158-6731-4d1f-beab-dd94492cb561 req-3b649705-b177-4e64-8d06-b13604f20313 service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Received event network-vif-plugged-6730cbf2-c90b-49ba-b2f7-085a3700cdc1 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3251f158-6731-4d1f-beab-dd94492cb561 req-3b649705-b177-4e64-8d06-b13604f20313 service nova] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3251f158-6731-4d1f-beab-dd94492cb561 req-3b649705-b177-4e64-8d06-b13604f20313 service nova] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3251f158-6731-4d1f-beab-dd94492cb561 req-3b649705-b177-4e64-8d06-b13604f20313 service nova] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-3251f158-6731-4d1f-beab-dd94492cb561 req-3b649705-b177-4e64-8d06-b13604f20313 service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] No waiting events found dispatching network-vif-plugged-6730cbf2-c90b-49ba-b2f7-085a3700cdc1 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:39:11 user nova-compute[72849]: WARNING nova.compute.manager [req-3251f158-6731-4d1f-beab-dd94492cb561 req-3b649705-b177-4e64-8d06-b13604f20313 service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Received unexpected event network-vif-plugged-6730cbf2-c90b-49ba-b2f7-085a3700cdc1 for instance with vm_state building and task_state spawning.
Aug 15 16:39:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-8ca86253-0eb9-4eaa-9e43-cd6d4093873a req-d0f33049-2b2b-43f1-85c3-d8c883e6f3d0 service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Received event network-vif-plugged-6730cbf2-c90b-49ba-b2f7-085a3700cdc1 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:39:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8ca86253-0eb9-4eaa-9e43-cd6d4093873a req-d0f33049-2b2b-43f1-85c3-d8c883e6f3d0 service nova] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8ca86253-0eb9-4eaa-9e43-cd6d4093873a req-d0f33049-2b2b-43f1-85c3-d8c883e6f3d0 service nova] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8ca86253-0eb9-4eaa-9e43-cd6d4093873a req-d0f33049-2b2b-43f1-85c3-d8c883e6f3d0 service nova] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:13 user nova-compute[72849]: DEBUG nova.compute.manager [req-8ca86253-0eb9-4eaa-9e43-cd6d4093873a req-d0f33049-2b2b-43f1-85c3-d8c883e6f3d0 service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] No waiting events found dispatching network-vif-plugged-6730cbf2-c90b-49ba-b2f7-085a3700cdc1 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:39:13 user nova-compute[72849]: WARNING nova.compute.manager [req-8ca86253-0eb9-4eaa-9e43-cd6d4093873a req-d0f33049-2b2b-43f1-85c3-d8c883e6f3d0 service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Received unexpected event network-vif-plugged-6730cbf2-c90b-49ba-b2f7-085a3700cdc1 for instance with vm_state building and task_state spawning.
Aug 15 16:39:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:39:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:39:13 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117553.7724254, ff3d801d-ddc7-4f90-8cc8-a577d6482270 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:39:13 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] VM Resumed (Lifecycle Event)
Aug 15 16:39:13 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Instance spawned successfully.
Aug 15 16:39:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:39:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:39:13 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:39:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:39:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:39:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:39:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:39:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:39:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:39:13 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:39:13 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117553.7739449, ff3d801d-ddc7-4f90-8cc8-a577d6482270 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:39:13 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] VM Started (Lifecycle Event)
Aug 15 16:39:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:39:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:39:14 user nova-compute[72849]: INFO nova.compute.manager [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Took 7.39 seconds to spawn the instance on the hypervisor.
Aug 15 16:39:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:39:14 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:39:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:14 user nova-compute[72849]: INFO nova.compute.manager [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Took 8.14 seconds to build instance.
Aug 15 16:39:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e3702bdb-c247-4d26-aa24-19eaaf4918f7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.372s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixvHmYZc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:39:16 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:39:16 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:39:16 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[445925d1-62af-4fea-9bb6-fb47ee302009]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:39:16 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d18b149-0934-48f8-a58e-19465374eabe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6] added
Aug 15 16:39:16 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[88eb0395-8324-4623-b67d-0e57d6aa6320]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68c92e4-c0dd-4708-8612-2ac4f99db0d8]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixvHmYZc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixvHmYZc" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93c4057-8668-4364-aa99-54e11ee08792]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ixvHmYZc'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ccb3f3-1fb6-4453-85d7-97f4494fc6a3]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1c2040-4ed9-4cdb-85b3-4147a5b1ebb1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:39:16 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:39:16 user nova-compute[72849]:  {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:39:16 user nova-compute[72849]: WARNING os_brick.initiator.connectors.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 16:39:16 user nova-compute[72849]: 
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61179f6-5aa8-488d-94bd-30fb78d032d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6, portal: 172.16.0.220,3260]
Aug 15 16:39:16 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6, portal: 172.16.0.220,3260] successful.
Aug 15 16:39:16 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6691f618-0f1e-4bd1-a2ba-fba56fcb359a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fd1f57-1959-4d79-ba64-39433ae253e5]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 (non-flash)
Aug 15 16:39:16 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 (non-flash)
Aug 15 16:39:16 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[816e7037-f9b0-43bf-9fdd-ef41fc5d6d43]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:39:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixvHmYZc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:39:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:39:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26333393334303038', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:39:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333393334303038', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:39:17 user nova-compute[72849]: DEBUG nova.objects.instance [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'flavor' on Instance uuid 3c433846-35b4-4d82-beae-5a18f5f069fe {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:39:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:39:17 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:39:17 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:39:17 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:39:17 user nova-compute[72849]:   <serial>0361814d-be39-43dd-9c1e-36a36155cdd6</serial>
Aug 15 16:39:17 user nova-compute[72849]: </disk>
Aug 15 16:39:17 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:39:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:39:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:39:18 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] No VIF found with MAC fa:16:3e:52:f9:b8, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:39:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-557231f2-25b0-4bb9-95f2-07fe78b4b6e4 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.696s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "3c433846-35b4-4d82-beae-5a18f5f069fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:19 user nova-compute[72849]: INFO nova.compute.manager [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Detaching volume 0361814d-be39-43dd-9c1e-36a36155cdd6
Aug 15 16:39:19 user nova-compute[72849]: INFO nova.virt.block_device [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Attempting to driver detach volume 0361814d-be39-43dd-9c1e-36a36155cdd6 from mountpoint /dev/vdb
Aug 15 16:39:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Attempting to detach device vdb from instance 3c433846-35b4-4d82-beae-5a18f5f069fe from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:39:19 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:39:19 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:39:19 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:39:19 user nova-compute[72849]:   <serial>0361814d-be39-43dd-9c1e-36a36155cdd6</serial>
Aug 15 16:39:19 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:39:19 user nova-compute[72849]: </disk>
Aug 15 16:39:19 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:39:19 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Successfully detached device vdb from instance 3c433846-35b4-4d82-beae-5a18f5f069fe from the persistent domain config.
Aug 15 16:39:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3c433846-35b4-4d82-beae-5a18f5f069fe from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:39:19 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:39:19 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:39:19 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:39:19 user nova-compute[72849]:   <serial>0361814d-be39-43dd-9c1e-36a36155cdd6</serial>
Aug 15 16:39:19 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:39:19 user nova-compute[72849]: </disk>
Aug 15 16:39:19 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692117559.8797324, 3c433846-35b4-4d82-beae-5a18f5f069fe => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3c433846-35b4-4d82-beae-5a18f5f069fe {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:39:19 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Successfully detached device vdb from instance 3c433846-35b4-4d82-beae-5a18f5f069fe from the live domain config.
Aug 15 16:39:19 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixvHmYZc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:39:19 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:39:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9effdd6-ff9c-46c5-98e5-d2e4549b46d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ae802f-4b4b-40df-91b7-bafb8b73f340]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 (non-flash)
Aug 15 16:39:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 (non-flash)
Aug 15 16:39:19 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3781bbb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee1a787-7bfc-472b-9744-90a90cd3ace9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:19 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22ac496-2031-4c74-a26a-c27c30aeff11]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd5b7a4-1768-4e53-8360-607b231a2a96]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a96b350-64a8-4821-8998-24fd0d9c3d11]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55d04cc-d720-4f32-8126-c9701be946b0]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7fb3b5-e193-4ee8-a261-221267de1bdd]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6, portal: 172.16.0.220,3260]
Aug 15 16:39:20 user nova-compute[72849]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6, portal: 172.16.0.220,3260] successful.
Aug 15 16:39:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0361814d-be39-43dd-9c1e-36a36155cdd6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68a0688-706f-47cc-bb4b-22bf4a84f3ed]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] <== disconnect_volume: return (297ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:39:20 user nova-compute[72849]: DEBUG nova.objects.instance [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'flavor' on Instance uuid 3c433846-35b4-4d82-beae-5a18f5f069fe {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-17c2dd20-eb76-4815-b9be-434e8347028b tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.738s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:39:21 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Creating image(s)
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Did not create local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Ensure instance console log exists: /opt/stack/data/nova/instances/5a4db694-b564-43b5-829c-08b9d54effed/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Start _get_guest_xml network_info=[{"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTGyIOie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5a4db694-b564-43b5-829c-08b9d54effed', 'attached_at': '', 'detached_at': '', 'volume_id': '3d0389bc-18c0-4d5f-84b8-45c822757bac', 'serial': '3d0389bc-18c0-4d5f-84b8-45c822757bac'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'd6a186b0-0785-477b-8174-6cd5a009058c', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:39:21 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 16:39:21 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.objects.instance [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5a4db694-b564-43b5-829c-08b9d54effed {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTGyIOie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:39:21 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:39:21 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:39:21 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f47f93-5474-4ff2-9f96-9aff2a6a2137]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:39:21 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e90c17-5978-4129-a5a9-f1a2e9e9a37b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac] added
Aug 15 16:39:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e000652-7181-4061-b9e1-1458bab3c0de]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbf5661-9a88-4f55-b200-3f46837a6530]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTGyIOie {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTGyIOie" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94f7e83-2eb7-4d8b-92c7-1bc44c349d51]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qTGyIOie'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70d93be-771f-4904-8641-f350ce4bb42d]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2151ecaa-67f4-47d5-b700-172acba59e3e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:39:21 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:39:21 user nova-compute[72849]:  {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:39:21 user nova-compute[72849]: WARNING os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 16:39:21 user nova-compute[72849]: : NotImplementedError
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[54de8b5a-c31c-4598-9c1b-85222dbde8c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac, portal: 172.16.0.220,3260]
Aug 15 16:39:21 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac, portal: 172.16.0.220,3260] successful.
Aug 15 16:39:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3fde7e-46bf-46b1-b7a3-2e26c4c79719]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c03ef9-1fa5-4e2d-ab93-d95eee8f24b5]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:39:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:39:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6796a4b9-a079-4594-bb1f-f2f418d80cdf]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTGyIOie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26433633966616666', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433633966616666', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T16:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1620494619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1342883923',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJatHR/jzIF+/y3DqPp6PgoaFfCxIRfWdAZfYQXri5QfeGqkdcwqS7G+66L7VfNSltp49OU15mHeogEdXsLwa5QNi2gL6qLyKw28X/fFcTOinCo13zoXRe1m1pZG99ND3A==',key_name='tempest-keypair-1009687442',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:37:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8257d7b72b2043fca341cffe932713cd',ramdisk_id='',reservation_id='r-mmdj3s06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1860304746',owner_user_name='tempest-ServerActionsV293TestJSON-1860304746-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:39:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88a41ce4f3804e209615d11dd8c8e429',uuid=5a4db694-b564-43b5-829c-08b9d54effed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Converting VIF {"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=0e61cd59-e467-4ca6-8758-161710ac94c2,network=Network(d451ff25-a96a-43d5-b481-90e37add5577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e61cd59-e4') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:39:22 user nova-compute[72849]:   <uuid>5a4db694-b564-43b5-829c-08b9d54effed</uuid>
Aug 15 16:39:22 user nova-compute[72849]:   <name>instance-00000027</name>
Aug 15 16:39:22 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:39:22 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:39:22 user nova-compute[72849]:   <metadata>
Aug 15 16:39:22 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:39:22 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:39:22 user nova-compute[72849]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1620494619</nova:name>
Aug 15 16:39:22 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:39:21</nova:creationTime>
Aug 15 16:39:22 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:39:22 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:39:22 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:39:22 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:39:22 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:39:22 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:39:22 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:39:22 user nova-compute[72849]:       <nova:owner>
Aug 15 16:39:22 user nova-compute[72849]:         <nova:user uuid="88a41ce4f3804e209615d11dd8c8e429">tempest-ServerActionsV293TestJSON-1860304746-project-member</nova:user>
Aug 15 16:39:22 user nova-compute[72849]:         <nova:project uuid="8257d7b72b2043fca341cffe932713cd">tempest-ServerActionsV293TestJSON-1860304746</nova:project>
Aug 15 16:39:22 user nova-compute[72849]:       </nova:owner>
Aug 15 16:39:22 user nova-compute[72849]:       <nova:ports>
Aug 15 16:39:22 user nova-compute[72849]:         <nova:port uuid="0e61cd59-e467-4ca6-8758-161710ac94c2">
Aug 15 16:39:22 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 16:39:22 user nova-compute[72849]:         </nova:port>
Aug 15 16:39:22 user nova-compute[72849]:       </nova:ports>
Aug 15 16:39:22 user nova-compute[72849]:     </nova:instance>
Aug 15 16:39:22 user nova-compute[72849]:   </metadata>
Aug 15 16:39:22 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:39:22 user nova-compute[72849]:     <system>
Aug 15 16:39:22 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:39:22 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:39:22 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:39:22 user nova-compute[72849]:       <entry name="serial">5a4db694-b564-43b5-829c-08b9d54effed</entry>
Aug 15 16:39:22 user nova-compute[72849]:       <entry name="uuid">5a4db694-b564-43b5-829c-08b9d54effed</entry>
Aug 15 16:39:22 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:39:22 user nova-compute[72849]:     </system>
Aug 15 16:39:22 user nova-compute[72849]:   </sysinfo>
Aug 15 16:39:22 user nova-compute[72849]:   <os>
Aug 15 16:39:22 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:39:22 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:39:22 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:39:22 user nova-compute[72849]:   </os>
Aug 15 16:39:22 user nova-compute[72849]:   <features>
Aug 15 16:39:22 user nova-compute[72849]:     <acpi/>
Aug 15 16:39:22 user nova-compute[72849]:     <apic/>
Aug 15 16:39:22 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:39:22 user nova-compute[72849]:   </features>
Aug 15 16:39:22 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:39:22 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:39:22 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:39:22 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:39:22 user nova-compute[72849]:   </clock>
Aug 15 16:39:22 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:39:22 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:39:22 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:39:22 user nova-compute[72849]:   </cpu>
Aug 15 16:39:22 user nova-compute[72849]:   <devices>
Aug 15 16:39:22 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:39:22 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:39:22 user nova-compute[72849]:       <source dev="/dev/sdb"/>
Aug 15 16:39:22 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:39:22 user nova-compute[72849]:       <serial>3d0389bc-18c0-4d5f-84b8-45c822757bac</serial>
Aug 15 16:39:22 user nova-compute[72849]:     </disk>
Aug 15 16:39:22 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:39:22 user nova-compute[72849]:       <mac address="fa:16:3e:12:d0:38"/>
Aug 15 16:39:22 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:39:22 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:39:22 user nova-compute[72849]:       <target dev="tap0e61cd59-e4"/>
Aug 15 16:39:22 user nova-compute[72849]:     </interface>
Aug 15 16:39:22 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:39:22 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/5a4db694-b564-43b5-829c-08b9d54effed/console.log" append="off"/>
Aug 15 16:39:22 user nova-compute[72849]:     </serial>
Aug 15 16:39:22 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:39:22 user nova-compute[72849]:     <video>
Aug 15 16:39:22 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:39:22 user nova-compute[72849]:     </video>
Aug 15 16:39:22 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:39:22 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:39:22 user nova-compute[72849]:     </rng>
Aug 15 16:39:22 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:39:22 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:39:22 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:39:22 user nova-compute[72849]:     </memballoon>
Aug 15 16:39:22 user nova-compute[72849]:   </devices>
Aug 15 16:39:22 user nova-compute[72849]: </domain>
Aug 15 16:39:22 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T16:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1620494619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1342883923',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJatHR/jzIF+/y3DqPp6PgoaFfCxIRfWdAZfYQXri5QfeGqkdcwqS7G+66L7VfNSltp49OU15mHeogEdXsLwa5QNi2gL6qLyKw28X/fFcTOinCo13zoXRe1m1pZG99ND3A==',key_name='tempest-keypair-1009687442',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:37:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8257d7b72b2043fca341cffe932713cd',ramdisk_id='',reservation_id='r-mmdj3s06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1860304746',owner_user_name='tempest-ServerActionsV293TestJSON-1860304746-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:39:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88a41ce4f3804e209615d11dd8c8e429',uuid=5a4db694-b564-43b5-829c-08b9d54effed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Converting VIF {"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=0e61cd59-e467-4ca6-8758-161710ac94c2,network=Network(d451ff25-a96a-43d5-b481-90e37add5577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e61cd59-e4') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG os_vif [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=0e61cd59-e467-4ca6-8758-161710ac94c2,network=Network(d451ff25-a96a-43d5-b481-90e37add5577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e61cd59-e4') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e61cd59-e4, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e61cd59-e4, col_values=(('external_ids', {'iface-id': '0e61cd59-e467-4ca6-8758-161710ac94c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:d0:38', 'vm-uuid': '5a4db694-b564-43b5-829c-08b9d54effed'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:22 user nova-compute[72849]: INFO os_vif [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=0e61cd59-e467-4ca6-8758-161710ac94c2,network=Network(d451ff25-a96a-43d5-b481-90e37add5577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e61cd59-e4')
Aug 15 16:39:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:39:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] No VIF found with MAC fa:16:3e:12:d0:38, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:39:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-f7eb569e-4f34-48ae-93a5-91649b8fa35c req-92e7a9dc-c5d5-4590-ab2c-0ebc7ae3a1fa service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received event network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:39:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f7eb569e-4f34-48ae-93a5-91649b8fa35c req-92e7a9dc-c5d5-4590-ab2c-0ebc7ae3a1fa service nova] Acquiring lock "5a4db694-b564-43b5-829c-08b9d54effed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f7eb569e-4f34-48ae-93a5-91649b8fa35c req-92e7a9dc-c5d5-4590-ab2c-0ebc7ae3a1fa service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f7eb569e-4f34-48ae-93a5-91649b8fa35c req-92e7a9dc-c5d5-4590-ab2c-0ebc7ae3a1fa service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-f7eb569e-4f34-48ae-93a5-91649b8fa35c req-92e7a9dc-c5d5-4590-ab2c-0ebc7ae3a1fa service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] No waiting events found dispatching network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:39:24 user nova-compute[72849]: WARNING nova.compute.manager [req-f7eb569e-4f34-48ae-93a5-91649b8fa35c req-92e7a9dc-c5d5-4590-ab2c-0ebc7ae3a1fa service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received unexpected event network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 16:39:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117566.2185533, 5a4db694-b564-43b5-829c-08b9d54effed => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:39:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] VM Resumed (Lifecycle Event)
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:39:26 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Instance spawned successfully.
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:39:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117566.2198348, 5a4db694-b564-43b5-829c-08b9d54effed => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:39:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] VM Started (Lifecycle Event)
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:39:26 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.objects.instance [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72849) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-03034178-1f05-4cc7-a631-62dfcc0c0272 tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-aeb9ba46-cdc9-4a02-b398-9fe0e180ef67 req-377dae6a-f280-45f0-aaa8-72673e9142bf service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received event network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-aeb9ba46-cdc9-4a02-b398-9fe0e180ef67 req-377dae6a-f280-45f0-aaa8-72673e9142bf service nova] Acquiring lock "5a4db694-b564-43b5-829c-08b9d54effed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-aeb9ba46-cdc9-4a02-b398-9fe0e180ef67 req-377dae6a-f280-45f0-aaa8-72673e9142bf service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-aeb9ba46-cdc9-4a02-b398-9fe0e180ef67 req-377dae6a-f280-45f0-aaa8-72673e9142bf service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-aeb9ba46-cdc9-4a02-b398-9fe0e180ef67 req-377dae6a-f280-45f0-aaa8-72673e9142bf service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] No waiting events found dispatching network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:39:26 user nova-compute[72849]: WARNING nova.compute.manager [req-aeb9ba46-cdc9-4a02-b398-9fe0e180ef67 req-377dae6a-f280-45f0-aaa8-72673e9142bf service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received unexpected event network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 for instance with vm_state active and task_state None.
Aug 15 16:39:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:39:36 user nova-compute[72849]: DEBUG nova.compute.manager [req-7d815e1d-1637-4982-a62d-2bf6c46bc353 req-dee0c097-5e65-41c6-971c-21c32b47bde8 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Received event network-changed-2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:39:36 user nova-compute[72849]: DEBUG nova.compute.manager [req-7d815e1d-1637-4982-a62d-2bf6c46bc353 req-dee0c097-5e65-41c6-971c-21c32b47bde8 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Refreshing instance network info cache due to event network-changed-2913e4f1-8c8c-4ac7-a159-835838a33e70. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:39:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7d815e1d-1637-4982-a62d-2bf6c46bc353 req-dee0c097-5e65-41c6-971c-21c32b47bde8 service nova] Acquiring lock "refresh_cache-0bddec9f-7eec-44b1-9a56-44d09512c456" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:39:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7d815e1d-1637-4982-a62d-2bf6c46bc353 req-dee0c097-5e65-41c6-971c-21c32b47bde8 service nova] Acquired lock "refresh_cache-0bddec9f-7eec-44b1-9a56-44d09512c456" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:39:36 user nova-compute[72849]: DEBUG nova.network.neutron [req-7d815e1d-1637-4982-a62d-2bf6c46bc353 req-dee0c097-5e65-41c6-971c-21c32b47bde8 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Refreshing network info cache for port 2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:39:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "0bddec9f-7eec-44b1-9a56-44d09512c456" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:36 user nova-compute[72849]: DEBUG nova.network.neutron [req-7d815e1d-1637-4982-a62d-2bf6c46bc353 req-dee0c097-5e65-41c6-971c-21c32b47bde8 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Updated VIF entry in instance network info cache for port 2913e4f1-8c8c-4ac7-a159-835838a33e70. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:39:36 user nova-compute[72849]: DEBUG nova.network.neutron [req-7d815e1d-1637-4982-a62d-2bf6c46bc353 req-dee0c097-5e65-41c6-971c-21c32b47bde8 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Updating instance_info_cache with network_info: [{"id": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "address": "fa:16:3e:7d:86:81", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2913e4f1-8c", "ovs_interfaceid": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:39:36 user nova-compute[72849]: DEBUG nova.objects.instance [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lazy-loading 'flavor' on Instance uuid 0bddec9f-7eec-44b1-9a56-44d09512c456 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:39:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7d815e1d-1637-4982-a62d-2bf6c46bc353 req-dee0c097-5e65-41c6-971c-21c32b47bde8 service nova] Releasing lock "refresh_cache-0bddec9f-7eec-44b1-9a56-44d09512c456" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:39:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "0bddec9f-7eec-44b1-9a56-44d09512c456" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:37 user nova-compute[72849]: INFO nova.compute.manager [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Attaching volume 0278a6b6-ca8b-4b19-b0ef-e88f37062a17 to /dev/vdb
Aug 15 16:39:37 user nova-compute[72849]: DEBUG os_brick.utils [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7902e14-8350-4ebd-8596-b519748c6310]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c6d179-c603-4ada-afdf-fb05dcdf13d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab418f59-e53e-495a-ab6d-e9a38d8ae0e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4af4a4a-1ead-4dfb-a402-3eb369ca5c47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:39:37 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:39:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46b4cbe-7de6-40d2-9475-f0a4e2adffeb]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG os_brick.utils [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Updating existing volume attachment record: 7f232ecc-6125-4e7e-b98b-7abb59f6c09f {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:39:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:38 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:39:38 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:39:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:39:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-5a4db694-b564-43b5-829c-08b9d54effed" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:39:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-5a4db694-b564-43b5-829c-08b9d54effed" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:39:38 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:39:38 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Updating instance_info_cache with network_info: [{"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:39:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-5a4db694-b564-43b5-829c-08b9d54effed" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:39:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:39:38 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:39:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:41 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:39:42 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:39:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:39:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:43 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:39:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:43 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:39:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:39:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:39:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:39:45 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:39:45 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:39:45 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=7814MB free_disk=25.110618591308594GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:39:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:45 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f0007ddd-f25d-4708-b617-d98728f6ffcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:39:45 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 5a4db694-b564-43b5-829c-08b9d54effed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:39:45 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 3c433846-35b4-4d82-beae-5a18f5f069fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:39:45 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0bddec9f-7eec-44b1-9a56-44d09512c456 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:39:45 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 4b9f21bc-836f-4095-9eb3-d3971d418363 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:39:45 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:39:45 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:39:45 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:39:46 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:39:46 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:39:46 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:39:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.355s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:48 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:39:48 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:39:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "4b9f21bc-836f-4095-9eb3-d3971d418363" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:52 user nova-compute[72849]: INFO nova.compute.manager [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Terminating instance
Aug 15 16:39:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:39:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-83374ed5-ac41-4241-886d-c2e286e11270 req-7ad747f2-376c-4d24-b8e3-0ffc20cef2f4 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received event network-vif-unplugged-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:39:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-83374ed5-ac41-4241-886d-c2e286e11270 req-7ad747f2-376c-4d24-b8e3-0ffc20cef2f4 service nova] Acquiring lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-83374ed5-ac41-4241-886d-c2e286e11270 req-7ad747f2-376c-4d24-b8e3-0ffc20cef2f4 service nova] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-83374ed5-ac41-4241-886d-c2e286e11270 req-7ad747f2-376c-4d24-b8e3-0ffc20cef2f4 service nova] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-83374ed5-ac41-4241-886d-c2e286e11270 req-7ad747f2-376c-4d24-b8e3-0ffc20cef2f4 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] No waiting events found dispatching network-vif-unplugged-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:39:52 user nova-compute[72849]: DEBUG nova.compute.manager [req-83374ed5-ac41-4241-886d-c2e286e11270 req-7ad747f2-376c-4d24-b8e3-0ffc20cef2f4 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received event network-vif-unplugged-cb180f95-0817-4f21-807c-4a96a65e4062 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:39:53 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Instance destroyed successfully.
Aug 15 16:39:53 user nova-compute[72849]: DEBUG nova.objects.instance [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lazy-loading 'resources' on Instance uuid 4b9f21bc-836f-4095-9eb3-d3971d418363 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:39:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T16:34:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1489512197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1489512197',id=36,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe+X3TlJY7viy6yCC4qfoaJNUF0aD42WXrGPlRjIPb89wzbqYH9zALZJ5CRJe4p1pdHW/9jzBSM0IPaTRUdlDyBTE1hky/6604FqoKqX9DPrfM+jFneqscMa1UPBBiqoQ==',key_name='tempest-keypair-1622612503',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:38:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bb636c3c71c479d90cf2e170db941e1',ramdisk_id='',reservation_id='r-ti7scmj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1263463439',owner_user_name='tempest-AttachVolumeShelveTestJSON-1263463439-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:38:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867f247fc90437899a13a7451a3249a',uuid=4b9f21bc-836f-4095-9eb3-d3971d418363,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:39:53 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converting VIF {"id": "cb180f95-0817-4f21-807c-4a96a65e4062", "address": "fa:16:3e:ea:b5:7a", "network": {"id": "8dcc119a-c3cb-4ae0-8b73-264dba5f1990", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-841163144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb636c3c71c479d90cf2e170db941e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb180f95-08", "ovs_interfaceid": "cb180f95-0817-4f21-807c-4a96a65e4062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:39:53 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:b5:7a,bridge_name='br-int',has_traffic_filtering=True,id=cb180f95-0817-4f21-807c-4a96a65e4062,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb180f95-08') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:39:53 user nova-compute[72849]: DEBUG os_vif [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:b5:7a,bridge_name='br-int',has_traffic_filtering=True,id=cb180f95-0817-4f21-807c-4a96a65e4062,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb180f95-08') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:39:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb180f95-08, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:39:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:53 user nova-compute[72849]: INFO os_vif [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:b5:7a,bridge_name='br-int',has_traffic_filtering=True,id=cb180f95-0817-4f21-807c-4a96a65e4062,network=Network(8dcc119a-c3cb-4ae0-8b73-264dba5f1990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb180f95-08')
Aug 15 16:39:53 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Deleting instance files /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363_del
Aug 15 16:39:53 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Deletion of /opt/stack/data/nova/instances/4b9f21bc-836f-4095-9eb3-d3971d418363_del complete
Aug 15 16:39:53 user nova-compute[72849]: INFO nova.compute.manager [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Took 0.79 seconds to destroy the instance on the hypervisor.
Aug 15 16:39:53 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:39:53 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:39:53 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:39:54 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:39:54 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Took 0.80 seconds to deallocate network for instance.
Aug 15 16:39:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-099d41ad-3a02-40be-9826-5f1ff68bc190 req-624a2053-08f6-4335-96c6-d4ff2d999c31 service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received event network-vif-deleted-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:39:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:39:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:54 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:39:54 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:39:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:54 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Deleted allocations for instance 4b9f21bc-836f-4095-9eb3-d3971d418363
Aug 15 16:39:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-5603baed-4ba9-4bf4-b6d0-9fefdcd8ad5f tempest-AttachVolumeShelveTestJSON-1263463439 tempest-AttachVolumeShelveTestJSON-1263463439-project-member] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.018s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-7b6a6928-b5ea-4ac8-9cd2-06515af990a8 req-957073b9-bbda-4f8a-9bbc-d1df2b7b26ba service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received event network-vif-plugged-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:39:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7b6a6928-b5ea-4ac8-9cd2-06515af990a8 req-957073b9-bbda-4f8a-9bbc-d1df2b7b26ba service nova] Acquiring lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:39:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7b6a6928-b5ea-4ac8-9cd2-06515af990a8 req-957073b9-bbda-4f8a-9bbc-d1df2b7b26ba service nova] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:39:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7b6a6928-b5ea-4ac8-9cd2-06515af990a8 req-957073b9-bbda-4f8a-9bbc-d1df2b7b26ba service nova] Lock "4b9f21bc-836f-4095-9eb3-d3971d418363-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:39:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-7b6a6928-b5ea-4ac8-9cd2-06515af990a8 req-957073b9-bbda-4f8a-9bbc-d1df2b7b26ba service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] No waiting events found dispatching network-vif-plugged-cb180f95-0817-4f21-807c-4a96a65e4062 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:39:54 user nova-compute[72849]: WARNING nova.compute.manager [req-7b6a6928-b5ea-4ac8-9cd2-06515af990a8 req-957073b9-bbda-4f8a-9bbc-d1df2b7b26ba service nova] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Received unexpected event network-vif-plugged-cb180f95-0817-4f21-807c-4a96a65e4062 for instance with vm_state deleted and task_state None.
Aug 15 16:39:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNMYBbQs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:40:00 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:40:00 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:40:00 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d181e755-d77e-4be1-b614-98e504c6c8f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:40:00 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b5645f-651e-4200-9f82-a68578f8b386]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17] added
Aug 15 16:40:00 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1392f52c-a443-400d-ab36-c64a51aa9833]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[04369520-4fd1-4614-8cde-201ba9d99089]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNMYBbQs {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNMYBbQs" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c580ac91-32ea-4698-862c-9f0c02e3c1a3]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kNMYBbQs'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52aae27-851f-4f09-bd68-ae150902255a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3988a3-1d4e-4368-80ad-e99f61ce545c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:40:00 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:40:00 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[27321084-892e-42fd-be11-fea203f15be1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17, portal: 172.16.0.220,3260]
Aug 15 16:40:00 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17, portal: 172.16.0.220,3260] successful.
Aug 15 16:40:00 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1438fc3a-338c-48da-b6c9-6554befac6e6]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e65626-7de6-42ef-a93e-28f50ed01e19]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:40:00 user nova-compute[72849]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 (non-flash)
Aug 15 16:40:00 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:40:00 user nova-compute[72849]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 (non-flash)
Aug 15 16:40:00 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc4a718-db7b-4deb-965e-b6ae105ca577]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:40:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNMYBbQs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:40:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:40:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23139656239393935', 'path': '/dev/sdc'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:40:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139656239393935', 'path': '/dev/sdc'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:40:01 user nova-compute[72849]: DEBUG nova.objects.instance [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lazy-loading 'flavor' on Instance uuid 0bddec9f-7eec-44b1-9a56-44d09512c456 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:40:02 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:40:02 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:40:02 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:40:02 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:40:02 user nova-compute[72849]:   <serial>0278a6b6-ca8b-4b19-b0ef-e88f37062a17</serial>
Aug 15 16:40:02 user nova-compute[72849]: </disk>
Aug 15 16:40:02 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:40:02 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:40:02 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:40:02 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] No VIF found with MAC fa:16:3e:7d:86:81, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:40:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf78c517-1bbc-40e2-ae55-315cf6a8ac65 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.460s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:40:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "0bddec9f-7eec-44b1-9a56-44d09512c456" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:03 user nova-compute[72849]: INFO nova.compute.manager [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Detaching volume 0278a6b6-ca8b-4b19-b0ef-e88f37062a17
Aug 15 16:40:04 user nova-compute[72849]: INFO nova.virt.block_device [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Attempting to driver detach volume 0278a6b6-ca8b-4b19-b0ef-e88f37062a17 from mountpoint /dev/vdb
Aug 15 16:40:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Attempting to detach device vdb from instance 0bddec9f-7eec-44b1-9a56-44d09512c456 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:40:04 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:40:04 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:40:04 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:40:04 user nova-compute[72849]:   <serial>0278a6b6-ca8b-4b19-b0ef-e88f37062a17</serial>
Aug 15 16:40:04 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:40:04 user nova-compute[72849]: </disk>
Aug 15 16:40:04 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:40:04 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Successfully detached device vdb from instance 0bddec9f-7eec-44b1-9a56-44d09512c456 from the persistent domain config.
Aug 15 16:40:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0bddec9f-7eec-44b1-9a56-44d09512c456 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:40:04 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:40:04 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:40:04 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:40:04 user nova-compute[72849]:   <serial>0278a6b6-ca8b-4b19-b0ef-e88f37062a17</serial>
Aug 15 16:40:04 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:40:04 user nova-compute[72849]: </disk>
Aug 15 16:40:04 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692117604.5040362, 0bddec9f-7eec-44b1-9a56-44d09512c456 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0bddec9f-7eec-44b1-9a56-44d09512c456 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:40:04 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Successfully detached device vdb from instance 0bddec9f-7eec-44b1-9a56-44d09512c456 from the live domain config.
Aug 15 16:40:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNMYBbQs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:40:04 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:40:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[affd7d6b-471f-4c7c-8d25-1854bd8eb8fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[45175ad2-e349-4940-9a76-5df55fdfb635]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:40:04 user nova-compute[72849]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 (non-flash)
Aug 15 16:40:04 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:40:04 user nova-compute[72849]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 (non-flash)
Aug 15 16:40:04 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc358283e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17'): ({'sdc'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Removing single pathed devices sdc {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[172c3bf6-5a18-48fa-8c66-b7253f6caddd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8733cc7-f8e4-417b-9eb5-768f260ba5a1]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Flushing IO for device /dev/sdc {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[639af8c3-14a4-4cfa-bdeb-9890d19d62ca]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a08f9d-e88d-4c4d-9176-186da95e5f7e]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7377f41-c196-4a62-8cc6-e71a5348458a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf85e8f2-6bcf-48bf-aac5-23754a607759]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17, portal: 172.16.0.220,3260]
Aug 15 16:40:04 user nova-compute[72849]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17, portal: 172.16.0.220,3260] successful.
Aug 15 16:40:04 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0278a6b6-ca8b-4b19-b0ef-e88f37062a17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd110cdb-2959-4454-8e15-5cba0afd8e89]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] <== disconnect_volume: return (274ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:40:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:40:05 user nova-compute[72849]: DEBUG nova.objects.instance [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lazy-loading 'flavor' on Instance uuid 0bddec9f-7eec-44b1-9a56-44d09512c456 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:40:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e7c1289f-66a4-4055-b2d4-01d222d1da7e tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.617s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:08 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117593.2410917, 4b9f21bc-836f-4095-9eb3-d3971d418363 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:40:08 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] VM Stopped (Lifecycle Event)
Aug 15 16:40:08 user nova-compute[72849]: DEBUG nova.compute.manager [None req-999d00b7-cdfa-4ec4-b21a-b596625df841 None None] [instance: 4b9f21bc-836f-4095-9eb3-d3971d418363] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:40:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "3c433846-35b4-4d82-beae-5a18f5f069fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "3c433846-35b4-4d82-beae-5a18f5f069fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:09 user nova-compute[72849]: INFO nova.compute.manager [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Terminating instance
Aug 15 16:40:09 user nova-compute[72849]: DEBUG nova.compute.manager [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:40:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-73e43016-1970-4be6-878e-d644f76cccf1 req-b329aad8-cf3e-4ffe-be1e-35ad3c5d1b9b service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Received event network-vif-unplugged-ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:40:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-73e43016-1970-4be6-878e-d644f76cccf1 req-b329aad8-cf3e-4ffe-be1e-35ad3c5d1b9b service nova] Acquiring lock "3c433846-35b4-4d82-beae-5a18f5f069fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-73e43016-1970-4be6-878e-d644f76cccf1 req-b329aad8-cf3e-4ffe-be1e-35ad3c5d1b9b service nova] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-73e43016-1970-4be6-878e-d644f76cccf1 req-b329aad8-cf3e-4ffe-be1e-35ad3c5d1b9b service nova] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-73e43016-1970-4be6-878e-d644f76cccf1 req-b329aad8-cf3e-4ffe-be1e-35ad3c5d1b9b service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] No waiting events found dispatching network-vif-unplugged-ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:40:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-73e43016-1970-4be6-878e-d644f76cccf1 req-b329aad8-cf3e-4ffe-be1e-35ad3c5d1b9b service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Received event network-vif-unplugged-ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:40:10 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Instance destroyed successfully.
Aug 15 16:40:10 user nova-compute[72849]: DEBUG nova.objects.instance [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lazy-loading 'resources' on Instance uuid 3c433846-35b4-4d82-beae-5a18f5f069fe {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:40:10 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:37:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2079133067',display_name='tempest-AttachVolumeNegativeTest-server-2079133067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2079133067',id=40,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaCpDcrOR1fk6HtClYSb54ORvkR2STo4v69GKOQxiGb166RNujKAT2h4at4NJqzLbfiajLfqgURf0e/O1XUM4E7duGxwsaqG8t9eV9+iDhemxfphexBAJu11/3KrsfhxA==',key_name='tempest-keypair-332137571',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:37:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0ddd223976e4b13a3b6a5638846f83a',ramdisk_id='',reservation_id='r-q0w10add',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-693282259',owner_user_name='tempest-AttachVolumeNegativeTest-693282259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e99eefba54014b9ea83f1611b02efaad',uuid=3c433846-35b4-4d82-beae-5a18f5f069fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "address": "fa:16:3e:52:f9:b8", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba949ad9-bb", "ovs_interfaceid": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:40:10 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converting VIF {"id": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "address": "fa:16:3e:52:f9:b8", "network": {"id": "5850c42c-44a4-4dbb-8037-a7d9384a75c9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1947119944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ddd223976e4b13a3b6a5638846f83a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba949ad9-bb", "ovs_interfaceid": "ba949ad9-bb5b-4a82-aa8e-f1294ad3e565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:40:10 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=ba949ad9-bb5b-4a82-aa8e-f1294ad3e565,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba949ad9-bb') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:40:10 user nova-compute[72849]: DEBUG os_vif [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=ba949ad9-bb5b-4a82-aa8e-f1294ad3e565,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba949ad9-bb') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:40:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba949ad9-bb, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:40:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:40:10 user nova-compute[72849]: INFO os_vif [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=ba949ad9-bb5b-4a82-aa8e-f1294ad3e565,network=Network(5850c42c-44a4-4dbb-8037-a7d9384a75c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba949ad9-bb')
Aug 15 16:40:10 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Deleting instance files /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe_del
Aug 15 16:40:10 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Deletion of /opt/stack/data/nova/instances/3c433846-35b4-4d82-beae-5a18f5f069fe_del complete
Aug 15 16:40:10 user nova-compute[72849]: INFO nova.compute.manager [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 15 16:40:10 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:40:10 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:40:10 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:40:11 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:40:11 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Took 1.35 seconds to deallocate network for instance.
Aug 15 16:40:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-1273b177-0f38-4c1f-b0ce-6b338725357c req-e7723128-2eff-4a18-b4be-c1593bd91f0c service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Received event network-vif-plugged-ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:40:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1273b177-0f38-4c1f-b0ce-6b338725357c req-e7723128-2eff-4a18-b4be-c1593bd91f0c service nova] Acquiring lock "3c433846-35b4-4d82-beae-5a18f5f069fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1273b177-0f38-4c1f-b0ce-6b338725357c req-e7723128-2eff-4a18-b4be-c1593bd91f0c service nova] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1273b177-0f38-4c1f-b0ce-6b338725357c req-e7723128-2eff-4a18-b4be-c1593bd91f0c service nova] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-1273b177-0f38-4c1f-b0ce-6b338725357c req-e7723128-2eff-4a18-b4be-c1593bd91f0c service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] No waiting events found dispatching network-vif-plugged-ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:40:11 user nova-compute[72849]: WARNING nova.compute.manager [req-1273b177-0f38-4c1f-b0ce-6b338725357c req-e7723128-2eff-4a18-b4be-c1593bd91f0c service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Received unexpected event network-vif-plugged-ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 for instance with vm_state deleted and task_state None.
Aug 15 16:40:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-1273b177-0f38-4c1f-b0ce-6b338725357c req-e7723128-2eff-4a18-b4be-c1593bd91f0c service nova] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Received event network-vif-deleted-ba949ad9-bb5b-4a82-aa8e-f1294ad3e565 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:40:12 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:40:12 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:40:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:12 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Deleted allocations for instance 3c433846-35b4-4d82-beae-5a18f5f069fe
Aug 15 16:40:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-039f9092-485a-48f0-9335-3de415eb8dd9 tempest-AttachVolumeNegativeTest-693282259 tempest-AttachVolumeNegativeTest-693282259-project-member] Lock "3c433846-35b4-4d82-beae-5a18f5f069fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.598s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:40:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:25 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117610.4045377, 3c433846-35b4-4d82-beae-5a18f5f069fe => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:40:25 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] VM Stopped (Lifecycle Event)
Aug 15 16:40:25 user nova-compute[72849]: DEBUG nova.compute.manager [None req-2c0e45ed-c9c9-4bd9-8c71-f177504dfa7e None None] [instance: 3c433846-35b4-4d82-beae-5a18f5f069fe] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:40:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:40:38 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:40:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:40:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Didn't find any instances for network info cache update. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 16:40:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:39 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:40:40 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:40:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Acquiring lock "5a4db694-b564-43b5-829c-08b9d54effed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "5a4db694-b564-43b5-829c-08b9d54effed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Acquiring lock "5a4db694-b564-43b5-829c-08b9d54effed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:41 user nova-compute[72849]: INFO nova.compute.manager [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Terminating instance
Aug 15 16:40:41 user nova-compute[72849]: DEBUG nova.compute.manager [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:40:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-9c499892-0b78-4656-855a-9b92160e6031 req-2a9cfef0-51aa-416a-bb80-f06f87b2c95d service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received event network-vif-unplugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:40:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9c499892-0b78-4656-855a-9b92160e6031 req-2a9cfef0-51aa-416a-bb80-f06f87b2c95d service nova] Acquiring lock "5a4db694-b564-43b5-829c-08b9d54effed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9c499892-0b78-4656-855a-9b92160e6031 req-2a9cfef0-51aa-416a-bb80-f06f87b2c95d service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9c499892-0b78-4656-855a-9b92160e6031 req-2a9cfef0-51aa-416a-bb80-f06f87b2c95d service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-9c499892-0b78-4656-855a-9b92160e6031 req-2a9cfef0-51aa-416a-bb80-f06f87b2c95d service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] No waiting events found dispatching network-vif-unplugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:40:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-9c499892-0b78-4656-855a-9b92160e6031 req-2a9cfef0-51aa-416a-bb80-f06f87b2c95d service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received event network-vif-unplugged-0e61cd59-e467-4ca6-8758-161710ac94c2 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:40:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:42 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Instance destroyed successfully.
Aug 15 16:40:42 user nova-compute[72849]: DEBUG nova.objects.instance [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lazy-loading 'resources' on Instance uuid 5a4db694-b564-43b5-829c-08b9d54effed {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T16:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1620494619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1342883923',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJatHR/jzIF+/y3DqPp6PgoaFfCxIRfWdAZfYQXri5QfeGqkdcwqS7G+66L7VfNSltp49OU15mHeogEdXsLwa5QNi2gL6qLyKw28X/fFcTOinCo13zoXRe1m1pZG99ND3A==',key_name='tempest-keypair-1009687442',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:39:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8257d7b72b2043fca341cffe932713cd',ramdisk_id='',reservation_id='r-mmdj3s06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1860304746',owner_user_name='tempest-ServerActionsV293TestJSON-1860304746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:39:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88a41ce4f3804e209615d11dd8c8e429',uuid=5a4db694-b564-43b5-829c-08b9d54effed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Converting VIF {"id": "0e61cd59-e467-4ca6-8758-161710ac94c2", "address": "fa:16:3e:12:d0:38", "network": {"id": "d451ff25-a96a-43d5-b481-90e37add5577", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407566062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8257d7b72b2043fca341cffe932713cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e61cd59-e4", "ovs_interfaceid": "0e61cd59-e467-4ca6-8758-161710ac94c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=0e61cd59-e467-4ca6-8758-161710ac94c2,network=Network(d451ff25-a96a-43d5-b481-90e37add5577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e61cd59-e4') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_vif [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=0e61cd59-e467-4ca6-8758-161710ac94c2,network=Network(d451ff25-a96a-43d5-b481-90e37add5577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e61cd59-e4') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e61cd59-e4, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:42 user nova-compute[72849]: INFO os_vif [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=0e61cd59-e467-4ca6-8758-161710ac94c2,network=Network(d451ff25-a96a-43d5-b481-90e37add5577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e61cd59-e4')
Aug 15 16:40:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTGyIOie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:40:42 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[262a8400-a17e-407f-a9a7-9375fea01901]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[328ea4a9-7d47-41e6-b4cc-626b1f9c0f3b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:40:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac (non-flash)
Aug 15 16:40:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc338612200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea42725f-2af9-4107-ae62-51d102b7bcf4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ffce31-efc5-49bf-9fd4-2e447345c2d0]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b110c432-59d5-4f55-aa7d-a9fb09424e2f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae486c66-87a7-4095-b46f-61925b3c60c7]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOfae20468-d3c9faffba2209b1', '/dev/disk/by-id/scsi-26433633966616666', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fae20468') {{(pid=84060) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c3f26a-62ae-4066-9562-79b2c890bd9f]: (4, None) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a68da8-6366-47b5-b645-9117f766b151]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fb5c19-d210-4c4a-a2c6-e9299d861c2b]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac, portal: 172.16.0.220,3260]
Aug 15 16:40:42 user nova-compute[72849]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac, portal: 172.16.0.220,3260] successful.
Aug 15 16:40:42 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0389bc-18c0-4d5f-84b8-45c822757bac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0695088a-f04f-4f1b-9c0d-f72f405c46da]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] <== disconnect_volume: return (326ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:40:42 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Deleting instance files /opt/stack/data/nova/instances/5a4db694-b564-43b5-829c-08b9d54effed_del
Aug 15 16:40:42 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Deletion of /opt/stack/data/nova/instances/5a4db694-b564-43b5-829c-08b9d54effed_del complete
Aug 15 16:40:42 user nova-compute[72849]: INFO nova.compute.manager [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 15 16:40:42 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:40:43 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Took 1.15 seconds to deallocate network for instance.
Aug 15 16:40:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received event network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] Acquiring lock "5a4db694-b564-43b5-829c-08b9d54effed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] No waiting events found dispatching network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:40:43 user nova-compute[72849]: WARNING nova.compute.manager [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received unexpected event network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 for instance with vm_state active and task_state deleting.
Aug 15 16:40:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received event network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] Acquiring lock "5a4db694-b564-43b5-829c-08b9d54effed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] No waiting events found dispatching network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:40:43 user nova-compute[72849]: WARNING nova.compute.manager [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received unexpected event network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 for instance with vm_state active and task_state deleting.
Aug 15 16:40:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received event network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] Acquiring lock "5a4db694-b564-43b5-829c-08b9d54effed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] No waiting events found dispatching network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:40:43 user nova-compute[72849]: WARNING nova.compute.manager [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received unexpected event network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 for instance with vm_state active and task_state deleting.
Aug 15 16:40:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received event network-vif-unplugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] Acquiring lock "5a4db694-b564-43b5-829c-08b9d54effed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] No waiting events found dispatching network-vif-unplugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received event network-vif-unplugged-0e61cd59-e467-4ca6-8758-161710ac94c2 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received event network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] Acquiring lock "5a4db694-b564-43b5-829c-08b9d54effed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] Lock "5a4db694-b564-43b5-829c-08b9d54effed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] No waiting events found dispatching network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:40:43 user nova-compute[72849]: WARNING nova.compute.manager [req-453718c4-5304-4c55-abf4-62c3018a7053 req-3f5932c0-3629-45ea-ad1c-f93d7616b442 service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received unexpected event network-vif-plugged-0e61cd59-e467-4ca6-8758-161710ac94c2 for instance with vm_state active and task_state deleting.
Aug 15 16:40:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-5d96fee4-0b22-4450-ad82-5c97e11a40f8 req-80e33fc3-33f6-4e32-8a45-1238c9be7abe service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Received event network-vif-deleted-0e61cd59-e467-4ca6-8758-161710ac94c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:40:43 user nova-compute[72849]: INFO nova.compute.manager [req-5d96fee4-0b22-4450-ad82-5c97e11a40f8 req-80e33fc3-33f6-4e32-8a45-1238c9be7abe service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Neutron deleted interface 0e61cd59-e467-4ca6-8758-161710ac94c2; detaching it from the instance and deleting it from the info cache
Aug 15 16:40:43 user nova-compute[72849]: DEBUG nova.network.neutron [req-5d96fee4-0b22-4450-ad82-5c97e11a40f8 req-80e33fc3-33f6-4e32-8a45-1238c9be7abe service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:40:43 user nova-compute[72849]: DEBUG nova.compute.manager [req-5d96fee4-0b22-4450-ad82-5c97e11a40f8 req-80e33fc3-33f6-4e32-8a45-1238c9be7abe service nova] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Detach interface failed, port_id=0e61cd59-e467-4ca6-8758-161710ac94c2, reason: Instance 5a4db694-b564-43b5-829c-08b9d54effed could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:44 user nova-compute[72849]: INFO nova.compute.manager [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Took 0.86 seconds to detach 1 volumes for instance.
Aug 15 16:40:44 user nova-compute[72849]: DEBUG nova.compute.manager [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Deleting volume: 3d0389bc-18c0-4d5f-84b8-45c822757bac {{(pid=72849) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "7722de29-482a-4f75-a3ed-d4293fdd9db8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:40:44 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:40:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:45 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Deleted allocations for instance 5a4db694-b564-43b5-829c-08b9d54effed
Aug 15 16:40:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:40:45 user nova-compute[72849]: INFO nova.compute.claims [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Claim successful on node user
Aug 15 16:40:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-115f2a51-f523-45fc-a591-9d2541620a5d tempest-ServerActionsV293TestJSON-1860304746 tempest-ServerActionsV293TestJSON-1860304746-project-member] Lock "5a4db694-b564-43b5-829c-08b9d54effed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.043s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:45 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:40:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:45 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:40:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:45 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:40:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:45 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:40:45 user nova-compute[72849]: DEBUG nova.network.neutron [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:40:45 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:40:46 user nova-compute[72849]: DEBUG nova.policy [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae3d508464a14dad9113a56fac6f0f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35bb132e2cc4dfc99e383862ce86829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:40:46 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:40:46 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:40:46 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8301MB free_disk=25.16199493408203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:46 user nova-compute[72849]: INFO nova.virt.block_device [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Booting with volume bea85e2c-f0d1-47ab-819b-736df16b67d1 at /dev/vda
Aug 15 16:40:46 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f0007ddd-f25d-4708-b617-d98728f6ffcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0bddec9f-7eec-44b1-9a56-44d09512c456 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 7722de29-482a-4f75-a3ed-d4293fdd9db8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG os_brick.utils [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f9b4e1-2bac-4660-afaa-a7fc4e2211de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[92277b7d-7ccc-4f4a-8992-e586acc949d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0190b1d1-8236-49f2-be9a-f7e62f6b7c4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[236393b8-73a5-4388-9cb7-e41ca2c4d925]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:40:46 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:40:46 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0911e8a-dc61-4ec4-812f-ad90c83cfe9e]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG os_brick.utils [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Updating existing volume attachment record: d47d7cec-0406-4202-a51d-2fe8905a3da2 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:46 user nova-compute[72849]: DEBUG nova.network.neutron [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Successfully created port: 4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:40:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:47 user nova-compute[72849]: DEBUG nova.network.neutron [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Successfully updated port: 4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:40:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:40:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquired lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:40:47 user nova-compute[72849]: DEBUG nova.network.neutron [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:40:47 user nova-compute[72849]: DEBUG nova.compute.manager [req-4566df3e-7c89-4789-8748-fdd97a85d697 req-3510a2c0-c275-431b-a299-9f96814fff31 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received event network-changed-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:40:47 user nova-compute[72849]: DEBUG nova.compute.manager [req-4566df3e-7c89-4789-8748-fdd97a85d697 req-3510a2c0-c275-431b-a299-9f96814fff31 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Refreshing instance network info cache due to event network-changed-4bb47a58-9f72-4291-9270-b5a0a988725c. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:40:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4566df3e-7c89-4789-8748-fdd97a85d697 req-3510a2c0-c275-431b-a299-9f96814fff31 service nova] Acquiring lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:40:47 user nova-compute[72849]: DEBUG nova.network.neutron [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:40:47 user nova-compute[72849]: DEBUG nova.network.neutron [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Updating instance_info_cache with network_info: [{"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:40:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Releasing lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:40:47 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Instance network_info: |[{"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:40:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4566df3e-7c89-4789-8748-fdd97a85d697 req-3510a2c0-c275-431b-a299-9f96814fff31 service nova] Acquired lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:40:47 user nova-compute[72849]: DEBUG nova.network.neutron [req-4566df3e-7c89-4789-8748-fdd97a85d697 req-3510a2c0-c275-431b-a299-9f96814fff31 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Refreshing network info cache for port 4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:40:48 user nova-compute[72849]: DEBUG nova.network.neutron [req-4566df3e-7c89-4789-8748-fdd97a85d697 req-3510a2c0-c275-431b-a299-9f96814fff31 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Updated VIF entry in instance network info cache for port 4bb47a58-9f72-4291-9270-b5a0a988725c. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:40:48 user nova-compute[72849]: DEBUG nova.network.neutron [req-4566df3e-7c89-4789-8748-fdd97a85d697 req-3510a2c0-c275-431b-a299-9f96814fff31 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Updating instance_info_cache with network_info: [{"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:40:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4566df3e-7c89-4789-8748-fdd97a85d697 req-3510a2c0-c275-431b-a299-9f96814fff31 service nova] Releasing lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:40:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:49 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:40:49 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:40:49 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:40:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-2853dbf7-6f5d-4bc2-a424-794f31a0f3b5 req-0fefa423-9a16-468f-a4e7-efb8937966a6 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Received event network-changed-2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:40:54 user nova-compute[72849]: DEBUG nova.compute.manager [req-2853dbf7-6f5d-4bc2-a424-794f31a0f3b5 req-0fefa423-9a16-468f-a4e7-efb8937966a6 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Refreshing instance network info cache due to event network-changed-2913e4f1-8c8c-4ac7-a159-835838a33e70. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:40:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2853dbf7-6f5d-4bc2-a424-794f31a0f3b5 req-0fefa423-9a16-468f-a4e7-efb8937966a6 service nova] Acquiring lock "refresh_cache-0bddec9f-7eec-44b1-9a56-44d09512c456" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:40:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2853dbf7-6f5d-4bc2-a424-794f31a0f3b5 req-0fefa423-9a16-468f-a4e7-efb8937966a6 service nova] Acquired lock "refresh_cache-0bddec9f-7eec-44b1-9a56-44d09512c456" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:40:54 user nova-compute[72849]: DEBUG nova.network.neutron [req-2853dbf7-6f5d-4bc2-a424-794f31a0f3b5 req-0fefa423-9a16-468f-a4e7-efb8937966a6 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Refreshing network info cache for port 2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:40:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "0bddec9f-7eec-44b1-9a56-44d09512c456" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:54 user nova-compute[72849]: INFO nova.compute.manager [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Terminating instance
Aug 15 16:40:54 user nova-compute[72849]: DEBUG nova.compute.manager [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:40:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-5f61a2a7-6b5e-498c-9295-04aa4ed591a3 req-c4cb2bbb-f93e-4c84-8bbd-10b2245c823d service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Received event network-vif-unplugged-2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5f61a2a7-6b5e-498c-9295-04aa4ed591a3 req-c4cb2bbb-f93e-4c84-8bbd-10b2245c823d service nova] Acquiring lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5f61a2a7-6b5e-498c-9295-04aa4ed591a3 req-c4cb2bbb-f93e-4c84-8bbd-10b2245c823d service nova] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5f61a2a7-6b5e-498c-9295-04aa4ed591a3 req-c4cb2bbb-f93e-4c84-8bbd-10b2245c823d service nova] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-5f61a2a7-6b5e-498c-9295-04aa4ed591a3 req-c4cb2bbb-f93e-4c84-8bbd-10b2245c823d service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] No waiting events found dispatching network-vif-unplugged-2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG nova.compute.manager [req-5f61a2a7-6b5e-498c-9295-04aa4ed591a3 req-c4cb2bbb-f93e-4c84-8bbd-10b2245c823d service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Received event network-vif-unplugged-2913e4f1-8c8c-4ac7-a159-835838a33e70 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:55 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Instance destroyed successfully.
Aug 15 16:40:55 user nova-compute[72849]: DEBUG nova.objects.instance [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lazy-loading 'resources' on Instance uuid 0bddec9f-7eec-44b1-9a56-44d09512c456 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:37:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1731701630',display_name='tempest-TestStampPattern-server-1731701630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1731701630',id=41,image_ref='bd5c5fb4-905c-42c5-b836-3a0660bee99b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMi45qmqS3JUOsCtLhOHr8dN0lAxTLLIGCYJEIKxFLRznYZlSyGaG7loxy0DXCnWZwO5buUhd7UKGlCKbbX0UVLrUyKLyamZajv/9tO6pGG+kS70g0npId3SIuDJieSVQ==',key_name='tempest-TestStampPattern-336120091',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:37:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='535e7bf486d84793aafc48b88712daf5',ramdisk_id='',reservation_id='r-to4nvgww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f0007ddd-f25d-4708-b617-d98728f6ffcc',image_min_disk='1',image_min_ram='0',image_owner_id='535e7bf486d84793aafc48b88712daf5',image_owner_project_name='tempest-TestStampPattern-1132040334',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1132040334-project-member',image_user_id='97a15b3aa0e9432da4b36d52bba1a9a8',owner_project_name='tempest-TestStampPattern-1132040334',owner_user_name='tempest-TestStampPattern-1132040334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:37:53Z,user_data=None,user_id='97a15b3aa0e9432da4b36d52bba1a9a8',uuid=0bddec9f-7eec-44b1-9a56-44d09512c456,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "address": "fa:16:3e:7d:86:81", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2913e4f1-8c", "ovs_interfaceid": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Converting VIF {"id": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "address": "fa:16:3e:7d:86:81", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2913e4f1-8c", "ovs_interfaceid": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:86:81,bridge_name='br-int',has_traffic_filtering=True,id=2913e4f1-8c8c-4ac7-a159-835838a33e70,network=Network(07227fb5-780c-4de1-8211-f2ac91fd1908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2913e4f1-8c') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG os_vif [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:86:81,bridge_name='br-int',has_traffic_filtering=True,id=2913e4f1-8c8c-4ac7-a159-835838a33e70,network=Network(07227fb5-780c-4de1-8211-f2ac91fd1908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2913e4f1-8c') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2913e4f1-8c, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:40:55 user nova-compute[72849]: INFO os_vif [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:86:81,bridge_name='br-int',has_traffic_filtering=True,id=2913e4f1-8c8c-4ac7-a159-835838a33e70,network=Network(07227fb5-780c-4de1-8211-f2ac91fd1908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2913e4f1-8c')
Aug 15 16:40:55 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Deleting instance files /opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456_del
Aug 15 16:40:55 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Deletion of /opt/stack/data/nova/instances/0bddec9f-7eec-44b1-9a56-44d09512c456_del complete
Aug 15 16:40:55 user nova-compute[72849]: DEBUG nova.network.neutron [req-2853dbf7-6f5d-4bc2-a424-794f31a0f3b5 req-0fefa423-9a16-468f-a4e7-efb8937966a6 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Updated VIF entry in instance network info cache for port 2913e4f1-8c8c-4ac7-a159-835838a33e70. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG nova.network.neutron [req-2853dbf7-6f5d-4bc2-a424-794f31a0f3b5 req-0fefa423-9a16-468f-a4e7-efb8937966a6 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Updating instance_info_cache with network_info: [{"id": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "address": "fa:16:3e:7d:86:81", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2913e4f1-8c", "ovs_interfaceid": "2913e4f1-8c8c-4ac7-a159-835838a33e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2853dbf7-6f5d-4bc2-a424-794f31a0f3b5 req-0fefa423-9a16-468f-a4e7-efb8937966a6 service nova] Releasing lock "refresh_cache-0bddec9f-7eec-44b1-9a56-44d09512c456" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:40:55 user nova-compute[72849]: INFO nova.compute.manager [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 15 16:40:55 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:40:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:56 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:40:56 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Took 0.79 seconds to deallocate network for instance.
Aug 15 16:40:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:56 user nova-compute[72849]: DEBUG nova.compute.manager [req-a990f050-a140-476a-9cae-34aab28041ea req-b4931876-aca3-4470-b111-3aff2807bd15 service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Received event network-changed-6730cbf2-c90b-49ba-b2f7-085a3700cdc1 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:40:56 user nova-compute[72849]: DEBUG nova.compute.manager [req-a990f050-a140-476a-9cae-34aab28041ea req-b4931876-aca3-4470-b111-3aff2807bd15 service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Refreshing instance network info cache due to event network-changed-6730cbf2-c90b-49ba-b2f7-085a3700cdc1. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:40:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a990f050-a140-476a-9cae-34aab28041ea req-b4931876-aca3-4470-b111-3aff2807bd15 service nova] Acquiring lock "refresh_cache-ff3d801d-ddc7-4f90-8cc8-a577d6482270" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:40:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a990f050-a140-476a-9cae-34aab28041ea req-b4931876-aca3-4470-b111-3aff2807bd15 service nova] Acquired lock "refresh_cache-ff3d801d-ddc7-4f90-8cc8-a577d6482270" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:40:56 user nova-compute[72849]: DEBUG nova.network.neutron [req-a990f050-a140-476a-9cae-34aab28041ea req-b4931876-aca3-4470-b111-3aff2807bd15 service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Refreshing network info cache for port 6730cbf2-c90b-49ba-b2f7-085a3700cdc1 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:40:56 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:40:56 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:40:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:56 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Deleted allocations for instance 0bddec9f-7eec-44b1-9a56-44d09512c456
Aug 15 16:40:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e1c5226c-61df-4c35-9cd8-71bed174e768 tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.193s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:57 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117642.0248015, 5a4db694-b564-43b5-829c-08b9d54effed => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:40:57 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] VM Stopped (Lifecycle Event)
Aug 15 16:40:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-8c56c856-46c5-4372-bb39-57b5ac50b6b7 None None] [instance: 5a4db694-b564-43b5-829c-08b9d54effed] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:40:57 user nova-compute[72849]: DEBUG nova.network.neutron [req-a990f050-a140-476a-9cae-34aab28041ea req-b4931876-aca3-4470-b111-3aff2807bd15 service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Updated VIF entry in instance network info cache for port 6730cbf2-c90b-49ba-b2f7-085a3700cdc1. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:40:57 user nova-compute[72849]: DEBUG nova.network.neutron [req-a990f050-a140-476a-9cae-34aab28041ea req-b4931876-aca3-4470-b111-3aff2807bd15 service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Updating instance_info_cache with network_info: [{"id": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "address": "fa:16:3e:79:89:fb", "network": {"id": "e58f7f18-d91b-491d-a7df-8dcfd65e8c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1908380537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5023408270042d1849f75aa91a764c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730cbf2-c9", "ovs_interfaceid": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:40:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Received event network-vif-plugged-2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:40:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] Acquiring lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] No waiting events found dispatching network-vif-plugged-2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:40:57 user nova-compute[72849]: WARNING nova.compute.manager [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Received unexpected event network-vif-plugged-2913e4f1-8c8c-4ac7-a159-835838a33e70 for instance with vm_state deleted and task_state None.
Aug 15 16:40:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Received event network-vif-plugged-2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:40:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] Acquiring lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] No waiting events found dispatching network-vif-plugged-2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:40:57 user nova-compute[72849]: WARNING nova.compute.manager [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Received unexpected event network-vif-plugged-2913e4f1-8c8c-4ac7-a159-835838a33e70 for instance with vm_state deleted and task_state None.
Aug 15 16:40:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Received event network-vif-plugged-2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:40:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] Acquiring lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] Lock "0bddec9f-7eec-44b1-9a56-44d09512c456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] No waiting events found dispatching network-vif-plugged-2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:40:57 user nova-compute[72849]: WARNING nova.compute.manager [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Received unexpected event network-vif-plugged-2913e4f1-8c8c-4ac7-a159-835838a33e70 for instance with vm_state deleted and task_state None.
Aug 15 16:40:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-fb769768-77ce-42f7-b76e-d75ba5615f21 req-a0068654-4212-447d-b3c9-41d04d30b350 service nova] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Received event network-vif-deleted-2913e4f1-8c8c-4ac7-a159-835838a33e70 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:40:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a990f050-a140-476a-9cae-34aab28041ea req-b4931876-aca3-4470-b111-3aff2807bd15 service nova] Releasing lock "refresh_cache-ff3d801d-ddc7-4f90-8cc8-a577d6482270" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:40:59 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Creating image(s)
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Did not create local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Ensure instance console log exists: /opt/stack/data/nova/instances/7722de29-482a-4f75-a3ed-d4293fdd9db8/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Start _get_guest_xml network_info=[{"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRkmTJKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7722de29-482a-4f75-a3ed-d4293fdd9db8', 'attached_at': '', 'detached_at': '', 'volume_id': 'bea85e2c-f0d1-47ab-819b-736df16b67d1', 'serial': 'bea85e2c-f0d1-47ab-819b-736df16b67d1'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'd47d7cec-0406-4202-a51d-2fe8905a3da2', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:40:59 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:40:59 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRkmTJKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:40:59 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:40:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:40:59 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:40:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:40:59 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[436b9c0c-92a4-4dea-a7e6-88baddcda704]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:40:59 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c1f8cb-b585-47d2-9c8b-3909992421e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1] added
Aug 15 16:40:59 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5bc4e9-6f1d-478f-9c7e-07634ec6b63a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b507a14-b99c-4404-a080-ce194155bb73]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iRkmTJKb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iRkmTJKb" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc6c309-362b-4159-82aa-d8ec125fbc70]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iRkmTJKb'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[27feb524-7b3a-48fe-9db7-94c1fb3e7446]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad37970-3fb8-46a4-bc79-0395571179e4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:40:59 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:40:59 user nova-compute[72849]:  {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:40:59 user nova-compute[72849]: WARNING os_brick.initiator.connectors.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 16:40:59 user nova-compute[72849]: 
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[197b506e-96d2-413c-8dad-ad37a1281b2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1, portal: 172.16.0.220,3260]
Aug 15 16:40:59 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1, portal: 172.16.0.220,3260] successful.
Aug 15 16:40:59 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4ec90c-356b-4e50-a7df-b133d0723996]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:40:59 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:00 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b130cd-5d03-4859-8276-d49f00c6f160]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:41:00 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:41:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:41:00 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:41:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:41:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:41:00 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:41:00 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:41:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:00 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:00 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9d39d6-b94d-429d-a1d6-74734a89a8e1]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:00 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:41:00 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRkmTJKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:41:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23961393565306161', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961393565306161', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-648703954',display_name='tempest-TestShelveInstance-server-648703954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-648703954',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1+HLabUqq6zIPMWDL04qSO39/IVnfVMHlk8RRaC4xTbnCxgJV/Rgr0HlZCGRDxgqa2CuyuCcrgUfpLO68W7/a/HLUfrrhWm6+Zr9c4OK9ZRJUQchNl3AuGahuKsjTUww==',key_name='tempest-TestShelveInstance-1445995414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a35bb132e2cc4dfc99e383862ce86829',ramdisk_id='',reservation_id='r-2h2pgqco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-628082297',owner_user_name='tempest-TestShelveInstance-628082297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:40:46Z,user_data=None,user_id='ae3d508464a14dad9113a56fac6f0f32',uuid=7722de29-482a-4f75-a3ed-d4293fdd9db8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Converting VIF {"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=4bb47a58-9f72-4291-9270-b5a0a988725c,network=Network(1d8f6acf-691c-4a97-a585-dd9fc43a7b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb47a58-9f') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG nova.objects.instance [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lazy-loading 'pci_devices' on Instance uuid 7722de29-482a-4f75-a3ed-d4293fdd9db8 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:41:01 user nova-compute[72849]:   <uuid>7722de29-482a-4f75-a3ed-d4293fdd9db8</uuid>
Aug 15 16:41:01 user nova-compute[72849]:   <name>instance-0000002b</name>
Aug 15 16:41:01 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:41:01 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:41:01 user nova-compute[72849]:   <metadata>
Aug 15 16:41:01 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:41:01 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:41:01 user nova-compute[72849]:       <nova:name>tempest-TestShelveInstance-server-648703954</nova:name>
Aug 15 16:41:01 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:40:59</nova:creationTime>
Aug 15 16:41:01 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:41:01 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:41:01 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:41:01 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:41:01 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:41:01 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:41:01 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:41:01 user nova-compute[72849]:       <nova:owner>
Aug 15 16:41:01 user nova-compute[72849]:         <nova:user uuid="ae3d508464a14dad9113a56fac6f0f32">tempest-TestShelveInstance-628082297-project-member</nova:user>
Aug 15 16:41:01 user nova-compute[72849]:         <nova:project uuid="a35bb132e2cc4dfc99e383862ce86829">tempest-TestShelveInstance-628082297</nova:project>
Aug 15 16:41:01 user nova-compute[72849]:       </nova:owner>
Aug 15 16:41:01 user nova-compute[72849]:       <nova:ports>
Aug 15 16:41:01 user nova-compute[72849]:         <nova:port uuid="4bb47a58-9f72-4291-9270-b5a0a988725c">
Aug 15 16:41:01 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:41:01 user nova-compute[72849]:         </nova:port>
Aug 15 16:41:01 user nova-compute[72849]:       </nova:ports>
Aug 15 16:41:01 user nova-compute[72849]:     </nova:instance>
Aug 15 16:41:01 user nova-compute[72849]:   </metadata>
Aug 15 16:41:01 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:41:01 user nova-compute[72849]:     <system>
Aug 15 16:41:01 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:41:01 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:41:01 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:41:01 user nova-compute[72849]:       <entry name="serial">7722de29-482a-4f75-a3ed-d4293fdd9db8</entry>
Aug 15 16:41:01 user nova-compute[72849]:       <entry name="uuid">7722de29-482a-4f75-a3ed-d4293fdd9db8</entry>
Aug 15 16:41:01 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:41:01 user nova-compute[72849]:     </system>
Aug 15 16:41:01 user nova-compute[72849]:   </sysinfo>
Aug 15 16:41:01 user nova-compute[72849]:   <os>
Aug 15 16:41:01 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:41:01 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:41:01 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:41:01 user nova-compute[72849]:   </os>
Aug 15 16:41:01 user nova-compute[72849]:   <features>
Aug 15 16:41:01 user nova-compute[72849]:     <acpi/>
Aug 15 16:41:01 user nova-compute[72849]:     <apic/>
Aug 15 16:41:01 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:41:01 user nova-compute[72849]:   </features>
Aug 15 16:41:01 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:41:01 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:41:01 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:41:01 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:41:01 user nova-compute[72849]:   </clock>
Aug 15 16:41:01 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:41:01 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:41:01 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:41:01 user nova-compute[72849]:   </cpu>
Aug 15 16:41:01 user nova-compute[72849]:   <devices>
Aug 15 16:41:01 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:41:01 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:41:01 user nova-compute[72849]:       <source dev="/dev/sdb"/>
Aug 15 16:41:01 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:41:01 user nova-compute[72849]:       <serial>bea85e2c-f0d1-47ab-819b-736df16b67d1</serial>
Aug 15 16:41:01 user nova-compute[72849]:     </disk>
Aug 15 16:41:01 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:41:01 user nova-compute[72849]:       <mac address="fa:16:3e:83:2e:30"/>
Aug 15 16:41:01 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:41:01 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:41:01 user nova-compute[72849]:       <target dev="tap4bb47a58-9f"/>
Aug 15 16:41:01 user nova-compute[72849]:     </interface>
Aug 15 16:41:01 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:41:01 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/7722de29-482a-4f75-a3ed-d4293fdd9db8/console.log" append="off"/>
Aug 15 16:41:01 user nova-compute[72849]:     </serial>
Aug 15 16:41:01 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:41:01 user nova-compute[72849]:     <video>
Aug 15 16:41:01 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:41:01 user nova-compute[72849]:     </video>
Aug 15 16:41:01 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:41:01 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:41:01 user nova-compute[72849]:     </rng>
Aug 15 16:41:01 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:41:01 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:41:01 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:41:01 user nova-compute[72849]:     </memballoon>
Aug 15 16:41:01 user nova-compute[72849]:   </devices>
Aug 15 16:41:01 user nova-compute[72849]: </domain>
Aug 15 16:41:01 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-648703954',display_name='tempest-TestShelveInstance-server-648703954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-648703954',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1+HLabUqq6zIPMWDL04qSO39/IVnfVMHlk8RRaC4xTbnCxgJV/Rgr0HlZCGRDxgqa2CuyuCcrgUfpLO68W7/a/HLUfrrhWm6+Zr9c4OK9ZRJUQchNl3AuGahuKsjTUww==',key_name='tempest-TestShelveInstance-1445995414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a35bb132e2cc4dfc99e383862ce86829',ramdisk_id='',reservation_id='r-2h2pgqco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-628082297',owner_user_name='tempest-TestShelveInstance-628082297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:40:46Z,user_data=None,user_id='ae3d508464a14dad9113a56fac6f0f32',uuid=7722de29-482a-4f75-a3ed-d4293fdd9db8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Converting VIF {"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=4bb47a58-9f72-4291-9270-b5a0a988725c,network=Network(1d8f6acf-691c-4a97-a585-dd9fc43a7b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb47a58-9f') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG os_vif [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=4bb47a58-9f72-4291-9270-b5a0a988725c,network=Network(1d8f6acf-691c-4a97-a585-dd9fc43a7b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb47a58-9f') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bb47a58-9f, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4bb47a58-9f, col_values=(('external_ids', {'iface-id': '4bb47a58-9f72-4291-9270-b5a0a988725c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:2e:30', 'vm-uuid': '7722de29-482a-4f75-a3ed-d4293fdd9db8'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:01 user nova-compute[72849]: INFO os_vif [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=4bb47a58-9f72-4291-9270-b5a0a988725c,network=Network(1d8f6acf-691c-4a97-a585-dd9fc43a7b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb47a58-9f')
Aug 15 16:41:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:41:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] No VIF found with MAC fa:16:3e:83:2e:30, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG nova.objects.instance [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lazy-loading 'flavor' on Instance uuid ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:41:02 user nova-compute[72849]: INFO nova.compute.manager [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Attaching volume f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 to /dev/vdb
Aug 15 16:41:02 user nova-compute[72849]: DEBUG os_brick.utils [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad95769-58f1-46db-b6fd-84ca092bcf6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[655a234e-afaf-44cf-a802-6ad5f69eab1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c98028-51f2-4e95-b4b8-0fb07aec805f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a1aa9f-0c64-47bb-b187-44e094989654]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:41:02 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aa60a0-f1cb-4289-8eb5-747e8d6596a4]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG os_brick.utils [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Updating existing volume attachment record: 786540cc-49a4-454f-af29-eaaf276fcd8b {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG nova.compute.manager [req-1826159f-7c66-4737-8398-c8d43982e637 req-80587f30-4fa3-47b1-9450-03728efad1dc service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received event network-vif-plugged-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1826159f-7c66-4737-8398-c8d43982e637 req-80587f30-4fa3-47b1-9450-03728efad1dc service nova] Acquiring lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1826159f-7c66-4737-8398-c8d43982e637 req-80587f30-4fa3-47b1-9450-03728efad1dc service nova] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1826159f-7c66-4737-8398-c8d43982e637 req-80587f30-4fa3-47b1-9450-03728efad1dc service nova] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:41:02 user nova-compute[72849]: DEBUG nova.compute.manager [req-1826159f-7c66-4737-8398-c8d43982e637 req-80587f30-4fa3-47b1-9450-03728efad1dc service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] No waiting events found dispatching network-vif-plugged-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:41:02 user nova-compute[72849]: WARNING nova.compute.manager [req-1826159f-7c66-4737-8398-c8d43982e637 req-80587f30-4fa3-47b1-9450-03728efad1dc service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received unexpected event network-vif-plugged-4bb47a58-9f72-4291-9270-b5a0a988725c for instance with vm_state building and task_state spawning.
Aug 15 16:41:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:04 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117664.647561, 7722de29-482a-4f75-a3ed-d4293fdd9db8 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:41:04 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] VM Resumed (Lifecycle Event)
Aug 15 16:41:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:41:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:41:04 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Instance spawned successfully.
Aug 15 16:41:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:41:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:41:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:41:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:41:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:41:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:41:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:41:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:41:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:41:04 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:41:04 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117664.649444, 7722de29-482a-4f75-a3ed-d4293fdd9db8 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:41:04 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] VM Started (Lifecycle Event)
Aug 15 16:41:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:41:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:41:04 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:41:04 user nova-compute[72849]: INFO nova.compute.manager [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Took 5.08 seconds to spawn the instance on the hypervisor.
Aug 15 16:41:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:41:04 user nova-compute[72849]: DEBUG nova.compute.manager [req-eb5bb247-344a-4ed5-b341-c183a42a7810 req-07a22814-8b5d-40ae-bdc1-ca6d036202bc service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received event network-vif-plugged-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:41:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eb5bb247-344a-4ed5-b341-c183a42a7810 req-07a22814-8b5d-40ae-bdc1-ca6d036202bc service nova] Acquiring lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:41:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eb5bb247-344a-4ed5-b341-c183a42a7810 req-07a22814-8b5d-40ae-bdc1-ca6d036202bc service nova] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:41:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eb5bb247-344a-4ed5-b341-c183a42a7810 req-07a22814-8b5d-40ae-bdc1-ca6d036202bc service nova] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:41:04 user nova-compute[72849]: DEBUG nova.compute.manager [req-eb5bb247-344a-4ed5-b341-c183a42a7810 req-07a22814-8b5d-40ae-bdc1-ca6d036202bc service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] No waiting events found dispatching network-vif-plugged-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:41:04 user nova-compute[72849]: WARNING nova.compute.manager [req-eb5bb247-344a-4ed5-b341-c183a42a7810 req-07a22814-8b5d-40ae-bdc1-ca6d036202bc service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received unexpected event network-vif-plugged-4bb47a58-9f72-4291-9270-b5a0a988725c for instance with vm_state active and task_state None.
Aug 15 16:41:04 user nova-compute[72849]: INFO nova.compute.manager [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Took 19.84 seconds to build instance.
Aug 15 16:41:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4672a871-b369-42b5-89d5-9e5b329fd638 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.959s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:41:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:10 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117655.546147, 0bddec9f-7eec-44b1-9a56-44d09512c456 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:41:10 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] VM Stopped (Lifecycle Event)
Aug 15 16:41:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5830d558-3449-4ce5-94f9-75d465a13308 None None] [instance: 0bddec9f-7eec-44b1-9a56-44d09512c456] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:41:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CXPTLBkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:41:12 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:41:12 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:41:12 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[094ddde9-be57-4eb8-b96a-b5caedeeac78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:41:12 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.041s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[032a3d01-2a75-4043-810f-b4de1611f09c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8] added
Aug 15 16:41:12 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e35af6-1e43-4f23-8399-dd0373e3c81a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c80a682-eab3-48d6-932a-052618734e7a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CXPTLBkF {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CXPTLBkF" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3904b249-df21-4444-98e4-be131f4bf0d9]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CXPTLBkF'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[399c9e10-03c8-44ae-8af1-19b7cb904e33]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc1332e-9a3a-4871-bb97-1c884d9058ae]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:41:12 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:41:12 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[975c565a-15ef-4996-81d9-0f346c487833]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8, portal: 172.16.0.220,3260]
Aug 15 16:41:12 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8, portal: 172.16.0.220,3260] successful.
Aug 15 16:41:12 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec236ff3-ac45-4f13-a8dc-7235e3741453]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac73865-2154-49e8-a0e8-f309ea64ad1d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:41:12 user nova-compute[72849]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 (non-flash)
Aug 15 16:41:12 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:41:12 user nova-compute[72849]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 (non-flash)
Aug 15 16:41:12 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb867cd5-5f20-4f54-8c6f-a4cd39410ed5]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:41:12 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CXPTLBkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:41:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:41:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23437623036623863', 'path': '/dev/sdc'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:41:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437623036623863', 'path': '/dev/sdc'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:41:13 user nova-compute[72849]: DEBUG nova.objects.instance [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lazy-loading 'flavor' on Instance uuid ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:41:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:41:13 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:41:13 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:41:13 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:41:13 user nova-compute[72849]:   <serial>f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8</serial>
Aug 15 16:41:13 user nova-compute[72849]: </disk>
Aug 15 16:41:13 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:41:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:41:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:41:14 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] No VIF found with MAC fa:16:3e:79:89:fb, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:41:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0f1ceb4b-71a2-4ea3-9f60-31803d6b8ba7 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.146s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:41:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:38 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:41:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:41:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:41:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-f0007ddd-f25d-4708-b617-d98728f6ffcc" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:41:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-f0007ddd-f25d-4708-b617-d98728f6ffcc" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:41:38 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:41:38 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid f0007ddd-f25d-4708-b617-d98728f6ffcc {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:41:38 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Updating instance_info_cache with network_info: [{"id": "de3685be-4bbe-4c94-b193-49797916f7cc", "address": "fa:16:3e:b0:a4:25", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3685be-4b", "ovs_interfaceid": "de3685be-4bbe-4c94-b193-49797916f7cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:41:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-f0007ddd-f25d-4708-b617-d98728f6ffcc" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:41:38 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:41:38 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:41:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:40 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:41:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:41 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:41:42 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:41:44 user nova-compute[72849]: INFO nova.compute.manager [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Detaching volume f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8
Aug 15 16:41:44 user nova-compute[72849]: INFO nova.virt.block_device [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Attempting to driver detach volume f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 from mountpoint /dev/vdb
Aug 15 16:41:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Attempting to detach device vdb from instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:41:44 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:41:44 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:41:44 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:41:44 user nova-compute[72849]:   <serial>f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8</serial>
Aug 15 16:41:44 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:41:44 user nova-compute[72849]: </disk>
Aug 15 16:41:44 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:41:44 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Successfully detached device vdb from instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 from the persistent domain config.
Aug 15 16:41:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:41:44 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:41:44 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:41:44 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:41:44 user nova-compute[72849]:   <serial>f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8</serial>
Aug 15 16:41:44 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:41:44 user nova-compute[72849]: </disk>
Aug 15 16:41:44 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692117704.5910604, ff3d801d-ddc7-4f90-8cc8-a577d6482270 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:41:44 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Successfully detached device vdb from instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 from the live domain config.
Aug 15 16:41:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CXPTLBkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:41:44 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:41:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaabf483-9898-488c-9c4b-443415961b2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0bcb61-a2ee-4799-b1a7-64aecc3162f9]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:41:44 user nova-compute[72849]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 (non-flash)
Aug 15 16:41:44 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:41:44 user nova-compute[72849]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 (non-flash)
Aug 15 16:41:44 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc358294550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8'): ({'sdc'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Removing single pathed devices sdc {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f961f45c-6489-4bd7-920e-eac628791e5a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[331114b1-193a-46ba-9e25-102b79d0895f]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Flushing IO for device /dev/sdc {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[381d89d9-ca9f-4330-aa8d-f167120f758a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d242e094-825f-4839-90ad-29357762e1b0]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e67385c-e961-47f0-9c20-93743a4abf5f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c094807-ad18-4aa9-ae5f-7f959fdfd735]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8, portal: 172.16.0.220,3260]
Aug 15 16:41:44 user nova-compute[72849]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8, portal: 172.16.0.220,3260] successful.
Aug 15 16:41:44 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7a3d849-5f82-4d9c-92b8-0b4b3f9283c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[17aaeff1-d79a-4808-abb0-5103f8c12b10]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] <== disconnect_volume: return (368ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:41:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:41:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:41:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:41:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:41:45 user nova-compute[72849]: DEBUG nova.objects.instance [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lazy-loading 'flavor' on Instance uuid ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:41:46 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:41:46 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:41:46 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8302MB free_disk=25.134197235107422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:41:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:41:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:41:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-d26b29ad-0414-472f-992e-19cf9c7599aa tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.017s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:41:46 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance f0007ddd-f25d-4708-b617-d98728f6ffcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:41:46 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:41:46 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 7722de29-482a-4f75-a3ed-d4293fdd9db8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:41:46 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:41:46 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:41:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:41:46 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:41:46 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:41:46 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:41:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:41:48 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:41:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:41:48 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:41:49 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:41:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:41:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:41:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:41:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:41:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:41:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:41:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:41:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:41:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:41:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:41:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG nova.compute.manager [req-e803b854-a973-47a1-ba8d-a1cc5a6a99a8 req-34e6bae8-2d37-4e3b-95b2-8cae96fce323 service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Received event network-changed-de3685be-4bbe-4c94-b193-49797916f7cc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG nova.compute.manager [req-e803b854-a973-47a1-ba8d-a1cc5a6a99a8 req-34e6bae8-2d37-4e3b-95b2-8cae96fce323 service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Refreshing instance network info cache due to event network-changed-de3685be-4bbe-4c94-b193-49797916f7cc. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e803b854-a973-47a1-ba8d-a1cc5a6a99a8 req-34e6bae8-2d37-4e3b-95b2-8cae96fce323 service nova] Acquiring lock "refresh_cache-f0007ddd-f25d-4708-b617-d98728f6ffcc" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e803b854-a973-47a1-ba8d-a1cc5a6a99a8 req-34e6bae8-2d37-4e3b-95b2-8cae96fce323 service nova] Acquired lock "refresh_cache-f0007ddd-f25d-4708-b617-d98728f6ffcc" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG nova.network.neutron [req-e803b854-a973-47a1-ba8d-a1cc5a6a99a8 req-34e6bae8-2d37-4e3b-95b2-8cae96fce323 service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Refreshing network info cache for port de3685be-4bbe-4c94-b193-49797916f7cc {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "f0007ddd-f25d-4708-b617-d98728f6ffcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "f0007ddd-f25d-4708-b617-d98728f6ffcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:06 user nova-compute[72849]: INFO nova.compute.manager [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Terminating instance
Aug 15 16:42:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG nova.compute.manager [req-61d389bf-fa57-41f6-bf33-57a59de0d5b9 req-5ab3cbaa-d6e6-4ddb-80c0-53f1dd7dd1db service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Received event network-vif-unplugged-de3685be-4bbe-4c94-b193-49797916f7cc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-61d389bf-fa57-41f6-bf33-57a59de0d5b9 req-5ab3cbaa-d6e6-4ddb-80c0-53f1dd7dd1db service nova] Acquiring lock "f0007ddd-f25d-4708-b617-d98728f6ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-61d389bf-fa57-41f6-bf33-57a59de0d5b9 req-5ab3cbaa-d6e6-4ddb-80c0-53f1dd7dd1db service nova] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-61d389bf-fa57-41f6-bf33-57a59de0d5b9 req-5ab3cbaa-d6e6-4ddb-80c0-53f1dd7dd1db service nova] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG nova.compute.manager [req-61d389bf-fa57-41f6-bf33-57a59de0d5b9 req-5ab3cbaa-d6e6-4ddb-80c0-53f1dd7dd1db service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] No waiting events found dispatching network-vif-unplugged-de3685be-4bbe-4c94-b193-49797916f7cc {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG nova.compute.manager [req-61d389bf-fa57-41f6-bf33-57a59de0d5b9 req-5ab3cbaa-d6e6-4ddb-80c0-53f1dd7dd1db service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Received event network-vif-unplugged-de3685be-4bbe-4c94-b193-49797916f7cc for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG nova.network.neutron [req-e803b854-a973-47a1-ba8d-a1cc5a6a99a8 req-34e6bae8-2d37-4e3b-95b2-8cae96fce323 service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Updated VIF entry in instance network info cache for port de3685be-4bbe-4c94-b193-49797916f7cc. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG nova.network.neutron [req-e803b854-a973-47a1-ba8d-a1cc5a6a99a8 req-34e6bae8-2d37-4e3b-95b2-8cae96fce323 service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Updating instance_info_cache with network_info: [{"id": "de3685be-4bbe-4c94-b193-49797916f7cc", "address": "fa:16:3e:b0:a4:25", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3685be-4b", "ovs_interfaceid": "de3685be-4bbe-4c94-b193-49797916f7cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:42:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-e803b854-a973-47a1-ba8d-a1cc5a6a99a8 req-34e6bae8-2d37-4e3b-95b2-8cae96fce323 service nova] Releasing lock "refresh_cache-f0007ddd-f25d-4708-b617-d98728f6ffcc" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:42:07 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Instance destroyed successfully.
Aug 15 16:42:07 user nova-compute[72849]: DEBUG nova.objects.instance [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lazy-loading 'resources' on Instance uuid f0007ddd-f25d-4708-b617-d98728f6ffcc {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:42:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:34:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1930308320',display_name='tempest-TestStampPattern-server-1930308320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1930308320',id=37,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMi45qmqS3JUOsCtLhOHr8dN0lAxTLLIGCYJEIKxFLRznYZlSyGaG7loxy0DXCnWZwO5buUhd7UKGlCKbbX0UVLrUyKLyamZajv/9tO6pGG+kS70g0npId3SIuDJieSVQ==',key_name='tempest-TestStampPattern-336120091',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:34:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='535e7bf486d84793aafc48b88712daf5',ramdisk_id='',reservation_id='r-8qqflud6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1132040334',owner_user_name='tempest-TestStampPattern-1132040334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:37:41Z,user_data=None,user_id='97a15b3aa0e9432da4b36d52bba1a9a8',uuid=f0007ddd-f25d-4708-b617-d98728f6ffcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de3685be-4bbe-4c94-b193-49797916f7cc", "address": "fa:16:3e:b0:a4:25", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3685be-4b", "ovs_interfaceid": "de3685be-4bbe-4c94-b193-49797916f7cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:42:07 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Converting VIF {"id": "de3685be-4bbe-4c94-b193-49797916f7cc", "address": "fa:16:3e:b0:a4:25", "network": {"id": "07227fb5-780c-4de1-8211-f2ac91fd1908", "bridge": "br-int", "label": "tempest-TestStampPattern-505863715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535e7bf486d84793aafc48b88712daf5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3685be-4b", "ovs_interfaceid": "de3685be-4bbe-4c94-b193-49797916f7cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:42:07 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:a4:25,bridge_name='br-int',has_traffic_filtering=True,id=de3685be-4bbe-4c94-b193-49797916f7cc,network=Network(07227fb5-780c-4de1-8211-f2ac91fd1908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3685be-4b') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:42:07 user nova-compute[72849]: DEBUG os_vif [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:a4:25,bridge_name='br-int',has_traffic_filtering=True,id=de3685be-4bbe-4c94-b193-49797916f7cc,network=Network(07227fb5-780c-4de1-8211-f2ac91fd1908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3685be-4b') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:42:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde3685be-4b, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:42:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:42:07 user nova-compute[72849]: INFO os_vif [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:a4:25,bridge_name='br-int',has_traffic_filtering=True,id=de3685be-4bbe-4c94-b193-49797916f7cc,network=Network(07227fb5-780c-4de1-8211-f2ac91fd1908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3685be-4b')
Aug 15 16:42:07 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Deleting instance files /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc_del
Aug 15 16:42:07 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Deletion of /opt/stack/data/nova/instances/f0007ddd-f25d-4708-b617-d98728f6ffcc_del complete
Aug 15 16:42:07 user nova-compute[72849]: INFO nova.compute.manager [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 15 16:42:07 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:42:07 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:42:07 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:42:07 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:42:07 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Took 0.55 seconds to deallocate network for instance.
Aug 15 16:42:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:07 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:42:07 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:42:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:07 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Deleted allocations for instance f0007ddd-f25d-4708-b617-d98728f6ffcc
Aug 15 16:42:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c43c98ea-6859-414d-9a95-5116f8f6691f tempest-TestStampPattern-1132040334 tempest-TestStampPattern-1132040334-project-member] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.788s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-e49613ae-30b2-42ff-8459-a0824072736f req-e1e7ad97-dcb0-4387-9c53-5ddc43138993 service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Received event network-vif-deleted-de3685be-4bbe-4c94-b193-49797916f7cc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:42:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-5ecc5d22-61f6-414d-9de2-a46b1c58fdb6 req-9d6c1c02-8d1f-495c-851c-9c05b8ff6f9f service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Received event network-vif-plugged-de3685be-4bbe-4c94-b193-49797916f7cc {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:42:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5ecc5d22-61f6-414d-9de2-a46b1c58fdb6 req-9d6c1c02-8d1f-495c-851c-9c05b8ff6f9f service nova] Acquiring lock "f0007ddd-f25d-4708-b617-d98728f6ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5ecc5d22-61f6-414d-9de2-a46b1c58fdb6 req-9d6c1c02-8d1f-495c-851c-9c05b8ff6f9f service nova] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5ecc5d22-61f6-414d-9de2-a46b1c58fdb6 req-9d6c1c02-8d1f-495c-851c-9c05b8ff6f9f service nova] Lock "f0007ddd-f25d-4708-b617-d98728f6ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-5ecc5d22-61f6-414d-9de2-a46b1c58fdb6 req-9d6c1c02-8d1f-495c-851c-9c05b8ff6f9f service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] No waiting events found dispatching network-vif-plugged-de3685be-4bbe-4c94-b193-49797916f7cc {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:42:08 user nova-compute[72849]: WARNING nova.compute.manager [req-5ecc5d22-61f6-414d-9de2-a46b1c58fdb6 req-9d6c1c02-8d1f-495c-851c-9c05b8ff6f9f service nova] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Received unexpected event network-vif-plugged-de3685be-4bbe-4c94-b193-49797916f7cc for instance with vm_state deleted and task_state None.
Aug 15 16:42:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:42:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:42:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:42:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:42:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:21 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117726.9955544, f0007ddd-f25d-4708-b617-d98728f6ffcc => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:42:21 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] VM Stopped (Lifecycle Event)
Aug 15 16:42:22 user nova-compute[72849]: DEBUG nova.compute.manager [None req-78b36257-b281-4f7d-a295-78e304b0d65f None None] [instance: f0007ddd-f25d-4708-b617-d98728f6ffcc] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:42:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:35 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:42:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG nova.objects.instance [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lazy-loading 'flavor' on Instance uuid ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:38 user nova-compute[72849]: INFO nova.compute.manager [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Attaching volume b34013e8-8527-418b-bc34-c58efd6f9740 to /dev/vdb
Aug 15 16:42:38 user nova-compute[72849]: DEBUG os_brick.utils [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e876325-2e70-463c-9f2e-dfad22f4d97d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93bf0eb-166e-4363-8d3d-62c313958bf5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b32daa3-078d-4e07-ad3e-bb6166e9199a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5382a40a-4c1d-49fb-bd3e-76dd71f330a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:42:38 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:42:38 user nova-compute[72849]: DEBUG nova.compute.manager [req-07e6f39b-6ff7-4b27-9441-38e70e150846 req-0c4a4a23-811a-476b-8a80-7ccec92d5ae1 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received event network-changed-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG nova.compute.manager [req-07e6f39b-6ff7-4b27-9441-38e70e150846 req-0c4a4a23-811a-476b-8a80-7ccec92d5ae1 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Refreshing instance network info cache due to event network-changed-4bb47a58-9f72-4291-9270-b5a0a988725c. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-07e6f39b-6ff7-4b27-9441-38e70e150846 req-0c4a4a23-811a-476b-8a80-7ccec92d5ae1 service nova] Acquiring lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-07e6f39b-6ff7-4b27-9441-38e70e150846 req-0c4a4a23-811a-476b-8a80-7ccec92d5ae1 service nova] Acquired lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG nova.network.neutron [req-07e6f39b-6ff7-4b27-9441-38e70e150846 req-0c4a4a23-811a-476b-8a80-7ccec92d5ae1 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Refreshing network info cache for port 4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[286635ad-3991-4c3f-b040-ff9ccb2b9def]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG os_brick.utils [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:42:38 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Updating existing volume attachment record: 996c269e-5b02-421a-9527-5e607a1c10fe {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:42:39 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:42:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:42:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "7722de29-482a-4f75-a3ed-d4293fdd9db8" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:39 user nova-compute[72849]: INFO nova.compute.manager [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Shelve offloading
Aug 15 16:42:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-07e6f39b-6ff7-4b27-9441-38e70e150846 req-0c4a4a23-811a-476b-8a80-7ccec92d5ae1 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Updated VIF entry in instance network info cache for port 4bb47a58-9f72-4291-9270-b5a0a988725c. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:42:39 user nova-compute[72849]: DEBUG nova.network.neutron [req-07e6f39b-6ff7-4b27-9441-38e70e150846 req-0c4a4a23-811a-476b-8a80-7ccec92d5ae1 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Updating instance_info_cache with network_info: [{"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:42:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-07e6f39b-6ff7-4b27-9441-38e70e150846 req-0c4a4a23-811a-476b-8a80-7ccec92d5ae1 service nova] Releasing lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:42:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-ff3d801d-ddc7-4f90-8cc8-a577d6482270" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:42:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-ff3d801d-ddc7-4f90-8cc8-a577d6482270" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:42:39 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:42:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:40 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Updating instance_info_cache with network_info: [{"id": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "address": "fa:16:3e:79:89:fb", "network": {"id": "e58f7f18-d91b-491d-a7df-8dcfd65e8c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1908380537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5023408270042d1849f75aa91a764c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730cbf2-c9", "ovs_interfaceid": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:42:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-ff3d801d-ddc7-4f90-8cc8-a577d6482270" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:42:40 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:42:40 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Instance destroyed successfully.
Aug 15 16:42:40 user nova-compute[72849]: DEBUG nova.compute.manager [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:42:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:42:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquired lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:42:40 user nova-compute[72849]: DEBUG nova.network.neutron [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:42:40 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:42:40 user nova-compute[72849]: DEBUG nova.network.neutron [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Updating instance_info_cache with network_info: [{"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:42:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Releasing lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-c366af75-5b49-4a6f-ac57-5b30523e8e35 req-ebf084f3-dae8-4f21-9ff5-a50dea6f079e service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received event network-vif-unplugged-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c366af75-5b49-4a6f-ac57-5b30523e8e35 req-ebf084f3-dae8-4f21-9ff5-a50dea6f079e service nova] Acquiring lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c366af75-5b49-4a6f-ac57-5b30523e8e35 req-ebf084f3-dae8-4f21-9ff5-a50dea6f079e service nova] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c366af75-5b49-4a6f-ac57-5b30523e8e35 req-ebf084f3-dae8-4f21-9ff5-a50dea6f079e service nova] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-c366af75-5b49-4a6f-ac57-5b30523e8e35 req-ebf084f3-dae8-4f21-9ff5-a50dea6f079e service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] No waiting events found dispatching network-vif-unplugged-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:42:41 user nova-compute[72849]: WARNING nova.compute.manager [req-c366af75-5b49-4a6f-ac57-5b30523e8e35 req-ebf084f3-dae8-4f21-9ff5-a50dea6f079e service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received unexpected event network-vif-unplugged-4bb47a58-9f72-4291-9270-b5a0a988725c for instance with vm_state active and task_state shelving.
Aug 15 16:42:41 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Instance destroyed successfully.
Aug 15 16:42:41 user nova-compute[72849]: DEBUG nova.objects.instance [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lazy-loading 'resources' on Instance uuid 7722de29-482a-4f75-a3ed-d4293fdd9db8 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-648703954',display_name='tempest-TestShelveInstance-server-648703954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-648703954',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1+HLabUqq6zIPMWDL04qSO39/IVnfVMHlk8RRaC4xTbnCxgJV/Rgr0HlZCGRDxgqa2CuyuCcrgUfpLO68W7/a/HLUfrrhWm6+Zr9c4OK9ZRJUQchNl3AuGahuKsjTUww==',key_name='tempest-TestShelveInstance-1445995414',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:41:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a35bb132e2cc4dfc99e383862ce86829',ramdisk_id='',reservation_id='r-2h2pgqco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-628082297',owner_user_name='tempest-TestShelveInstance-628082297-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:41:05Z,user_data=None,user_id='ae3d508464a14dad9113a56fac6f0f32',uuid=7722de29-482a-4f75-a3ed-d4293fdd9db8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Converting VIF {"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=4bb47a58-9f72-4291-9270-b5a0a988725c,network=Network(1d8f6acf-691c-4a97-a585-dd9fc43a7b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb47a58-9f') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_vif [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=4bb47a58-9f72-4291-9270-b5a0a988725c,network=Network(1d8f6acf-691c-4a97-a585-dd9fc43a7b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb47a58-9f') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bb47a58-9f, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:42:41 user nova-compute[72849]: INFO os_vif [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=4bb47a58-9f72-4291-9270-b5a0a988725c,network=Network(1d8f6acf-691c-4a97-a585-dd9fc43a7b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb47a58-9f')
Aug 15 16:42:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRkmTJKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:42:41 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ce5465-ac82-4268-813e-d0d2978020de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5b8038-3d8b-4f84-aa63-eebe3d57b213]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:42:41 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:42:41 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3587e3d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b26e188-3ec7-4b8f-9039-6a7e5142c73f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b162fc6e-fb03-44ba-8623-75154d4196b0]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d97668-0922-4259-9445-bdb3e0805ef6]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[32778d9a-2653-47d2-990e-8d9f88226fb1]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5554984e-700c-4660-9e0e-4624b566ee79]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43983ca-1ebe-47c3-88b5-e0e3f8935436]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1, portal: 172.16.0.220,3260]
Aug 15 16:42:41 user nova-compute[72849]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1, portal: 172.16.0.220,3260] successful.
Aug 15 16:42:41 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54b2dd7-2617-4053-a1ca-2130381d06c1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] <== disconnect_volume: return (291ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:42:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:42:41 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Deleting instance files /opt/stack/data/nova/instances/7722de29-482a-4f75-a3ed-d4293fdd9db8_del
Aug 15 16:42:41 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Deletion of /opt/stack/data/nova/instances/7722de29-482a-4f75-a3ed-d4293fdd9db8_del complete
Aug 15 16:42:42 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquiring lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:42:42 user nova-compute[72849]: INFO nova.compute.claims [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Claim successful on node user
Aug 15 16:42:42 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG nova.network.neutron [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:42:42 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:42:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG nova.policy [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '058da58bd1924ef78c9228777f898a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a6bda829b4429b87c54780795763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:42:42 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Deleted allocations for instance 7722de29-482a-4f75-a3ed-d4293fdd9db8
Aug 15 16:42:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:42:42 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Creating image(s)
Aug 15 16:42:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquiring lock "/opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "/opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "/opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:42 user nova-compute[72849]: DEBUG nova.objects.instance [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lazy-loading 'numa_topology' on Instance uuid 7722de29-482a-4f75-a3ed-d4293fdd9db8 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-acc5b97e-0052-4675-9ed0-b775944021b6 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.804s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/disk 1073741824" returned: 0 in 0.061s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.217s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG nova.network.neutron [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Successfully created port: d81abc96-99af-4450-bf06-a53ff4663ea8 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Cannot resize image /opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG nova.objects.instance [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lazy-loading 'migration_context' on Instance uuid 7fc2d7c5-2c57-4466-aeda-58930af3e57c {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Ensure instance console log exists: /opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:44 user nova-compute[72849]: DEBUG nova.network.neutron [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Successfully updated port: d81abc96-99af-4450-bf06-a53ff4663ea8 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:42:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquiring lock "refresh_cache-7fc2d7c5-2c57-4466-aeda-58930af3e57c" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:42:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquired lock "refresh_cache-7fc2d7c5-2c57-4466-aeda-58930af3e57c" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:42:44 user nova-compute[72849]: DEBUG nova.network.neutron [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:42:44 user nova-compute[72849]: DEBUG nova.network.neutron [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:42:44 user nova-compute[72849]: DEBUG nova.network.neutron [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Updating instance_info_cache with network_info: [{"id": "d81abc96-99af-4450-bf06-a53ff4663ea8", "address": "fa:16:3e:45:81:8b", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81abc96-99", "ovs_interfaceid": "d81abc96-99af-4450-bf06-a53ff4663ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:42:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Releasing lock "refresh_cache-7fc2d7c5-2c57-4466-aeda-58930af3e57c" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:42:44 user nova-compute[72849]: DEBUG nova.compute.manager [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Instance network_info: |[{"id": "d81abc96-99af-4450-bf06-a53ff4663ea8", "address": "fa:16:3e:45:81:8b", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81abc96-99", "ovs_interfaceid": "d81abc96-99af-4450-bf06-a53ff4663ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:42:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Start _get_guest_xml network_info=[{"id": "d81abc96-99af-4450-bf06-a53ff4663ea8", "address": "fa:16:3e:45:81:8b", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81abc96-99", "ovs_interfaceid": "d81abc96-99af-4450-bf06-a53ff4663ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:42:44 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:42:44 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:42:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:42:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-92442670',display_name='tempest-VolumesActionsTest-instance-92442670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-92442670',id=44,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48a6bda829b4429b87c54780795763e1',ramdisk_id='',reservation_id='r-bfsgas4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1889056072',owner_user_name='tempest-VolumesActionsTest-1889056072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:42:43Z,user_data=None,user_id='058da58bd1924ef78c9228777f898a5d',uuid=7fc2d7c5-2c57-4466-aeda-58930af3e57c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d81abc96-99af-4450-bf06-a53ff4663ea8", "address": "fa:16:3e:45:81:8b", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81abc96-99", "ovs_interfaceid": "d81abc96-99af-4450-bf06-a53ff4663ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Converting VIF {"id": "d81abc96-99af-4450-bf06-a53ff4663ea8", "address": "fa:16:3e:45:81:8b", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81abc96-99", "ovs_interfaceid": "d81abc96-99af-4450-bf06-a53ff4663ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:81:8b,bridge_name='br-int',has_traffic_filtering=True,id=d81abc96-99af-4450-bf06-a53ff4663ea8,network=Network(f410fe9a-3118-492b-99d1-e54500294d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81abc96-99') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.objects.instance [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lazy-loading 'pci_devices' on Instance uuid 7fc2d7c5-2c57-4466-aeda-58930af3e57c {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:42:45 user nova-compute[72849]:   <uuid>7fc2d7c5-2c57-4466-aeda-58930af3e57c</uuid>
Aug 15 16:42:45 user nova-compute[72849]:   <name>instance-0000002c</name>
Aug 15 16:42:45 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:42:45 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:42:45 user nova-compute[72849]:   <metadata>
Aug 15 16:42:45 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:42:45 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:42:45 user nova-compute[72849]:       <nova:name>tempest-VolumesActionsTest-instance-92442670</nova:name>
Aug 15 16:42:45 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:42:44</nova:creationTime>
Aug 15 16:42:45 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:42:45 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:42:45 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:42:45 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:42:45 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:42:45 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:42:45 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:42:45 user nova-compute[72849]:       <nova:owner>
Aug 15 16:42:45 user nova-compute[72849]:         <nova:user uuid="058da58bd1924ef78c9228777f898a5d">tempest-VolumesActionsTest-1889056072-project-member</nova:user>
Aug 15 16:42:45 user nova-compute[72849]:         <nova:project uuid="48a6bda829b4429b87c54780795763e1">tempest-VolumesActionsTest-1889056072</nova:project>
Aug 15 16:42:45 user nova-compute[72849]:       </nova:owner>
Aug 15 16:42:45 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:42:45 user nova-compute[72849]:       <nova:ports>
Aug 15 16:42:45 user nova-compute[72849]:         <nova:port uuid="d81abc96-99af-4450-bf06-a53ff4663ea8">
Aug 15 16:42:45 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 16:42:45 user nova-compute[72849]:         </nova:port>
Aug 15 16:42:45 user nova-compute[72849]:       </nova:ports>
Aug 15 16:42:45 user nova-compute[72849]:     </nova:instance>
Aug 15 16:42:45 user nova-compute[72849]:   </metadata>
Aug 15 16:42:45 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:42:45 user nova-compute[72849]:     <system>
Aug 15 16:42:45 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:42:45 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:42:45 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:42:45 user nova-compute[72849]:       <entry name="serial">7fc2d7c5-2c57-4466-aeda-58930af3e57c</entry>
Aug 15 16:42:45 user nova-compute[72849]:       <entry name="uuid">7fc2d7c5-2c57-4466-aeda-58930af3e57c</entry>
Aug 15 16:42:45 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:42:45 user nova-compute[72849]:     </system>
Aug 15 16:42:45 user nova-compute[72849]:   </sysinfo>
Aug 15 16:42:45 user nova-compute[72849]:   <os>
Aug 15 16:42:45 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:42:45 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:42:45 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:42:45 user nova-compute[72849]:   </os>
Aug 15 16:42:45 user nova-compute[72849]:   <features>
Aug 15 16:42:45 user nova-compute[72849]:     <acpi/>
Aug 15 16:42:45 user nova-compute[72849]:     <apic/>
Aug 15 16:42:45 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:42:45 user nova-compute[72849]:   </features>
Aug 15 16:42:45 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:42:45 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:42:45 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:42:45 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:42:45 user nova-compute[72849]:   </clock>
Aug 15 16:42:45 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:42:45 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:42:45 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:42:45 user nova-compute[72849]:   </cpu>
Aug 15 16:42:45 user nova-compute[72849]:   <devices>
Aug 15 16:42:45 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:42:45 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:42:45 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/disk"/>
Aug 15 16:42:45 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:42:45 user nova-compute[72849]:     </disk>
Aug 15 16:42:45 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:42:45 user nova-compute[72849]:       <mac address="fa:16:3e:45:81:8b"/>
Aug 15 16:42:45 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:42:45 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:42:45 user nova-compute[72849]:       <target dev="tapd81abc96-99"/>
Aug 15 16:42:45 user nova-compute[72849]:     </interface>
Aug 15 16:42:45 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:42:45 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/console.log" append="off"/>
Aug 15 16:42:45 user nova-compute[72849]:     </serial>
Aug 15 16:42:45 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:42:45 user nova-compute[72849]:     <video>
Aug 15 16:42:45 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:42:45 user nova-compute[72849]:     </video>
Aug 15 16:42:45 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:42:45 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:42:45 user nova-compute[72849]:     </rng>
Aug 15 16:42:45 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:42:45 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:42:45 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:42:45 user nova-compute[72849]:     </memballoon>
Aug 15 16:42:45 user nova-compute[72849]:   </devices>
Aug 15 16:42:45 user nova-compute[72849]: </domain>
Aug 15 16:42:45 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-92442670',display_name='tempest-VolumesActionsTest-instance-92442670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-92442670',id=44,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48a6bda829b4429b87c54780795763e1',ramdisk_id='',reservation_id='r-bfsgas4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1889056072',owner_user_name='tempest-VolumesActionsTest-1889056072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:42:43Z,user_data=None,user_id='058da58bd1924ef78c9228777f898a5d',uuid=7fc2d7c5-2c57-4466-aeda-58930af3e57c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d81abc96-99af-4450-bf06-a53ff4663ea8", "address": "fa:16:3e:45:81:8b", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81abc96-99", "ovs_interfaceid": "d81abc96-99af-4450-bf06-a53ff4663ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Converting VIF {"id": "d81abc96-99af-4450-bf06-a53ff4663ea8", "address": "fa:16:3e:45:81:8b", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81abc96-99", "ovs_interfaceid": "d81abc96-99af-4450-bf06-a53ff4663ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:81:8b,bridge_name='br-int',has_traffic_filtering=True,id=d81abc96-99af-4450-bf06-a53ff4663ea8,network=Network(f410fe9a-3118-492b-99d1-e54500294d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81abc96-99') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG os_vif [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:81:8b,bridge_name='br-int',has_traffic_filtering=True,id=d81abc96-99af-4450-bf06-a53ff4663ea8,network=Network(f410fe9a-3118-492b-99d1-e54500294d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81abc96-99') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd81abc96-99, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd81abc96-99, col_values=(('external_ids', {'iface-id': 'd81abc96-99af-4450-bf06-a53ff4663ea8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:81:8b', 'vm-uuid': '7fc2d7c5-2c57-4466-aeda-58930af3e57c'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:45 user nova-compute[72849]: INFO os_vif [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:81:8b,bridge_name='br-int',has_traffic_filtering=True,id=d81abc96-99af-4450-bf06-a53ff4663ea8,network=Network(f410fe9a-3118-492b-99d1-e54500294d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81abc96-99')
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] No VIF found with MAC fa:16:3e:45:81:8b, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-6c3943b9-4331-41fd-9dea-8794514e43b0 req-ddcffebe-fbed-45e6-baf3-e0a45cb8b4be service nova] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Received event network-changed-d81abc96-99af-4450-bf06-a53ff4663ea8 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.compute.manager [req-6c3943b9-4331-41fd-9dea-8794514e43b0 req-ddcffebe-fbed-45e6-baf3-e0a45cb8b4be service nova] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Refreshing instance network info cache due to event network-changed-d81abc96-99af-4450-bf06-a53ff4663ea8. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6c3943b9-4331-41fd-9dea-8794514e43b0 req-ddcffebe-fbed-45e6-baf3-e0a45cb8b4be service nova] Acquiring lock "refresh_cache-7fc2d7c5-2c57-4466-aeda-58930af3e57c" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6c3943b9-4331-41fd-9dea-8794514e43b0 req-ddcffebe-fbed-45e6-baf3-e0a45cb8b4be service nova] Acquired lock "refresh_cache-7fc2d7c5-2c57-4466-aeda-58930af3e57c" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.network.neutron [req-6c3943b9-4331-41fd-9dea-8794514e43b0 req-ddcffebe-fbed-45e6-baf3-e0a45cb8b4be service nova] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Refreshing network info cache for port d81abc96-99af-4450-bf06-a53ff4663ea8 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.network.neutron [req-6c3943b9-4331-41fd-9dea-8794514e43b0 req-ddcffebe-fbed-45e6-baf3-e0a45cb8b4be service nova] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Updated VIF entry in instance network info cache for port d81abc96-99af-4450-bf06-a53ff4663ea8. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG nova.network.neutron [req-6c3943b9-4331-41fd-9dea-8794514e43b0 req-ddcffebe-fbed-45e6-baf3-e0a45cb8b4be service nova] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Updating instance_info_cache with network_info: [{"id": "d81abc96-99af-4450-bf06-a53ff4663ea8", "address": "fa:16:3e:45:81:8b", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81abc96-99", "ovs_interfaceid": "d81abc96-99af-4450-bf06-a53ff4663ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:42:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6c3943b9-4331-41fd-9dea-8794514e43b0 req-ddcffebe-fbed-45e6-baf3-e0a45cb8b4be service nova] Releasing lock "refresh_cache-7fc2d7c5-2c57-4466-aeda-58930af3e57c" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:42:46 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:42:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:46 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:42:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:46 user nova-compute[72849]: DEBUG nova.compute.manager [req-7cb1b330-5cc8-45f6-87a8-6187796f9e1d req-1d429db4-b130-4c7c-9245-4113fe90814c service nova] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Received event network-vif-plugged-d81abc96-99af-4450-bf06-a53ff4663ea8 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:42:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7cb1b330-5cc8-45f6-87a8-6187796f9e1d req-1d429db4-b130-4c7c-9245-4113fe90814c service nova] Acquiring lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7cb1b330-5cc8-45f6-87a8-6187796f9e1d req-1d429db4-b130-4c7c-9245-4113fe90814c service nova] Lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7cb1b330-5cc8-45f6-87a8-6187796f9e1d req-1d429db4-b130-4c7c-9245-4113fe90814c service nova] Lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:46 user nova-compute[72849]: DEBUG nova.compute.manager [req-7cb1b330-5cc8-45f6-87a8-6187796f9e1d req-1d429db4-b130-4c7c-9245-4113fe90814c service nova] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] No waiting events found dispatching network-vif-plugged-d81abc96-99af-4450-bf06-a53ff4663ea8 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:42:46 user nova-compute[72849]: WARNING nova.compute.manager [req-7cb1b330-5cc8-45f6-87a8-6187796f9e1d req-1d429db4-b130-4c7c-9245-4113fe90814c service nova] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Received unexpected event network-vif-plugged-d81abc96-99af-4450-bf06-a53ff4663ea8 for instance with vm_state building and task_state spawning.
Aug 15 16:42:46 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFGgUZem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:42:47 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:42:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:42:47 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:42:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:42:47 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:42:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f745d3e-68eb-48d7-b812-4993f0dfdfa7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:42:47 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bdeced-7fa9-4da6-8e11-6e53dd03e812]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740] added
Aug 15 16:42:47 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[509b5686-2b4c-4f50-93ee-01b4913c6d2b]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:42:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d069796-adfb-4405-a779-cb92743d49bd]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117768.5893974, 7fc2d7c5-2c57-4466-aeda-58930af3e57c => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:42:48 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] VM Resumed (Lifecycle Event)
Aug 15 16:42:48 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG nova.compute.manager [req-2e2755ac-fd68-4fb5-9ac9-1ed6957bf760 req-00edcf00-fc1a-410f-ae04-6ce22cd2db10 service nova] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Received event network-vif-plugged-d81abc96-99af-4450-bf06-a53ff4663ea8 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2e2755ac-fd68-4fb5-9ac9-1ed6957bf760 req-00edcf00-fc1a-410f-ae04-6ce22cd2db10 service nova] Acquiring lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2e2755ac-fd68-4fb5-9ac9-1ed6957bf760 req-00edcf00-fc1a-410f-ae04-6ce22cd2db10 service nova] Lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2e2755ac-fd68-4fb5-9ac9-1ed6957bf760 req-00edcf00-fc1a-410f-ae04-6ce22cd2db10 service nova] Lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG nova.compute.manager [req-2e2755ac-fd68-4fb5-9ac9-1ed6957bf760 req-00edcf00-fc1a-410f-ae04-6ce22cd2db10 service nova] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] No waiting events found dispatching network-vif-plugged-d81abc96-99af-4450-bf06-a53ff4663ea8 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:42:48 user nova-compute[72849]: WARNING nova.compute.manager [req-2e2755ac-fd68-4fb5-9ac9-1ed6957bf760 req-00edcf00-fc1a-410f-ae04-6ce22cd2db10 service nova] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Received unexpected event network-vif-plugged-d81abc96-99af-4450-bf06-a53ff4663ea8 for instance with vm_state building and task_state spawning.
Aug 15 16:42:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vFGgUZem {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:48 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:42:48 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:42:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8473MB free_disk=25.24603271484375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:42:48 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Instance spawned successfully.
Aug 15 16:42:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vFGgUZem" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ff419e-c779-4b32-8000-8bc7bd707c50]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vFGgUZem'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:42:48 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:42:48 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117768.5901191, 7fc2d7c5-2c57-4466-aeda-58930af3e57c => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:42:48 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] VM Started (Lifecycle Event)
Aug 15 16:42:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82b02c3-8a6a-413b-8ef6-e305b3494327]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:42:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fa588d-1100-4661-b05b-06100061e8c3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:42:49 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:42:49 user nova-compute[72849]:  {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:42:49 user nova-compute[72849]: WARNING os_brick.initiator.connectors.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 16:42:49 user nova-compute[72849]: 
Aug 15 16:42:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:42:49 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:42:49 user nova-compute[72849]: INFO nova.compute.manager [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Took 6.20 seconds to spawn the instance on the hypervisor.
Aug 15 16:42:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e5ffe0-0664-41ca-9f0c-ea23ddb12efb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740, portal: 172.16.0.220,3260]
Aug 15 16:42:49 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740, portal: 172.16.0.220,3260] successful.
Aug 15 16:42:49 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8e12a2-47ad-4ada-9a2a-bda31677f9ab]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f770a231-5137-41f9-9885-f0444ee4d9a9]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 (non-flash)
Aug 15 16:42:49 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 (non-flash)
Aug 15 16:42:49 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.447s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:49 user nova-compute[72849]: INFO nova.compute.manager [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Took 6.77 seconds to build instance.
Aug 15 16:42:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b487ca16-68a0-4c81-8abc-0a85bff63b25]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFGgUZem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-64266229-6a90-4993-988c-b3ca4e1a71fa tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.888s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 7fc2d7c5-2c57-4466-aeda-58930af3e57c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing inventories for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating ProviderTree inventory for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating inventory in ProviderTree for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing aggregate associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, aggregates: None {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing trait associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.666s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 16:42:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] There are 0 instances to clean {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 16:42:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.492s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:42:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] <== connect_volume: return (2494ms) {'type': 'block', 'scsi_wwn': '23066616539356434', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:42:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066616539356434', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:42:50 user nova-compute[72849]: DEBUG nova.objects.instance [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lazy-loading 'flavor' on Instance uuid ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:42:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:42:50 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:42:50 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:42:50 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:42:50 user nova-compute[72849]:   <serial>b34013e8-8527-418b-bc34-c58efd6f9740</serial>
Aug 15 16:42:50 user nova-compute[72849]: </disk>
Aug 15 16:42:50 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:42:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:42:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:42:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] No VIF found with MAC fa:16:3e:79:89:fb, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:42:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-196a1068-3884-4aca-aa3c-245217d56e17 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.358s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:51 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:42:51 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:42:51 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:42:51 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:42:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:42:51 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:42:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:42:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:42:52 user nova-compute[72849]: INFO nova.compute.manager [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Detaching volume b34013e8-8527-418b-bc34-c58efd6f9740
Aug 15 16:42:53 user nova-compute[72849]: INFO nova.virt.block_device [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Attempting to driver detach volume b34013e8-8527-418b-bc34-c58efd6f9740 from mountpoint /dev/vdb
Aug 15 16:42:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Attempting to detach device vdb from instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:42:53 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:42:53 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:42:53 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:42:53 user nova-compute[72849]:   <serial>b34013e8-8527-418b-bc34-c58efd6f9740</serial>
Aug 15 16:42:53 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:42:53 user nova-compute[72849]: </disk>
Aug 15 16:42:53 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:42:53 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Successfully detached device vdb from instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 from the persistent domain config.
Aug 15 16:42:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:42:53 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:42:53 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:42:53 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:42:53 user nova-compute[72849]:   <serial>b34013e8-8527-418b-bc34-c58efd6f9740</serial>
Aug 15 16:42:53 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:42:53 user nova-compute[72849]: </disk>
Aug 15 16:42:53 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692117773.513764, ff3d801d-ddc7-4f90-8cc8-a577d6482270 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:42:53 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Successfully detached device vdb from instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 from the live domain config.
Aug 15 16:42:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFGgUZem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:42:53 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:42:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[935f8f0f-7ddf-41c2-abc4-71697f48ec8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef30421d-ddd5-4b8b-a8bb-35763f8b6521]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 (non-flash)
Aug 15 16:42:53 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 (non-flash)
Aug 15 16:42:53 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc37832eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d38991e-fcef-4fa9-b717-65931ab6ae69]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d4cd24-5824-48a2-be36-3add5f0b1c6d]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[418c6270-5b53-456f-aad4-27f94f1ed2e9]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1e7984-0318-4356-a35c-b0182bd120b8]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fde4a3-7419-4d7b-9fc8-0b253c92b7eb]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7391833a-8ec2-4d58-826b-481fc8c5743d]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740, portal: 172.16.0.220,3260]
Aug 15 16:42:53 user nova-compute[72849]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740, portal: 172.16.0.220,3260] successful.
Aug 15 16:42:53 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b34013e8-8527-418b-bc34-c58efd6f9740 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae39626f-3f45-4131-8595-4dd09edad8d0]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] <== disconnect_volume: return (281ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:42:53 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:42:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:54 user nova-compute[72849]: DEBUG nova.objects.instance [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lazy-loading 'flavor' on Instance uuid ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:42:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a3a2f9a5-296b-4840-9bde-64181faa637e tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.611s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:42:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:55 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117760.1856663, 7722de29-482a-4f75-a3ed-d4293fdd9db8 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:42:55 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] VM Stopped (Lifecycle Event)
Aug 15 16:42:55 user nova-compute[72849]: DEBUG nova.compute.manager [None req-7761dcd4-a9e2-410e-a51b-b847289d4eb1 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:42:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:42:59 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:42:59 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72849) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 16:43:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:43:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:43:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:43:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:43:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:43:14 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:43:14 user nova-compute[72849]: INFO nova.compute.claims [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Claim successful on node user
Aug 15 16:43:15 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:43:15 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:43:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:43:15 user nova-compute[72849]: DEBUG nova.compute.manager [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:43:15 user nova-compute[72849]: DEBUG nova.compute.manager [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:43:15 user nova-compute[72849]: DEBUG nova.network.neutron [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:43:15 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:43:15 user nova-compute[72849]: DEBUG nova.compute.manager [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:43:15 user nova-compute[72849]: INFO nova.virt.block_device [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Booting with volume snapshot 5d5ca0c4-fb1a-4ed0-8837-977195ee40f2 at /dev/vda
Aug 15 16:43:15 user nova-compute[72849]: DEBUG nova.policy [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe3f48f280e54c2099e6b1db842db2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87edcbec784a4f65b99740f34ff121bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:43:15 user nova-compute[72849]: DEBUG nova.network.neutron [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Successfully created port: 88ff8111-9371-4da1-97ef-95f9ab035eac {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:43:16 user nova-compute[72849]: DEBUG nova.network.neutron [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Successfully updated port: 88ff8111-9371-4da1-97ef-95f9ab035eac {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:43:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "refresh_cache-e229ced9-d1cf-4765-9ba7-b32cdf47960b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:43:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquired lock "refresh_cache-e229ced9-d1cf-4765-9ba7-b32cdf47960b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:43:16 user nova-compute[72849]: DEBUG nova.network.neutron [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:43:16 user nova-compute[72849]: DEBUG nova.compute.manager [req-76870e4c-e084-4309-a688-89cae80855f8 req-cdb7f417-d9a3-48a4-b8e1-8dec0382777e service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Received event network-changed-88ff8111-9371-4da1-97ef-95f9ab035eac {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:43:16 user nova-compute[72849]: DEBUG nova.compute.manager [req-76870e4c-e084-4309-a688-89cae80855f8 req-cdb7f417-d9a3-48a4-b8e1-8dec0382777e service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Refreshing instance network info cache due to event network-changed-88ff8111-9371-4da1-97ef-95f9ab035eac. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:43:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-76870e4c-e084-4309-a688-89cae80855f8 req-cdb7f417-d9a3-48a4-b8e1-8dec0382777e service nova] Acquiring lock "refresh_cache-e229ced9-d1cf-4765-9ba7-b32cdf47960b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:43:16 user nova-compute[72849]: DEBUG nova.network.neutron [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:43:17 user nova-compute[72849]: DEBUG nova.network.neutron [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Updating instance_info_cache with network_info: [{"id": "88ff8111-9371-4da1-97ef-95f9ab035eac", "address": "fa:16:3e:5b:4e:4c", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ff8111-93", "ovs_interfaceid": "88ff8111-9371-4da1-97ef-95f9ab035eac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:43:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Releasing lock "refresh_cache-e229ced9-d1cf-4765-9ba7-b32cdf47960b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:43:17 user nova-compute[72849]: DEBUG nova.compute.manager [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Instance network_info: |[{"id": "88ff8111-9371-4da1-97ef-95f9ab035eac", "address": "fa:16:3e:5b:4e:4c", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ff8111-93", "ovs_interfaceid": "88ff8111-9371-4da1-97ef-95f9ab035eac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:43:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-76870e4c-e084-4309-a688-89cae80855f8 req-cdb7f417-d9a3-48a4-b8e1-8dec0382777e service nova] Acquired lock "refresh_cache-e229ced9-d1cf-4765-9ba7-b32cdf47960b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:43:17 user nova-compute[72849]: DEBUG nova.network.neutron [req-76870e4c-e084-4309-a688-89cae80855f8 req-cdb7f417-d9a3-48a4-b8e1-8dec0382777e service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Refreshing network info cache for port 88ff8111-9371-4da1-97ef-95f9ab035eac {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:43:17 user nova-compute[72849]: DEBUG nova.network.neutron [req-76870e4c-e084-4309-a688-89cae80855f8 req-cdb7f417-d9a3-48a4-b8e1-8dec0382777e service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Updated VIF entry in instance network info cache for port 88ff8111-9371-4da1-97ef-95f9ab035eac. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:43:17 user nova-compute[72849]: DEBUG nova.network.neutron [req-76870e4c-e084-4309-a688-89cae80855f8 req-cdb7f417-d9a3-48a4-b8e1-8dec0382777e service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Updating instance_info_cache with network_info: [{"id": "88ff8111-9371-4da1-97ef-95f9ab035eac", "address": "fa:16:3e:5b:4e:4c", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ff8111-93", "ovs_interfaceid": "88ff8111-9371-4da1-97ef-95f9ab035eac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:43:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-76870e4c-e084-4309-a688-89cae80855f8 req-cdb7f417-d9a3-48a4-b8e1-8dec0382777e service nova] Releasing lock "refresh_cache-e229ced9-d1cf-4765-9ba7-b32cdf47960b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:43:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:25 user nova-compute[72849]: DEBUG os_brick.utils [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:43:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba84959-7513-4dd0-9b02-ce2bb46b4f63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b76564a-d19d-44e3-9f44-d3e009d30970]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e79dae-2dc5-45f5-a5bf-387de531f416]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe070d2f-3e44-4463-85c7-0ae59926d47a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:43:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:43:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:43:26 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:43:26 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bdfe13-c346-46b3-b853-eacb342ea764]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:43:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:43:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:43:26 user nova-compute[72849]: DEBUG os_brick.utils [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:43:26 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Updating existing volume attachment record: 91ef3ae6-f606-4d01-ab8c-ff7fceda9fd8 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:43:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:43:32 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:43:32 user nova-compute[72849]: WARNING nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
Aug 15 16:43:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:43:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 7fc2d7c5-2c57-4466-aeda-58930af3e57c {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:43:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid e229ced9-d1cf-4765-9ba7-b32cdf47960b {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:43:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:43:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:43:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:43:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:43:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:43:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:43:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.compute.manager [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:43:34 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Creating image(s)
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Did not create local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Ensure instance console log exists: /opt/stack/data/nova/instances/e229ced9-d1cf-4765-9ba7-b32cdf47960b/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Start _get_guest_xml network_info=[{"id": "88ff8111-9371-4da1-97ef-95f9ab035eac", "address": "fa:16:3e:5b:4e:4c", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ff8111-93", "ovs_interfaceid": "88ff8111-9371-4da1-97ef-95f9ab035eac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfGhotVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e229ced9-d1cf-4765-9ba7-b32cdf47960b', 'attached_at': '', 'detached_at': '', 'volume_id': 'c62e61cd-60dd-45c7-9d7e-d88958d749fa', 'serial': 'c62e61cd-60dd-45c7-9d7e-d88958d749fa'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '91ef3ae6-f606-4d01-ab8c-ff7fceda9fd8', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:43:34 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:43:34 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfGhotVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:43:34 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:43:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:43:34 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:43:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:43:34 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c406a893-12d2-4ec1-9f55-96f26dc2e752]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:43:34 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2275bcd0-23f5-40c5-8d8e-f0bb08adb881]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa] added
Aug 15 16:43:34 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ec6d76-f33e-4aee-b2b2-d37a61fcc521]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c9cb80-b3fa-418f-b663-a094ca5cedc1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfGhotVy {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfGhotVy" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b242773-62f6-48cc-b7ec-dd38345b340a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FfGhotVy'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10daee4-fe00-4442-8e05-9274f6811cb0]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcbc947-a634-436b-9bd9-802d997efd7c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:43:34 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:43:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:43:34 user nova-compute[72849]:  {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:43:34 user nova-compute[72849]: WARNING os_brick.initiator.connectors.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 16:43:34 user nova-compute[72849]: 
Aug 15 16:43:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7700eb73-da0b-41b3-9bab-feb594dc0837]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa, portal: 172.16.0.220,3260]
Aug 15 16:43:35 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa, portal: 172.16.0.220,3260] successful.
Aug 15 16:43:35 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6677e9-29aa-4660-96a2-34477e6d0291]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a066e79-0c46-4515-8553-4f4c90caf642]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)
Aug 15 16:43:35 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)
Aug 15 16:43:35 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a71af2-25fa-4d09-bf7c-383d6a06dc6d]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfGhotVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:43:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23337373135363333', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337373135363333', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-934327641',display_name='tempest-TestVolumeBootPattern-server-934327641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-934327641',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87edcbec784a4f65b99740f34ff121bb',ramdisk_id='',reservation_id='r-etgz3zcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1900922481',owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:43:15Z,user_data=None,user_id='fe3f48f280e54c2099e6b1db842db2cd',uuid=e229ced9-d1cf-4765-9ba7-b32cdf47960b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88ff8111-9371-4da1-97ef-95f9ab035eac", "address": "fa:16:3e:5b:4e:4c", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ff8111-93", "ovs_interfaceid": "88ff8111-9371-4da1-97ef-95f9ab035eac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converting VIF {"id": "88ff8111-9371-4da1-97ef-95f9ab035eac", "address": "fa:16:3e:5b:4e:4c", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ff8111-93", "ovs_interfaceid": "88ff8111-9371-4da1-97ef-95f9ab035eac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:4e:4c,bridge_name='br-int',has_traffic_filtering=True,id=88ff8111-9371-4da1-97ef-95f9ab035eac,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ff8111-93') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG nova.objects.instance [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lazy-loading 'pci_devices' on Instance uuid e229ced9-d1cf-4765-9ba7-b32cdf47960b {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:43:36 user nova-compute[72849]:   <uuid>e229ced9-d1cf-4765-9ba7-b32cdf47960b</uuid>
Aug 15 16:43:36 user nova-compute[72849]:   <name>instance-0000002d</name>
Aug 15 16:43:36 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:43:36 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:43:36 user nova-compute[72849]:   <metadata>
Aug 15 16:43:36 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:43:36 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:43:36 user nova-compute[72849]:       <nova:name>tempest-TestVolumeBootPattern-server-934327641</nova:name>
Aug 15 16:43:36 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:43:34</nova:creationTime>
Aug 15 16:43:36 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:43:36 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:43:36 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:43:36 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:43:36 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:43:36 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:43:36 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:43:36 user nova-compute[72849]:       <nova:owner>
Aug 15 16:43:36 user nova-compute[72849]:         <nova:user uuid="fe3f48f280e54c2099e6b1db842db2cd">tempest-TestVolumeBootPattern-1900922481-project-member</nova:user>
Aug 15 16:43:36 user nova-compute[72849]:         <nova:project uuid="87edcbec784a4f65b99740f34ff121bb">tempest-TestVolumeBootPattern-1900922481</nova:project>
Aug 15 16:43:36 user nova-compute[72849]:       </nova:owner>
Aug 15 16:43:36 user nova-compute[72849]:       <nova:ports>
Aug 15 16:43:36 user nova-compute[72849]:         <nova:port uuid="88ff8111-9371-4da1-97ef-95f9ab035eac">
Aug 15 16:43:36 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 16:43:36 user nova-compute[72849]:         </nova:port>
Aug 15 16:43:36 user nova-compute[72849]:       </nova:ports>
Aug 15 16:43:36 user nova-compute[72849]:     </nova:instance>
Aug 15 16:43:36 user nova-compute[72849]:   </metadata>
Aug 15 16:43:36 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:43:36 user nova-compute[72849]:     <system>
Aug 15 16:43:36 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:43:36 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:43:36 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:43:36 user nova-compute[72849]:       <entry name="serial">e229ced9-d1cf-4765-9ba7-b32cdf47960b</entry>
Aug 15 16:43:36 user nova-compute[72849]:       <entry name="uuid">e229ced9-d1cf-4765-9ba7-b32cdf47960b</entry>
Aug 15 16:43:36 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:43:36 user nova-compute[72849]:     </system>
Aug 15 16:43:36 user nova-compute[72849]:   </sysinfo>
Aug 15 16:43:36 user nova-compute[72849]:   <os>
Aug 15 16:43:36 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:43:36 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:43:36 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:43:36 user nova-compute[72849]:   </os>
Aug 15 16:43:36 user nova-compute[72849]:   <features>
Aug 15 16:43:36 user nova-compute[72849]:     <acpi/>
Aug 15 16:43:36 user nova-compute[72849]:     <apic/>
Aug 15 16:43:36 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:43:36 user nova-compute[72849]:   </features>
Aug 15 16:43:36 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:43:36 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:43:36 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:43:36 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:43:36 user nova-compute[72849]:   </clock>
Aug 15 16:43:36 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:43:36 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:43:36 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:43:36 user nova-compute[72849]:   </cpu>
Aug 15 16:43:36 user nova-compute[72849]:   <devices>
Aug 15 16:43:36 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:43:36 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:43:36 user nova-compute[72849]:       <source dev="/dev/sdb"/>
Aug 15 16:43:36 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:43:36 user nova-compute[72849]:       <serial>c62e61cd-60dd-45c7-9d7e-d88958d749fa</serial>
Aug 15 16:43:36 user nova-compute[72849]:     </disk>
Aug 15 16:43:36 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:43:36 user nova-compute[72849]:       <mac address="fa:16:3e:5b:4e:4c"/>
Aug 15 16:43:36 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:43:36 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:43:36 user nova-compute[72849]:       <target dev="tap88ff8111-93"/>
Aug 15 16:43:36 user nova-compute[72849]:     </interface>
Aug 15 16:43:36 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:43:36 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/e229ced9-d1cf-4765-9ba7-b32cdf47960b/console.log" append="off"/>
Aug 15 16:43:36 user nova-compute[72849]:     </serial>
Aug 15 16:43:36 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:43:36 user nova-compute[72849]:     <video>
Aug 15 16:43:36 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:43:36 user nova-compute[72849]:     </video>
Aug 15 16:43:36 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:43:36 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:43:36 user nova-compute[72849]:     </rng>
Aug 15 16:43:36 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:43:36 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:43:36 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:43:36 user nova-compute[72849]:     </memballoon>
Aug 15 16:43:36 user nova-compute[72849]:   </devices>
Aug 15 16:43:36 user nova-compute[72849]: </domain>
Aug 15 16:43:36 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-934327641',display_name='tempest-TestVolumeBootPattern-server-934327641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-934327641',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87edcbec784a4f65b99740f34ff121bb',ramdisk_id='',reservation_id='r-etgz3zcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1900922481',owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:43:15Z,user_data=None,user_id='fe3f48f280e54c2099e6b1db842db2cd',uuid=e229ced9-d1cf-4765-9ba7-b32cdf47960b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88ff8111-9371-4da1-97ef-95f9ab035eac", "address": "fa:16:3e:5b:4e:4c", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ff8111-93", "ovs_interfaceid": "88ff8111-9371-4da1-97ef-95f9ab035eac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converting VIF {"id": "88ff8111-9371-4da1-97ef-95f9ab035eac", "address": "fa:16:3e:5b:4e:4c", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ff8111-93", "ovs_interfaceid": "88ff8111-9371-4da1-97ef-95f9ab035eac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:4e:4c,bridge_name='br-int',has_traffic_filtering=True,id=88ff8111-9371-4da1-97ef-95f9ab035eac,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ff8111-93') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG os_vif [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:4e:4c,bridge_name='br-int',has_traffic_filtering=True,id=88ff8111-9371-4da1-97ef-95f9ab035eac,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ff8111-93') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88ff8111-93, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88ff8111-93, col_values=(('external_ids', {'iface-id': '88ff8111-9371-4da1-97ef-95f9ab035eac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:4e:4c', 'vm-uuid': 'e229ced9-d1cf-4765-9ba7-b32cdf47960b'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:36 user nova-compute[72849]: INFO os_vif [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:4e:4c,bridge_name='br-int',has_traffic_filtering=True,id=88ff8111-9371-4da1-97ef-95f9ab035eac,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ff8111-93')
Aug 15 16:43:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:43:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] No VIF found with MAC fa:16:3e:5b:4e:4c, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:43:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:37 user nova-compute[72849]: DEBUG nova.compute.manager [req-00ffdd6e-c014-4957-ba3c-097155673185 req-c9e0a03b-8267-4b0e-ac54-91501d7e302f service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Received event network-vif-plugged-88ff8111-9371-4da1-97ef-95f9ab035eac {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:43:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-00ffdd6e-c014-4957-ba3c-097155673185 req-c9e0a03b-8267-4b0e-ac54-91501d7e302f service nova] Acquiring lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:43:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-00ffdd6e-c014-4957-ba3c-097155673185 req-c9e0a03b-8267-4b0e-ac54-91501d7e302f service nova] Lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:43:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-00ffdd6e-c014-4957-ba3c-097155673185 req-c9e0a03b-8267-4b0e-ac54-91501d7e302f service nova] Lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:43:37 user nova-compute[72849]: DEBUG nova.compute.manager [req-00ffdd6e-c014-4957-ba3c-097155673185 req-c9e0a03b-8267-4b0e-ac54-91501d7e302f service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] No waiting events found dispatching network-vif-plugged-88ff8111-9371-4da1-97ef-95f9ab035eac {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:43:37 user nova-compute[72849]: WARNING nova.compute.manager [req-00ffdd6e-c014-4957-ba3c-097155673185 req-c9e0a03b-8267-4b0e-ac54-91501d7e302f service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Received unexpected event network-vif-plugged-88ff8111-9371-4da1-97ef-95f9ab035eac for instance with vm_state building and task_state spawning.
Aug 15 16:43:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:39 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Skipping network cache update for instance because it has been migrated to another host. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Didn't find any instances for network info cache update. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117819.6144545, e229ced9-d1cf-4765-9ba7-b32cdf47960b => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:43:39 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] VM Resumed (Lifecycle Event)
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:43:39 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Instance spawned successfully.
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:43:39 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117819.619474, e229ced9-d1cf-4765-9ba7-b32cdf47960b => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:43:39 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] VM Started (Lifecycle Event)
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:43:39 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:43:39 user nova-compute[72849]: INFO nova.compute.manager [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Took 5.06 seconds to spawn the instance on the hypervisor.
Aug 15 16:43:39 user nova-compute[72849]: DEBUG nova.compute.manager [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:43:39 user nova-compute[72849]: INFO nova.compute.manager [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Took 25.12 seconds to build instance.
Aug 15 16:43:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-214fb0a5-3e9f-4fef-9a9d-3d56490f8a10 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.216s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:43:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.505s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:43:39 user nova-compute[72849]: INFO nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 15 16:43:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:43:40 user nova-compute[72849]: DEBUG nova.compute.manager [req-d64891c5-1531-4f10-a33f-429ffb46e1fc req-66e80d3f-92e7-492f-9939-7cca3b6eac8a service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Received event network-vif-plugged-88ff8111-9371-4da1-97ef-95f9ab035eac {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:43:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d64891c5-1531-4f10-a33f-429ffb46e1fc req-66e80d3f-92e7-492f-9939-7cca3b6eac8a service nova] Acquiring lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:43:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d64891c5-1531-4f10-a33f-429ffb46e1fc req-66e80d3f-92e7-492f-9939-7cca3b6eac8a service nova] Lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:43:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d64891c5-1531-4f10-a33f-429ffb46e1fc req-66e80d3f-92e7-492f-9939-7cca3b6eac8a service nova] Lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:43:40 user nova-compute[72849]: DEBUG nova.compute.manager [req-d64891c5-1531-4f10-a33f-429ffb46e1fc req-66e80d3f-92e7-492f-9939-7cca3b6eac8a service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] No waiting events found dispatching network-vif-plugged-88ff8111-9371-4da1-97ef-95f9ab035eac {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:43:40 user nova-compute[72849]: WARNING nova.compute.manager [req-d64891c5-1531-4f10-a33f-429ffb46e1fc req-66e80d3f-92e7-492f-9939-7cca3b6eac8a service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Received unexpected event network-vif-plugged-88ff8111-9371-4da1-97ef-95f9ab035eac for instance with vm_state active and task_state None.
Aug 15 16:43:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:41 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:43:42 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:43:44 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:43:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:45 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:43:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lazy-loading 'flavor' on Instance uuid ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:43:47 user nova-compute[72849]: INFO nova.compute.manager [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Attaching volume 3ea6715e-8022-477e-834c-ce13b90c1e04 to /dev/vdb
Aug 15 16:43:47 user nova-compute[72849]: DEBUG os_brick.utils [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df007b2-f60a-4e9d-b08e-000c94d0cd11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac244fca-b20c-48bb-8018-11d465305236]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3cfe80-e444-43df-80bd-0e21ed348029]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[81950fc9-4597-410d-a947-00596942d251]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:43:47 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9558c3-f390-4085-8281-cb46c4b7f811]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG os_brick.utils [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Updating existing volume attachment record: 4d849ef8-71c4-43e7-bb55-bff9ca34cb20 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:48 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:43:48 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:43:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8392MB free_disk=25.21316146850586GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:43:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:43:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:43:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:43:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 7fc2d7c5-2c57-4466-aeda-58930af3e57c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:43:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance e229ced9-d1cf-4765-9ba7-b32cdf47960b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:43:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:43:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:43:48 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:43:48 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:43:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:43:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:43:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:49 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:43:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:43:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:51 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:43:51 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:43:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSAhTLMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:43:56 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:43:56 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:43:56 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[14406792-178e-4994-a5b3-2b04aa7c5a74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:43:56 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9294f8fc-2a50-4afc-88d1-05c8c37a9d41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04] added
Aug 15 16:43:56 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0206e5-30fb-4537-8ffa-2956ac935a13]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9dc7d6-6a21-4407-84bb-302e658376f7]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jSAhTLMZ {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jSAhTLMZ" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[961f6a6a-2dda-4b15-add0-31718744d9df]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jSAhTLMZ'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[755497e7-e3ab-4869-8996-be94c872d1e6]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d964c2-ce26-4ebb-8b51-ceae8baf16cf]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)
Aug 15 16:43:56 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)
Aug 15 16:43:56 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc99220-f79c-403a-96e7-6c196b46f97b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04, portal: 172.16.0.220,3260]
Aug 15 16:43:56 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04, portal: 172.16.0.220,3260] successful.
Aug 15 16:43:56 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74c7ab3-441a-4775-a119-2bfaa4fde157]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7eaad43-46d2-4d3b-9b67-59d2daea760d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)
Aug 15 16:43:56 user nova-compute[72849]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 (non-flash)
Aug 15 16:43:56 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)
Aug 15 16:43:56 user nova-compute[72849]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 (non-flash)
Aug 15 16:43:56 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ed49bb-a9b1-4adc-9afb-2b228dcb2df6]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:43:56 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSAhTLMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:43:57 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:43:57 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23364323066356532', 'path': '/dev/sdc'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:43:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364323066356532', 'path': '/dev/sdc'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:43:57 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lazy-loading 'flavor' on Instance uuid ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:43:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:43:57 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:43:57 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:43:57 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:43:57 user nova-compute[72849]:   <serial>3ea6715e-8022-477e-834c-ce13b90c1e04</serial>
Aug 15 16:43:57 user nova-compute[72849]: </disk>
Aug 15 16:43:57 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:43:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:43:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:43:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] No VIF found with MAC fa:16:3e:79:89:fb, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:43:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:43:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7ae39b29-74ee-4627-82bc-ca6d3545f2c2 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.862s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:43:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:00 user nova-compute[72849]: INFO nova.compute.manager [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Detaching volume 3ea6715e-8022-477e-834c-ce13b90c1e04
Aug 15 16:44:00 user nova-compute[72849]: INFO nova.virt.block_device [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Attempting to driver detach volume 3ea6715e-8022-477e-834c-ce13b90c1e04 from mountpoint /dev/vdb
Aug 15 16:44:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Attempting to detach device vdb from instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:44:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:44:00 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:44:00 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:44:00 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:44:00 user nova-compute[72849]:   <serial>3ea6715e-8022-477e-834c-ce13b90c1e04</serial>
Aug 15 16:44:00 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:44:00 user nova-compute[72849]: </disk>
Aug 15 16:44:00 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:44:00 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Successfully detached device vdb from instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 from the persistent domain config.
Aug 15 16:44:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:44:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:44:00 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:44:00 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:44:00 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:44:00 user nova-compute[72849]:   <serial>3ea6715e-8022-477e-834c-ce13b90c1e04</serial>
Aug 15 16:44:00 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:44:00 user nova-compute[72849]: </disk>
Aug 15 16:44:00 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692117841.3458343, ff3d801d-ddc7-4f90-8cc8-a577d6482270 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:44:01 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Successfully detached device vdb from instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 from the live domain config.
Aug 15 16:44:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSAhTLMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:44:01 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:44:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[557f6f92-0884-4f51-a087-e6e2db6771dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e519ff87-7dd6-4cad-89b0-4a1a86e1ee8e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)
Aug 15 16:44:01 user nova-compute[72849]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 (non-flash)
Aug 15 16:44:01 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)
Aug 15 16:44:01 user nova-compute[72849]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 (non-flash)
Aug 15 16:44:01 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3874dc040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04'): ({'sdc'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Removing single pathed devices sdc {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0294e016-9720-40a6-88c1-929d63dde5a6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d8cf86-407d-46ad-b83d-207ab0e38ec1]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Flushing IO for device /dev/sdc {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[51becb2d-3414-4313-892a-0cbbf624d5a0]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9c6ccc-d1b1-498b-b5ee-27b6b3d4f9c4]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[286863a1-40b0-4764-a077-a825a4ad9fa0]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a16266c-d980-44d3-b649-6a9b9598b791]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04, portal: 172.16.0.220,3260]
Aug 15 16:44:01 user nova-compute[72849]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04, portal: 172.16.0.220,3260] successful.
Aug 15 16:44:01 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ea6715e-8022-477e-834c-ce13b90c1e04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c38f06-2b50-477e-b1de-c99893339d44]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] <== disconnect_volume: return (282ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "85da743e-e2c7-42c1-8621-f9942e115b01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "85da743e-e2c7-42c1-8621-f9942e115b01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG nova.compute.manager [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:01 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:44:01 user nova-compute[72849]: INFO nova.compute.claims [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Claim successful on node user
Aug 15 16:44:02 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG nova.compute.manager [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG nova.compute.manager [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG nova.network.neutron [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:44:02 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:44:02 user nova-compute[72849]: DEBUG nova.compute.manager [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG nova.policy [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff5000940b6d4cc79590b52201b8cd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2debda1cc8ff470b9c83ea54eb8ed955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG nova.compute.manager [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:44:02 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Creating image(s)
Aug 15 16:44:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "/opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "/opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "/opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG nova.objects.instance [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lazy-loading 'flavor' on Instance uuid ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f57033a6-eab0-4e48-a608-da79ccdeab04 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.737s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.178s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.178s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk 1073741824" returned: 0 in 0.050s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:02 user nova-compute[72849]: DEBUG nova.network.neutron [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Successfully created port: dbf46f11-8d35-4234-8748-d198b36de354 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.230s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Cannot resize image /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG nova.objects.instance [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lazy-loading 'migration_context' on Instance uuid 85da743e-e2c7-42c1-8621-f9942e115b01 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Ensure instance console log exists: /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG nova.network.neutron [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Successfully updated port: dbf46f11-8d35-4234-8748-d198b36de354 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "refresh_cache-85da743e-e2c7-42c1-8621-f9942e115b01" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquired lock "refresh_cache-85da743e-e2c7-42c1-8621-f9942e115b01" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG nova.network.neutron [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG nova.compute.manager [req-6354f69b-e61d-4325-abaf-fddcaef9daab req-b118200d-5605-407f-8d3e-ccb154cdf07e service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Received event network-changed-dbf46f11-8d35-4234-8748-d198b36de354 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG nova.compute.manager [req-6354f69b-e61d-4325-abaf-fddcaef9daab req-b118200d-5605-407f-8d3e-ccb154cdf07e service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Refreshing instance network info cache due to event network-changed-dbf46f11-8d35-4234-8748-d198b36de354. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6354f69b-e61d-4325-abaf-fddcaef9daab req-b118200d-5605-407f-8d3e-ccb154cdf07e service nova] Acquiring lock "refresh_cache-85da743e-e2c7-42c1-8621-f9942e115b01" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:44:03 user nova-compute[72849]: DEBUG nova.network.neutron [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.network.neutron [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Updating instance_info_cache with network_info: [{"id": "dbf46f11-8d35-4234-8748-d198b36de354", "address": "fa:16:3e:31:70:b3", "network": {"id": "a1da2ef5-bf52-472d-af07-d81b9cf8a5e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-544176784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2debda1cc8ff470b9c83ea54eb8ed955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf46f11-8d", "ovs_interfaceid": "dbf46f11-8d35-4234-8748-d198b36de354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Releasing lock "refresh_cache-85da743e-e2c7-42c1-8621-f9942e115b01" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Instance network_info: |[{"id": "dbf46f11-8d35-4234-8748-d198b36de354", "address": "fa:16:3e:31:70:b3", "network": {"id": "a1da2ef5-bf52-472d-af07-d81b9cf8a5e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-544176784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2debda1cc8ff470b9c83ea54eb8ed955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf46f11-8d", "ovs_interfaceid": "dbf46f11-8d35-4234-8748-d198b36de354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6354f69b-e61d-4325-abaf-fddcaef9daab req-b118200d-5605-407f-8d3e-ccb154cdf07e service nova] Acquired lock "refresh_cache-85da743e-e2c7-42c1-8621-f9942e115b01" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.network.neutron [req-6354f69b-e61d-4325-abaf-fddcaef9daab req-b118200d-5605-407f-8d3e-ccb154cdf07e service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Refreshing network info cache for port dbf46f11-8d35-4234-8748-d198b36de354 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Start _get_guest_xml network_info=[{"id": "dbf46f11-8d35-4234-8748-d198b36de354", "address": "fa:16:3e:31:70:b3", "network": {"id": "a1da2ef5-bf52-472d-af07-d81b9cf8a5e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-544176784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2debda1cc8ff470b9c83ea54eb8ed955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf46f11-8d", "ovs_interfaceid": "dbf46f11-8d35-4234-8748-d198b36de354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:44:04 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:44:04 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:44:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1296328350',display_name='tempest-TestServerVolumeAttachmentScenario-server-1296328350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1296328350',id=46,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtN2Q5jfP2RntBU9L6ER0E7a/zCyVtC68ApwpubADq3M1CkZzk5zVtAM5ppxhhaaPcKmzE+u7QSONVOgUWC/CCFql4PWWgla/afPH4qQE8KTzlCDPip2aL8+dGrolbJ+g==',key_name='tempest-keypair-2081832247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2debda1cc8ff470b9c83ea54eb8ed955',ramdisk_id='',reservation_id='r-33rrb6sw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1356741363',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1356741363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:44:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff5000940b6d4cc79590b52201b8cd8c',uuid=85da743e-e2c7-42c1-8621-f9942e115b01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbf46f11-8d35-4234-8748-d198b36de354", "address": "fa:16:3e:31:70:b3", "network": {"id": "a1da2ef5-bf52-472d-af07-d81b9cf8a5e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-544176784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2debda1cc8ff470b9c83ea54eb8ed955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf46f11-8d", "ovs_interfaceid": "dbf46f11-8d35-4234-8748-d198b36de354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Converting VIF {"id": "dbf46f11-8d35-4234-8748-d198b36de354", "address": "fa:16:3e:31:70:b3", "network": {"id": "a1da2ef5-bf52-472d-af07-d81b9cf8a5e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-544176784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2debda1cc8ff470b9c83ea54eb8ed955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf46f11-8d", "ovs_interfaceid": "dbf46f11-8d35-4234-8748-d198b36de354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:70:b3,bridge_name='br-int',has_traffic_filtering=True,id=dbf46f11-8d35-4234-8748-d198b36de354,network=Network(a1da2ef5-bf52-472d-af07-d81b9cf8a5e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf46f11-8d') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.objects.instance [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lazy-loading 'pci_devices' on Instance uuid 85da743e-e2c7-42c1-8621-f9942e115b01 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:44:04 user nova-compute[72849]:   <uuid>85da743e-e2c7-42c1-8621-f9942e115b01</uuid>
Aug 15 16:44:04 user nova-compute[72849]:   <name>instance-0000002e</name>
Aug 15 16:44:04 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:44:04 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:44:04 user nova-compute[72849]:   <metadata>
Aug 15 16:44:04 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:44:04 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:44:04 user nova-compute[72849]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1296328350</nova:name>
Aug 15 16:44:04 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:44:04</nova:creationTime>
Aug 15 16:44:04 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:44:04 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:44:04 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:44:04 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:44:04 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:44:04 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:44:04 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:44:04 user nova-compute[72849]:       <nova:owner>
Aug 15 16:44:04 user nova-compute[72849]:         <nova:user uuid="ff5000940b6d4cc79590b52201b8cd8c">tempest-TestServerVolumeAttachmentScenario-1356741363-project-member</nova:user>
Aug 15 16:44:04 user nova-compute[72849]:         <nova:project uuid="2debda1cc8ff470b9c83ea54eb8ed955">tempest-TestServerVolumeAttachmentScenario-1356741363</nova:project>
Aug 15 16:44:04 user nova-compute[72849]:       </nova:owner>
Aug 15 16:44:04 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:44:04 user nova-compute[72849]:       <nova:ports>
Aug 15 16:44:04 user nova-compute[72849]:         <nova:port uuid="dbf46f11-8d35-4234-8748-d198b36de354">
Aug 15 16:44:04 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 16:44:04 user nova-compute[72849]:         </nova:port>
Aug 15 16:44:04 user nova-compute[72849]:       </nova:ports>
Aug 15 16:44:04 user nova-compute[72849]:     </nova:instance>
Aug 15 16:44:04 user nova-compute[72849]:   </metadata>
Aug 15 16:44:04 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:44:04 user nova-compute[72849]:     <system>
Aug 15 16:44:04 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:44:04 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:44:04 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:44:04 user nova-compute[72849]:       <entry name="serial">85da743e-e2c7-42c1-8621-f9942e115b01</entry>
Aug 15 16:44:04 user nova-compute[72849]:       <entry name="uuid">85da743e-e2c7-42c1-8621-f9942e115b01</entry>
Aug 15 16:44:04 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:44:04 user nova-compute[72849]:     </system>
Aug 15 16:44:04 user nova-compute[72849]:   </sysinfo>
Aug 15 16:44:04 user nova-compute[72849]:   <os>
Aug 15 16:44:04 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:44:04 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:44:04 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:44:04 user nova-compute[72849]:   </os>
Aug 15 16:44:04 user nova-compute[72849]:   <features>
Aug 15 16:44:04 user nova-compute[72849]:     <acpi/>
Aug 15 16:44:04 user nova-compute[72849]:     <apic/>
Aug 15 16:44:04 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:44:04 user nova-compute[72849]:   </features>
Aug 15 16:44:04 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:44:04 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:44:04 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:44:04 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:44:04 user nova-compute[72849]:   </clock>
Aug 15 16:44:04 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:44:04 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:44:04 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:44:04 user nova-compute[72849]:   </cpu>
Aug 15 16:44:04 user nova-compute[72849]:   <devices>
Aug 15 16:44:04 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:44:04 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:44:04 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk"/>
Aug 15 16:44:04 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:44:04 user nova-compute[72849]:     </disk>
Aug 15 16:44:04 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:44:04 user nova-compute[72849]:       <mac address="fa:16:3e:31:70:b3"/>
Aug 15 16:44:04 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:44:04 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:44:04 user nova-compute[72849]:       <target dev="tapdbf46f11-8d"/>
Aug 15 16:44:04 user nova-compute[72849]:     </interface>
Aug 15 16:44:04 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:44:04 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/console.log" append="off"/>
Aug 15 16:44:04 user nova-compute[72849]:     </serial>
Aug 15 16:44:04 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:44:04 user nova-compute[72849]:     <video>
Aug 15 16:44:04 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:44:04 user nova-compute[72849]:     </video>
Aug 15 16:44:04 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:44:04 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:44:04 user nova-compute[72849]:     </rng>
Aug 15 16:44:04 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:44:04 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:44:04 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:44:04 user nova-compute[72849]:     </memballoon>
Aug 15 16:44:04 user nova-compute[72849]:   </devices>
Aug 15 16:44:04 user nova-compute[72849]: </domain>
Aug 15 16:44:04 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:44:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1296328350',display_name='tempest-TestServerVolumeAttachmentScenario-server-1296328350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1296328350',id=46,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtN2Q5jfP2RntBU9L6ER0E7a/zCyVtC68ApwpubADq3M1CkZzk5zVtAM5ppxhhaaPcKmzE+u7QSONVOgUWC/CCFql4PWWgla/afPH4qQE8KTzlCDPip2aL8+dGrolbJ+g==',key_name='tempest-keypair-2081832247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2debda1cc8ff470b9c83ea54eb8ed955',ramdisk_id='',reservation_id='r-33rrb6sw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1356741363',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1356741363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:44:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff5000940b6d4cc79590b52201b8cd8c',uuid=85da743e-e2c7-42c1-8621-f9942e115b01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbf46f11-8d35-4234-8748-d198b36de354", "address": "fa:16:3e:31:70:b3", "network": {"id": "a1da2ef5-bf52-472d-af07-d81b9cf8a5e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-544176784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2debda1cc8ff470b9c83ea54eb8ed955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf46f11-8d", "ovs_interfaceid": "dbf46f11-8d35-4234-8748-d198b36de354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Converting VIF {"id": "dbf46f11-8d35-4234-8748-d198b36de354", "address": "fa:16:3e:31:70:b3", "network": {"id": "a1da2ef5-bf52-472d-af07-d81b9cf8a5e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-544176784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2debda1cc8ff470b9c83ea54eb8ed955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf46f11-8d", "ovs_interfaceid": "dbf46f11-8d35-4234-8748-d198b36de354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:70:b3,bridge_name='br-int',has_traffic_filtering=True,id=dbf46f11-8d35-4234-8748-d198b36de354,network=Network(a1da2ef5-bf52-472d-af07-d81b9cf8a5e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf46f11-8d') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG os_vif [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:70:b3,bridge_name='br-int',has_traffic_filtering=True,id=dbf46f11-8d35-4234-8748-d198b36de354,network=Network(a1da2ef5-bf52-472d-af07-d81b9cf8a5e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf46f11-8d') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbf46f11-8d, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdbf46f11-8d, col_values=(('external_ids', {'iface-id': 'dbf46f11-8d35-4234-8748-d198b36de354', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:70:b3', 'vm-uuid': '85da743e-e2c7-42c1-8621-f9942e115b01'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:04 user nova-compute[72849]: INFO os_vif [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:70:b3,bridge_name='br-int',has_traffic_filtering=True,id=dbf46f11-8d35-4234-8748-d198b36de354,network=Network(a1da2ef5-bf52-472d-af07-d81b9cf8a5e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf46f11-8d')
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] No VIF found with MAC fa:16:3e:31:70:b3, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.network.neutron [req-6354f69b-e61d-4325-abaf-fddcaef9daab req-b118200d-5605-407f-8d3e-ccb154cdf07e service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Updated VIF entry in instance network info cache for port dbf46f11-8d35-4234-8748-d198b36de354. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG nova.network.neutron [req-6354f69b-e61d-4325-abaf-fddcaef9daab req-b118200d-5605-407f-8d3e-ccb154cdf07e service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Updating instance_info_cache with network_info: [{"id": "dbf46f11-8d35-4234-8748-d198b36de354", "address": "fa:16:3e:31:70:b3", "network": {"id": "a1da2ef5-bf52-472d-af07-d81b9cf8a5e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-544176784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2debda1cc8ff470b9c83ea54eb8ed955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf46f11-8d", "ovs_interfaceid": "dbf46f11-8d35-4234-8748-d198b36de354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:44:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6354f69b-e61d-4325-abaf-fddcaef9daab req-b118200d-5605-407f-8d3e-ccb154cdf07e service nova] Releasing lock "refresh_cache-85da743e-e2c7-42c1-8621-f9942e115b01" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:44:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-11718dd0-0998-446b-a0e5-ce2becfb604e req-50d27270-9b8d-4d97-8357-c464c8c29c3f service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Received event network-vif-plugged-dbf46f11-8d35-4234-8748-d198b36de354 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:44:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-11718dd0-0998-446b-a0e5-ce2becfb604e req-50d27270-9b8d-4d97-8357-c464c8c29c3f service nova] Acquiring lock "85da743e-e2c7-42c1-8621-f9942e115b01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-11718dd0-0998-446b-a0e5-ce2becfb604e req-50d27270-9b8d-4d97-8357-c464c8c29c3f service nova] Lock "85da743e-e2c7-42c1-8621-f9942e115b01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-11718dd0-0998-446b-a0e5-ce2becfb604e req-50d27270-9b8d-4d97-8357-c464c8c29c3f service nova] Lock "85da743e-e2c7-42c1-8621-f9942e115b01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-11718dd0-0998-446b-a0e5-ce2becfb604e req-50d27270-9b8d-4d97-8357-c464c8c29c3f service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] No waiting events found dispatching network-vif-plugged-dbf46f11-8d35-4234-8748-d198b36de354 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:44:05 user nova-compute[72849]: WARNING nova.compute.manager [req-11718dd0-0998-446b-a0e5-ce2becfb604e req-50d27270-9b8d-4d97-8357-c464c8c29c3f service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Received unexpected event network-vif-plugged-dbf46f11-8d35-4234-8748-d198b36de354 for instance with vm_state building and task_state spawning.
Aug 15 16:44:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:07 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117847.8421395, 85da743e-e2c7-42c1-8621-f9942e115b01 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:44:07 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] VM Resumed (Lifecycle Event)
Aug 15 16:44:07 user nova-compute[72849]: DEBUG nova.compute.manager [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:44:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:44:07 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Instance spawned successfully.
Aug 15 16:44:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:44:07 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:44:07 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:44:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:44:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:44:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:44:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:44:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:44:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:44:07 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:44:07 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117847.8457828, 85da743e-e2c7-42c1-8621-f9942e115b01 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:44:07 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] VM Started (Lifecycle Event)
Aug 15 16:44:07 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:44:07 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:44:07 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:44:07 user nova-compute[72849]: INFO nova.compute.manager [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Took 5.59 seconds to spawn the instance on the hypervisor.
Aug 15 16:44:07 user nova-compute[72849]: DEBUG nova.compute.manager [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:44:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-b44b6e67-7b92-4a63-b2d0-f2b9d8ac4526 req-99e2a928-3947-4780-a578-5757e3400249 service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Received event network-vif-plugged-dbf46f11-8d35-4234-8748-d198b36de354 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:44:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b44b6e67-7b92-4a63-b2d0-f2b9d8ac4526 req-99e2a928-3947-4780-a578-5757e3400249 service nova] Acquiring lock "85da743e-e2c7-42c1-8621-f9942e115b01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b44b6e67-7b92-4a63-b2d0-f2b9d8ac4526 req-99e2a928-3947-4780-a578-5757e3400249 service nova] Lock "85da743e-e2c7-42c1-8621-f9942e115b01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b44b6e67-7b92-4a63-b2d0-f2b9d8ac4526 req-99e2a928-3947-4780-a578-5757e3400249 service nova] Lock "85da743e-e2c7-42c1-8621-f9942e115b01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-b44b6e67-7b92-4a63-b2d0-f2b9d8ac4526 req-99e2a928-3947-4780-a578-5757e3400249 service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] No waiting events found dispatching network-vif-plugged-dbf46f11-8d35-4234-8748-d198b36de354 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:44:07 user nova-compute[72849]: WARNING nova.compute.manager [req-b44b6e67-7b92-4a63-b2d0-f2b9d8ac4526 req-99e2a928-3947-4780-a578-5757e3400249 service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Received unexpected event network-vif-plugged-dbf46f11-8d35-4234-8748-d198b36de354 for instance with vm_state building and task_state spawning.
Aug 15 16:44:08 user nova-compute[72849]: INFO nova.compute.manager [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Took 6.26 seconds to build instance.
Aug 15 16:44:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-432748cd-b437-46ba-be84-22440353d865 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "85da743e-e2c7-42c1-8621-f9942e115b01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.353s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:44:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:44:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:44:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:44:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:44:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "7722de29-482a-4f75-a3ed-d4293fdd9db8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:30 user nova-compute[72849]: INFO nova.compute.manager [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Unshelving
Aug 15 16:44:30 user nova-compute[72849]: INFO nova.virt.block_device [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Booting with volume bea85e2c-f0d1-47ab-819b-736df16b67d1 at /dev/vda
Aug 15 16:44:30 user nova-compute[72849]: DEBUG os_brick.utils [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7232cccb-3cf8-467f-a111-9db55ae76cd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24953ff-b319-4ff7-924b-072f2aa043fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fc9e7f-c707-4d46-924f-563021c8d4dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6d39b8-c68a-42bb-b91b-580f171bffeb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:44:30 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:44:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f6dc35-21bf-487e-9ae5-d4b9dd5b0000]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG os_brick.utils [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:44:30 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Updating existing volume attachment record: fb0f2c21-f529-447a-83b5-9b412b9dfcb9 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquiring lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquiring lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:33 user nova-compute[72849]: INFO nova.compute.manager [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Terminating instance
Aug 15 16:44:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-8b037e1b-fc23-4ed5-9af1-ae764af31955 req-28fc3c33-d742-42d2-81f6-83eeb7208d09 service nova] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Received event network-vif-unplugged-d81abc96-99af-4450-bf06-a53ff4663ea8 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8b037e1b-fc23-4ed5-9af1-ae764af31955 req-28fc3c33-d742-42d2-81f6-83eeb7208d09 service nova] Acquiring lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8b037e1b-fc23-4ed5-9af1-ae764af31955 req-28fc3c33-d742-42d2-81f6-83eeb7208d09 service nova] Lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8b037e1b-fc23-4ed5-9af1-ae764af31955 req-28fc3c33-d742-42d2-81f6-83eeb7208d09 service nova] Lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-8b037e1b-fc23-4ed5-9af1-ae764af31955 req-28fc3c33-d742-42d2-81f6-83eeb7208d09 service nova] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] No waiting events found dispatching network-vif-unplugged-d81abc96-99af-4450-bf06-a53ff4663ea8 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-8b037e1b-fc23-4ed5-9af1-ae764af31955 req-28fc3c33-d742-42d2-81f6-83eeb7208d09 service nova] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Received event network-vif-unplugged-d81abc96-99af-4450-bf06-a53ff4663ea8 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:44:33 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Instance destroyed successfully.
Aug 15 16:44:33 user nova-compute[72849]: DEBUG nova.objects.instance [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lazy-loading 'resources' on Instance uuid 7fc2d7c5-2c57-4466-aeda-58930af3e57c {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-92442670',display_name='tempest-VolumesActionsTest-instance-92442670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-92442670',id=44,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:42:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48a6bda829b4429b87c54780795763e1',ramdisk_id='',reservation_id='r-bfsgas4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1889056072',owner_user_name='tempest-VolumesActionsTest-1889056072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:42:49Z,user_data=None,user_id='058da58bd1924ef78c9228777f898a5d',uuid=7fc2d7c5-2c57-4466-aeda-58930af3e57c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d81abc96-99af-4450-bf06-a53ff4663ea8", "address": "fa:16:3e:45:81:8b", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81abc96-99", "ovs_interfaceid": "d81abc96-99af-4450-bf06-a53ff4663ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Converting VIF {"id": "d81abc96-99af-4450-bf06-a53ff4663ea8", "address": "fa:16:3e:45:81:8b", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81abc96-99", "ovs_interfaceid": "d81abc96-99af-4450-bf06-a53ff4663ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:81:8b,bridge_name='br-int',has_traffic_filtering=True,id=d81abc96-99af-4450-bf06-a53ff4663ea8,network=Network(f410fe9a-3118-492b-99d1-e54500294d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81abc96-99') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG os_vif [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:81:8b,bridge_name='br-int',has_traffic_filtering=True,id=d81abc96-99af-4450-bf06-a53ff4663ea8,network=Network(f410fe9a-3118-492b-99d1-e54500294d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81abc96-99') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd81abc96-99, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:44:33 user nova-compute[72849]: INFO os_vif [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:81:8b,bridge_name='br-int',has_traffic_filtering=True,id=d81abc96-99af-4450-bf06-a53ff4663ea8,network=Network(f410fe9a-3118-492b-99d1-e54500294d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81abc96-99')
Aug 15 16:44:33 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Deleting instance files /opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c_del
Aug 15 16:44:33 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Deletion of /opt/stack/data/nova/instances/7fc2d7c5-2c57-4466-aeda-58930af3e57c_del complete
Aug 15 16:44:33 user nova-compute[72849]: INFO nova.compute.manager [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 15 16:44:33 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:44:33 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:44:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:34 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:44:34 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Took 0.90 seconds to deallocate network for instance.
Aug 15 16:44:34 user nova-compute[72849]: DEBUG nova.compute.manager [req-2ffadb18-02db-4b8b-a76c-d9cbf5f4efea req-2a8cf700-29e0-4761-a07b-d9346465e2e8 service nova] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Received event network-vif-deleted-d81abc96-99af-4450-bf06-a53ff4663ea8 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:44:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:35 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:44:35 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:44:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:35 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Deleted allocations for instance 7fc2d7c5-2c57-4466-aeda-58930af3e57c
Aug 15 16:44:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4aa710fd-6407-47bc-9258-6f0c88ffc75d tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.244s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:35 user nova-compute[72849]: DEBUG nova.compute.manager [req-1f8c0e7b-3704-4d5e-a76d-f040639bea59 req-69aa1c17-149d-4902-94ec-b860ae54904b service nova] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Received event network-vif-plugged-d81abc96-99af-4450-bf06-a53ff4663ea8 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:44:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1f8c0e7b-3704-4d5e-a76d-f040639bea59 req-69aa1c17-149d-4902-94ec-b860ae54904b service nova] Acquiring lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1f8c0e7b-3704-4d5e-a76d-f040639bea59 req-69aa1c17-149d-4902-94ec-b860ae54904b service nova] Lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:35 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1f8c0e7b-3704-4d5e-a76d-f040639bea59 req-69aa1c17-149d-4902-94ec-b860ae54904b service nova] Lock "7fc2d7c5-2c57-4466-aeda-58930af3e57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:35 user nova-compute[72849]: DEBUG nova.compute.manager [req-1f8c0e7b-3704-4d5e-a76d-f040639bea59 req-69aa1c17-149d-4902-94ec-b860ae54904b service nova] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] No waiting events found dispatching network-vif-plugged-d81abc96-99af-4450-bf06-a53ff4663ea8 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:44:35 user nova-compute[72849]: WARNING nova.compute.manager [req-1f8c0e7b-3704-4d5e-a76d-f040639bea59 req-69aa1c17-149d-4902-94ec-b860ae54904b service nova] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Received unexpected event network-vif-plugged-d81abc96-99af-4450-bf06-a53ff4663ea8 for instance with vm_state deleted and task_state None.
Aug 15 16:44:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:39 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lazy-loading 'pci_requests' on Instance uuid 7722de29-482a-4f75-a3ed-d4293fdd9db8 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:44:39 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lazy-loading 'numa_topology' on Instance uuid 7722de29-482a-4f75-a3ed-d4293fdd9db8 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:44:39 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:44:39 user nova-compute[72849]: INFO nova.compute.claims [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Claim successful on node user
Aug 15 16:44:40 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:44:40 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:44:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:40 user nova-compute[72849]: INFO nova.network.neutron [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Updating port 4bb47a58-9f72-4291-9270-b5a0a988725c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 16:44:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:44:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquired lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:44:40 user nova-compute[72849]: DEBUG nova.network.neutron [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-26420596-cc42-41a9-8275-ea79128b1567 req-ccbc33ed-19ff-429c-b8cb-d28136448a0f service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received event network-changed-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-26420596-cc42-41a9-8275-ea79128b1567 req-ccbc33ed-19ff-429c-b8cb-d28136448a0f service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Refreshing instance network info cache due to event network-changed-4bb47a58-9f72-4291-9270-b5a0a988725c. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-26420596-cc42-41a9-8275-ea79128b1567 req-ccbc33ed-19ff-429c-b8cb-d28136448a0f service nova] Acquiring lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-ff3d801d-ddc7-4f90-8cc8-a577d6482270" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-ff3d801d-ddc7-4f90-8cc8-a577d6482270" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.network.neutron [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Updating instance_info_cache with network_info: [{"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Releasing lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:44:41 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Creating image(s)
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Did not create local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Ensure instance console log exists: /opt/stack/data/nova/instances/7722de29-482a-4f75-a3ed-d4293fdd9db8/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Start _get_guest_xml network_info=[{"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRkmTJKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7722de29-482a-4f75-a3ed-d4293fdd9db8', 'attached_at': '', 'detached_at': '', 'volume_id': 'bea85e2c-f0d1-47ab-819b-736df16b67d1', 'serial': 'bea85e2c-f0d1-47ab-819b-736df16b67d1'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'fb0f2c21-f529-447a-83b5-9b412b9dfcb9', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-26420596-cc42-41a9-8275-ea79128b1567 req-ccbc33ed-19ff-429c-b8cb-d28136448a0f service nova] Acquired lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.network.neutron [req-26420596-cc42-41a9-8275-ea79128b1567 req-ccbc33ed-19ff-429c-b8cb-d28136448a0f service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Refreshing network info cache for port 4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:44:41 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:44:41 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7722de29-482a-4f75-a3ed-d4293fdd9db8 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRkmTJKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:44:41 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:44:41 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:44:41 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc26ae3-e71d-46d7-ada5-5fd47ed38425]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:44:41 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a697f3-fbc1-489d-b75b-b9db63e080aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1] added
Aug 15 16:44:41 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8056056-a6a4-4b5c-81f6-4725ca6cc8b4]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[593ee039-5b4c-4ac4-a22b-5ed0837ed0dd]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iRkmTJKb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iRkmTJKb" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a6c25f-e30a-4c87-81df-38234b429c34]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iRkmTJKb'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0ffe10-069f-4a22-8f7d-fc317db48181]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[45145042-a27f-4987-a36e-3522fcaf33cf]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)
Aug 15 16:44:41 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)
Aug 15 16:44:41 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1011c46f-552b-4205-ab58-f020817f3157]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1, portal: 172.16.0.220,3260]
Aug 15 16:44:41 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1, portal: 172.16.0.220,3260] successful.
Aug 15 16:44:41 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca8eb11-c5bd-4f68-9242-d6790deb53dd]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff157dd0-7c7f-4a89-9a2f-cc6190d548b5]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)
Aug 15 16:44:41 user nova-compute[72849]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:44:41 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)
Aug 15 16:44:41 user nova-compute[72849]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:44:41 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a00f8bd-3923-4648-ae06-12d5c8540b68]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:44:41 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRkmTJKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Updating instance_info_cache with network_info: [{"id": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "address": "fa:16:3e:79:89:fb", "network": {"id": "e58f7f18-d91b-491d-a7df-8dcfd65e8c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1908380537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5023408270042d1849f75aa91a764c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730cbf2-c9", "ovs_interfaceid": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-ff3d801d-ddc7-4f90-8cc8-a577d6482270" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG nova.network.neutron [req-26420596-cc42-41a9-8275-ea79128b1567 req-ccbc33ed-19ff-429c-b8cb-d28136448a0f service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Updated VIF entry in instance network info cache for port 4bb47a58-9f72-4291-9270-b5a0a988725c. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG nova.network.neutron [req-26420596-cc42-41a9-8275-ea79128b1567 req-ccbc33ed-19ff-429c-b8cb-d28136448a0f service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Updating instance_info_cache with network_info: [{"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-26420596-cc42-41a9-8275-ea79128b1567 req-ccbc33ed-19ff-429c-b8cb-d28136448a0f service nova] Releasing lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23961393565306161', 'path': '/dev/sdc'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961393565306161', 'path': '/dev/sdc'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T16:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-648703954',display_name='tempest-TestShelveInstance-server-648703954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-648703954',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1445995414',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:41:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a35bb132e2cc4dfc99e383862ce86829',ramdisk_id='',reservation_id='r-2h2pgqco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-628082297',owner_user_name='tempest-TestShelveInstance-628082297-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:44:31Z,user_data=None,user_id='ae3d508464a14dad9113a56fac6f0f32',uuid=7722de29-482a-4f75-a3ed-d4293fdd9db8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Converting VIF {"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=4bb47a58-9f72-4291-9270-b5a0a988725c,network=Network(1d8f6acf-691c-4a97-a585-dd9fc43a7b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb47a58-9f') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lazy-loading 'pci_devices' on Instance uuid 7722de29-482a-4f75-a3ed-d4293fdd9db8 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:44:42 user nova-compute[72849]:   <uuid>7722de29-482a-4f75-a3ed-d4293fdd9db8</uuid>
Aug 15 16:44:42 user nova-compute[72849]:   <name>instance-0000002b</name>
Aug 15 16:44:42 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:44:42 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:44:42 user nova-compute[72849]:   <metadata>
Aug 15 16:44:42 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:44:42 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:44:42 user nova-compute[72849]:       <nova:name>tempest-TestShelveInstance-server-648703954</nova:name>
Aug 15 16:44:42 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:44:41</nova:creationTime>
Aug 15 16:44:42 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:44:42 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:44:42 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:44:42 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:44:42 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:44:42 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:44:42 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:44:42 user nova-compute[72849]:       <nova:owner>
Aug 15 16:44:42 user nova-compute[72849]:         <nova:user uuid="ae3d508464a14dad9113a56fac6f0f32">tempest-TestShelveInstance-628082297-project-member</nova:user>
Aug 15 16:44:42 user nova-compute[72849]:         <nova:project uuid="a35bb132e2cc4dfc99e383862ce86829">tempest-TestShelveInstance-628082297</nova:project>
Aug 15 16:44:42 user nova-compute[72849]:       </nova:owner>
Aug 15 16:44:42 user nova-compute[72849]:       <nova:ports>
Aug 15 16:44:42 user nova-compute[72849]:         <nova:port uuid="4bb47a58-9f72-4291-9270-b5a0a988725c">
Aug 15 16:44:42 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 16:44:42 user nova-compute[72849]:         </nova:port>
Aug 15 16:44:42 user nova-compute[72849]:       </nova:ports>
Aug 15 16:44:42 user nova-compute[72849]:     </nova:instance>
Aug 15 16:44:42 user nova-compute[72849]:   </metadata>
Aug 15 16:44:42 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:44:42 user nova-compute[72849]:     <system>
Aug 15 16:44:42 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:44:42 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:44:42 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:44:42 user nova-compute[72849]:       <entry name="serial">7722de29-482a-4f75-a3ed-d4293fdd9db8</entry>
Aug 15 16:44:42 user nova-compute[72849]:       <entry name="uuid">7722de29-482a-4f75-a3ed-d4293fdd9db8</entry>
Aug 15 16:44:42 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:44:42 user nova-compute[72849]:     </system>
Aug 15 16:44:42 user nova-compute[72849]:   </sysinfo>
Aug 15 16:44:42 user nova-compute[72849]:   <os>
Aug 15 16:44:42 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:44:42 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:44:42 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:44:42 user nova-compute[72849]:   </os>
Aug 15 16:44:42 user nova-compute[72849]:   <features>
Aug 15 16:44:42 user nova-compute[72849]:     <acpi/>
Aug 15 16:44:42 user nova-compute[72849]:     <apic/>
Aug 15 16:44:42 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:44:42 user nova-compute[72849]:   </features>
Aug 15 16:44:42 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:44:42 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:44:42 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:44:42 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:44:42 user nova-compute[72849]:   </clock>
Aug 15 16:44:42 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:44:42 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:44:42 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:44:42 user nova-compute[72849]:   </cpu>
Aug 15 16:44:42 user nova-compute[72849]:   <devices>
Aug 15 16:44:42 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:44:42 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:44:42 user nova-compute[72849]:       <source dev="/dev/sdc"/>
Aug 15 16:44:42 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:44:42 user nova-compute[72849]:       <serial>bea85e2c-f0d1-47ab-819b-736df16b67d1</serial>
Aug 15 16:44:42 user nova-compute[72849]:     </disk>
Aug 15 16:44:42 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:44:42 user nova-compute[72849]:       <mac address="fa:16:3e:83:2e:30"/>
Aug 15 16:44:42 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:44:42 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:44:42 user nova-compute[72849]:       <target dev="tap4bb47a58-9f"/>
Aug 15 16:44:42 user nova-compute[72849]:     </interface>
Aug 15 16:44:42 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:44:42 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/7722de29-482a-4f75-a3ed-d4293fdd9db8/console.log" append="off"/>
Aug 15 16:44:42 user nova-compute[72849]:     </serial>
Aug 15 16:44:42 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:44:42 user nova-compute[72849]:     <video>
Aug 15 16:44:42 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:44:42 user nova-compute[72849]:     </video>
Aug 15 16:44:42 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:44:42 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:44:42 user nova-compute[72849]:     </rng>
Aug 15 16:44:42 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:44:42 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:44:42 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:44:42 user nova-compute[72849]:     </memballoon>
Aug 15 16:44:42 user nova-compute[72849]:   </devices>
Aug 15 16:44:42 user nova-compute[72849]: </domain>
Aug 15 16:44:42 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T16:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-648703954',display_name='tempest-TestShelveInstance-server-648703954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-648703954',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1445995414',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:41:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a35bb132e2cc4dfc99e383862ce86829',ramdisk_id='',reservation_id='r-2h2pgqco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-628082297',owner_user_name='tempest-TestShelveInstance-628082297-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:44:31Z,user_data=None,user_id='ae3d508464a14dad9113a56fac6f0f32',uuid=7722de29-482a-4f75-a3ed-d4293fdd9db8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Converting VIF {"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=4bb47a58-9f72-4291-9270-b5a0a988725c,network=Network(1d8f6acf-691c-4a97-a585-dd9fc43a7b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb47a58-9f') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG os_vif [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=4bb47a58-9f72-4291-9270-b5a0a988725c,network=Network(1d8f6acf-691c-4a97-a585-dd9fc43a7b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb47a58-9f') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bb47a58-9f, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4bb47a58-9f, col_values=(('external_ids', {'iface-id': '4bb47a58-9f72-4291-9270-b5a0a988725c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:2e:30', 'vm-uuid': '7722de29-482a-4f75-a3ed-d4293fdd9db8'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:44:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:42 user nova-compute[72849]: INFO os_vif [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=4bb47a58-9f72-4291-9270-b5a0a988725c,network=Network(1d8f6acf-691c-4a97-a585-dd9fc43a7b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb47a58-9f')
Aug 15 16:44:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:44:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] No VIF found with MAC fa:16:3e:83:2e:30, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:44:43 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:44:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-ce6bfe47-9e58-41bc-99be-d6853a6e9e9f req-1428bffd-90fa-4a61-9b7c-5584b380a3c9 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received event network-vif-plugged-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:44:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ce6bfe47-9e58-41bc-99be-d6853a6e9e9f req-1428bffd-90fa-4a61-9b7c-5584b380a3c9 service nova] Acquiring lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ce6bfe47-9e58-41bc-99be-d6853a6e9e9f req-1428bffd-90fa-4a61-9b7c-5584b380a3c9 service nova] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-ce6bfe47-9e58-41bc-99be-d6853a6e9e9f req-1428bffd-90fa-4a61-9b7c-5584b380a3c9 service nova] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:44 user nova-compute[72849]: DEBUG nova.compute.manager [req-ce6bfe47-9e58-41bc-99be-d6853a6e9e9f req-1428bffd-90fa-4a61-9b7c-5584b380a3c9 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] No waiting events found dispatching network-vif-plugged-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:44:44 user nova-compute[72849]: WARNING nova.compute.manager [req-ce6bfe47-9e58-41bc-99be-d6853a6e9e9f req-1428bffd-90fa-4a61-9b7c-5584b380a3c9 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received unexpected event network-vif-plugged-4bb47a58-9f72-4291-9270-b5a0a988725c for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 16:44:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:46 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:44:46 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117886.306401, 7722de29-482a-4f75-a3ed-d4293fdd9db8 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:44:46 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] VM Resumed (Lifecycle Event)
Aug 15 16:44:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:44:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:44:46 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Instance spawned successfully.
Aug 15 16:44:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:44:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:44:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:44:46 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:44:46 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117886.3098576, 7722de29-482a-4f75-a3ed-d4293fdd9db8 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:44:46 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] VM Started (Lifecycle Event)
Aug 15 16:44:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:44:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:44:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ca28ec74-4f64-4da6-94d3-93a87effac83 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.711s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:46 user nova-compute[72849]: DEBUG nova.compute.manager [req-793b228c-a267-44b3-a43d-fe1b1a4db1df req-d59c63f1-020a-49b3-8ebb-083dc5119913 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received event network-vif-plugged-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:44:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-793b228c-a267-44b3-a43d-fe1b1a4db1df req-d59c63f1-020a-49b3-8ebb-083dc5119913 service nova] Acquiring lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-793b228c-a267-44b3-a43d-fe1b1a4db1df req-d59c63f1-020a-49b3-8ebb-083dc5119913 service nova] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-793b228c-a267-44b3-a43d-fe1b1a4db1df req-d59c63f1-020a-49b3-8ebb-083dc5119913 service nova] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:46 user nova-compute[72849]: DEBUG nova.compute.manager [req-793b228c-a267-44b3-a43d-fe1b1a4db1df req-d59c63f1-020a-49b3-8ebb-083dc5119913 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] No waiting events found dispatching network-vif-plugged-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:44:46 user nova-compute[72849]: WARNING nova.compute.manager [req-793b228c-a267-44b3-a43d-fe1b1a4db1df req-d59c63f1-020a-49b3-8ebb-083dc5119913 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received unexpected event network-vif-plugged-4bb47a58-9f72-4291-9270-b5a0a988725c for instance with vm_state active and task_state None.
Aug 15 16:44:47 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:44:47 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:44:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:47 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:44:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:44:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:44:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:47 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:48 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:44:48 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:44:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8230MB free_disk=25.201374053955078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:44:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:44:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance e229ced9-d1cf-4765-9ba7-b32cdf47960b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:44:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 85da743e-e2c7-42c1-8621-f9942e115b01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:44:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 7722de29-482a-4f75-a3ed-d4293fdd9db8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:44:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:44:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:44:48 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117873.7959268, 7fc2d7c5-2c57-4466-aeda-58930af3e57c => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:44:48 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] VM Stopped (Lifecycle Event)
Aug 15 16:44:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-642880c0-9a5a-4b2a-99de-8ef75e3b0cb2 None None] [instance: 7fc2d7c5-2c57-4466-aeda-58930af3e57c] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:44:48 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:44:48 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:44:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:44:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:49 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:44:49 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:44:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:44:52 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:44:52 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:44:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:54 user nova-compute[72849]: DEBUG nova.objects.instance [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lazy-loading 'flavor' on Instance uuid ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:44:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:44:55 user nova-compute[72849]: INFO nova.compute.manager [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Attaching volume 3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a to /dev/vdb
Aug 15 16:44:55 user nova-compute[72849]: DEBUG os_brick.utils [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a03b1e-e2ca-48df-b7b2-cf150b574172]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac514a24-97ef-4a99-bc12-3d8a9c22136d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d8b364-2ba7-4e8a-8b30-acaeef705ba3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddfa266-5198-40c4-ab4a-708c25a0e420]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:44:55 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:44:55 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[207a2193-708c-4892-aea7-dfb0a97eb512]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG os_brick.utils [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:44:55 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Updating existing volume attachment record: 6ed930cf-350a-4329-b870-0e72eeeaf213 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:44:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:44:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:03 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:45:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DnAiZCWz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:45:03 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:45:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:45:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:45:03 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:45:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:45:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:45:03 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:45:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[399a8d46-42eb-4a0a-bf88-503f3817e66e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:45:04 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2a5390-02d8-450d-a58c-01befde7d5b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a] added
Aug 15 16:45:04 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8fc7e1-8465-41af-b263-d93a6853fb9a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bc0876-64df-449a-9901-b4afcd36a6c4]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DnAiZCWz {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DnAiZCWz" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a093a8-bdad-4b81-a416-f35a4ccdb15b]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DnAiZCWz'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9479f6c-918d-47f0-8691-c3b7c1deb44b]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[472f7800-ac1c-4369-9b62-c2600dce87b8]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)
Aug 15 16:45:04 user nova-compute[72849]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:45:04 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)
Aug 15 16:45:04 user nova-compute[72849]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:45:04 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bde7e4-015f-4431-9d1a-a062e0baba3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a, portal: 172.16.0.220,3260]
Aug 15 16:45:04 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a, portal: 172.16.0.220,3260] successful.
Aug 15 16:45:04 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ada6abc-1636-4aae-8af5-a284b094c3b5]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d5d926-e915-43d5-a620-a1c18faf2c96]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)
Aug 15 16:45:04 user nova-compute[72849]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:45:04 user nova-compute[72849]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a (non-flash)
Aug 15 16:45:04 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)
Aug 15 16:45:04 user nova-compute[72849]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:45:04 user nova-compute[72849]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a (non-flash)
Aug 15 16:45:04 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dd8356-929c-4177-9144-0804319966b6]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DnAiZCWz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:45:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:05 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:45:05 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26333346637313763', 'path': '/dev/sdd'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:45:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333346637313763', 'path': '/dev/sdd'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:45:05 user nova-compute[72849]: DEBUG nova.objects.instance [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lazy-loading 'flavor' on Instance uuid ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:45:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:45:05 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:45:05 user nova-compute[72849]:   <source dev="/dev/sdd"/>
Aug 15 16:45:05 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:45:05 user nova-compute[72849]:   <serial>3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a</serial>
Aug 15 16:45:05 user nova-compute[72849]: </disk>
Aug 15 16:45:05 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:45:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:45:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:45:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:45:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:45:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:45:05 user nova-compute[72849]: INFO nova.compute.manager [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Terminating instance
Aug 15 16:45:05 user nova-compute[72849]: DEBUG nova.compute.manager [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:45:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:45:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:45:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] No VIF found with MAC fa:16:3e:79:89:fb, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:45:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-2db02822-ad1c-463e-a9b9-96167b247c0d tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.808s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG nova.compute.manager [req-b00314db-0acc-426f-988c-da8ab9f8643c req-e1ba6178-1e59-4f47-9d3b-9a543176b67b service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Received event network-vif-unplugged-88ff8111-9371-4da1-97ef-95f9ab035eac {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b00314db-0acc-426f-988c-da8ab9f8643c req-e1ba6178-1e59-4f47-9d3b-9a543176b67b service nova] Acquiring lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b00314db-0acc-426f-988c-da8ab9f8643c req-e1ba6178-1e59-4f47-9d3b-9a543176b67b service nova] Lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b00314db-0acc-426f-988c-da8ab9f8643c req-e1ba6178-1e59-4f47-9d3b-9a543176b67b service nova] Lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG nova.compute.manager [req-b00314db-0acc-426f-988c-da8ab9f8643c req-e1ba6178-1e59-4f47-9d3b-9a543176b67b service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] No waiting events found dispatching network-vif-unplugged-88ff8111-9371-4da1-97ef-95f9ab035eac {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG nova.compute.manager [req-b00314db-0acc-426f-988c-da8ab9f8643c req-e1ba6178-1e59-4f47-9d3b-9a543176b67b service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Received event network-vif-unplugged-88ff8111-9371-4da1-97ef-95f9ab035eac for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:06 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Instance destroyed successfully.
Aug 15 16:45:06 user nova-compute[72849]: DEBUG nova.objects.instance [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lazy-loading 'resources' on Instance uuid e229ced9-d1cf-4765-9ba7-b32cdf47960b {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-934327641',display_name='tempest-TestVolumeBootPattern-server-934327641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-934327641',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:43:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87edcbec784a4f65b99740f34ff121bb',ramdisk_id='',reservation_id='r-etgz3zcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1900922481',owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:43:40Z,user_data=None,user_id='fe3f48f280e54c2099e6b1db842db2cd',uuid=e229ced9-d1cf-4765-9ba7-b32cdf47960b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88ff8111-9371-4da1-97ef-95f9ab035eac", "address": "fa:16:3e:5b:4e:4c", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ff8111-93", "ovs_interfaceid": "88ff8111-9371-4da1-97ef-95f9ab035eac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converting VIF {"id": "88ff8111-9371-4da1-97ef-95f9ab035eac", "address": "fa:16:3e:5b:4e:4c", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ff8111-93", "ovs_interfaceid": "88ff8111-9371-4da1-97ef-95f9ab035eac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:4e:4c,bridge_name='br-int',has_traffic_filtering=True,id=88ff8111-9371-4da1-97ef-95f9ab035eac,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ff8111-93') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_vif [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:4e:4c,bridge_name='br-int',has_traffic_filtering=True,id=88ff8111-9371-4da1-97ef-95f9ab035eac,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ff8111-93') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88ff8111-93, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:45:06 user nova-compute[72849]: INFO os_vif [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:4e:4c,bridge_name='br-int',has_traffic_filtering=True,id=88ff8111-9371-4da1-97ef-95f9ab035eac,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ff8111-93')
Aug 15 16:45:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfGhotVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:45:06 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[033e69a6-e209-42c8-97f3-d06febd849ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffabbf9-f943-41a3-b6e4-a03461650f9d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)
Aug 15 16:45:06 user nova-compute[72849]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:45:06 user nova-compute[72849]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a (non-flash)
Aug 15 16:45:06 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa (non-flash)
Aug 15 16:45:06 user nova-compute[72849]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:45:06 user nova-compute[72849]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a (non-flash)
Aug 15 16:45:06 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3581a7010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba15f24-2945-4faa-97d5-7c137305b6c6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6be312-fa2d-4e92-a398-a5a5d68c4c67]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdcef0f-1014-4151-853e-e4559e8c1dab]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cee322-f84c-4597-a3b8-7facfd15cb48]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6768db19', '/dev/disk/by-id/scsi-23337373135363333', '/dev/disk/by-id/scsi-1SCST_BIO6768db19-3771563342c31323') {{(pid=84060) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1d97f1-df26-4277-a5a8-6683add5e8fc]: (4, None) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dbe060-0571-4fc6-9672-74f888eda6ce]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a2f66e-1fa8-4c12-8402-581b459e8e39]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa, portal: 172.16.0.220,3260]
Aug 15 16:45:06 user nova-compute[72849]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa, portal: 172.16.0.220,3260] successful.
Aug 15 16:45:06 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62e61cd-60dd-45c7-9d7e-d88958d749fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7258bd-d312-415e-a0c8-3502167ee433]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] <== disconnect_volume: return (286ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:45:06 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Deleting instance files /opt/stack/data/nova/instances/e229ced9-d1cf-4765-9ba7-b32cdf47960b_del
Aug 15 16:45:06 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Deletion of /opt/stack/data/nova/instances/e229ced9-d1cf-4765-9ba7-b32cdf47960b_del complete
Aug 15 16:45:06 user nova-compute[72849]: INFO nova.compute.manager [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 15 16:45:06 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:45:06 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:45:07 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:45:07 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Took 0.52 seconds to deallocate network for instance.
Aug 15 16:45:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-bfa3b7b6-c1fe-4c95-9435-5b70970e0c57 req-0f79ad0c-050e-4684-9aa6-545ae9220ecd service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Received event network-vif-deleted-88ff8111-9371-4da1-97ef-95f9ab035eac {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:45:07 user nova-compute[72849]: INFO nova.compute.manager [req-bfa3b7b6-c1fe-4c95-9435-5b70970e0c57 req-0f79ad0c-050e-4684-9aa6-545ae9220ecd service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Neutron deleted interface 88ff8111-9371-4da1-97ef-95f9ab035eac; detaching it from the instance and deleting it from the info cache
Aug 15 16:45:07 user nova-compute[72849]: DEBUG nova.network.neutron [req-bfa3b7b6-c1fe-4c95-9435-5b70970e0c57 req-0f79ad0c-050e-4684-9aa6-545ae9220ecd service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:45:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-bfa3b7b6-c1fe-4c95-9435-5b70970e0c57 req-0f79ad0c-050e-4684-9aa6-545ae9220ecd service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Detach interface failed, port_id=88ff8111-9371-4da1-97ef-95f9ab035eac, reason: Instance e229ced9-d1cf-4765-9ba7-b32cdf47960b could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:45:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-a5d8deb0-90d6-4fbb-be59-35170df1bd04 req-6334310b-0c81-48a1-9224-59414fbe0b6c service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Received event network-vif-plugged-88ff8111-9371-4da1-97ef-95f9ab035eac {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:45:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a5d8deb0-90d6-4fbb-be59-35170df1bd04 req-6334310b-0c81-48a1-9224-59414fbe0b6c service nova] Acquiring lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:45:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a5d8deb0-90d6-4fbb-be59-35170df1bd04 req-6334310b-0c81-48a1-9224-59414fbe0b6c service nova] Lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:45:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a5d8deb0-90d6-4fbb-be59-35170df1bd04 req-6334310b-0c81-48a1-9224-59414fbe0b6c service nova] Lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:45:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-a5d8deb0-90d6-4fbb-be59-35170df1bd04 req-6334310b-0c81-48a1-9224-59414fbe0b6c service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] No waiting events found dispatching network-vif-plugged-88ff8111-9371-4da1-97ef-95f9ab035eac {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:45:08 user nova-compute[72849]: WARNING nova.compute.manager [req-a5d8deb0-90d6-4fbb-be59-35170df1bd04 req-6334310b-0c81-48a1-9224-59414fbe0b6c service nova] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Received unexpected event network-vif-plugged-88ff8111-9371-4da1-97ef-95f9ab035eac for instance with vm_state active and task_state deleting.
Aug 15 16:45:08 user nova-compute[72849]: INFO nova.compute.manager [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Took 0.92 seconds to detach 1 volumes for instance.
Aug 15 16:45:08 user nova-compute[72849]: DEBUG nova.compute.manager [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Deleting volume: c62e61cd-60dd-45c7-9d7e-d88958d749fa {{(pid=72849) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 16:45:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:45:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:45:08 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:45:08 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:45:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:45:08 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Deleted allocations for instance e229ced9-d1cf-4765-9ba7-b32cdf47960b
Aug 15 16:45:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:45:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:45:08 user nova-compute[72849]: INFO nova.compute.manager [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Detaching volume 3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a
Aug 15 16:45:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-24960612-b63b-40a7-a35a-adbdaba4d281 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "e229ced9-d1cf-4765-9ba7-b32cdf47960b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.107s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:45:08 user nova-compute[72849]: INFO nova.virt.block_device [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Attempting to driver detach volume 3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a from mountpoint /dev/vdb
Aug 15 16:45:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Attempting to detach device vdb from instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:45:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:45:08 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:45:08 user nova-compute[72849]:   <source dev="/dev/sdd"/>
Aug 15 16:45:08 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:45:08 user nova-compute[72849]:   <serial>3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a</serial>
Aug 15 16:45:08 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:45:08 user nova-compute[72849]: </disk>
Aug 15 16:45:08 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:45:08 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Successfully detached device vdb from instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 from the persistent domain config.
Aug 15 16:45:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:45:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:45:08 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:45:08 user nova-compute[72849]:   <source dev="/dev/sdd"/>
Aug 15 16:45:08 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:45:08 user nova-compute[72849]:   <serial>3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a</serial>
Aug 15 16:45:08 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:45:08 user nova-compute[72849]: </disk>
Aug 15 16:45:08 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692117909.3527858, ff3d801d-ddc7-4f90-8cc8-a577d6482270 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:45:09 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Successfully detached device vdb from instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 from the live domain config.
Aug 15 16:45:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DnAiZCWz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:45:09 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:45:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8110d26-00c0-45e1-955a-215faf3238e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b3b380-7926-41cf-9490-2e8bff41953b]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:45:09 user nova-compute[72849]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a (non-flash)
Aug 15 16:45:09 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:45:09 user nova-compute[72849]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a (non-flash)
Aug 15 16:45:09 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3587e2710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a'): ({'sdd'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Removing single pathed devices sdd {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c129f88-6d91-47b1-b26c-5d1ca51fd220]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1ec452-0878-44f5-91ce-0429ee5ccd02]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Flushing IO for device /dev/sdd {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47e5acd-d2fa-4aac-a5ec-9486d1aedebc]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11f0023-cb26-4108-8683-2209fcb27775]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] SCSI volumes sdd have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e622fe-5a93-462e-8345-64a422801783]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[045dd178-bd29-4d8a-84d0-6996c9ad75cb]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a, portal: 172.16.0.220,3260]
Aug 15 16:45:09 user nova-compute[72849]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a, portal: 172.16.0.220,3260] successful.
Aug 15 16:45:09 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b6f1d02-3f3d-4acb-b1db-e2ffb7e9bf7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ced91a7-dfad-4387-a834-37913a1f666e]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] <== disconnect_volume: return (311ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:45:09 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:45:10 user nova-compute[72849]: DEBUG nova.objects.instance [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lazy-loading 'flavor' on Instance uuid ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:45:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-f504b706-54b0-4f5f-ae92-61c6aaa701e0 tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.747s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:45:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:21 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117906.423989, e229ced9-d1cf-4765-9ba7-b32cdf47960b => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:45:21 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] VM Stopped (Lifecycle Event)
Aug 15 16:45:21 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c07a9ec2-39ff-4512-b2f0-444a4fe7d744 None None] [instance: e229ced9-d1cf-4765-9ba7-b32cdf47960b] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:45:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:45:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquiring lock "52ec78db-a731-4a31-b9f1-2214c7bb9007" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:45:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "52ec78db-a731-4a31-b9f1-2214c7bb9007" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:45:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:45:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:45:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:45:24 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:45:24 user nova-compute[72849]: INFO nova.compute.claims [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Claim successful on node user
Aug 15 16:45:25 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG nova.compute.manager [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG nova.compute.manager [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG nova.network.neutron [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:45:25 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:45:25 user nova-compute[72849]: DEBUG nova.compute.manager [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG nova.policy [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '058da58bd1924ef78c9228777f898a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a6bda829b4429b87c54780795763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG nova.compute.manager [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:45:25 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Creating image(s)
Aug 15 16:45:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquiring lock "/opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "/opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "/opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.172s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.175s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/disk 1073741824" returned: 0 in 0.049s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG nova.network.neutron [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Successfully created port: 91f2be4e-53e6-4330-9ac0-359a255f2f12 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 16:45:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:26 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Cannot resize image /opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 16:45:26 user nova-compute[72849]: DEBUG nova.objects.instance [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lazy-loading 'migration_context' on Instance uuid 52ec78db-a731-4a31-b9f1-2214c7bb9007 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:45:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 16:45:26 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Ensure instance console log exists: /opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:45:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:45:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:45:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:45:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:45:26 user nova-compute[72849]: DEBUG nova.network.neutron [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Successfully updated port: 91f2be4e-53e6-4330-9ac0-359a255f2f12 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:45:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquiring lock "refresh_cache-52ec78db-a731-4a31-b9f1-2214c7bb9007" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:45:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquired lock "refresh_cache-52ec78db-a731-4a31-b9f1-2214c7bb9007" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:45:26 user nova-compute[72849]: DEBUG nova.network.neutron [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:45:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-11160868-07de-4a49-8dc7-0f399c51a9cf req-52541625-ab94-45bc-856e-02901c3dfd43 service nova] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Received event network-changed-91f2be4e-53e6-4330-9ac0-359a255f2f12 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:45:26 user nova-compute[72849]: DEBUG nova.compute.manager [req-11160868-07de-4a49-8dc7-0f399c51a9cf req-52541625-ab94-45bc-856e-02901c3dfd43 service nova] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Refreshing instance network info cache due to event network-changed-91f2be4e-53e6-4330-9ac0-359a255f2f12. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:45:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-11160868-07de-4a49-8dc7-0f399c51a9cf req-52541625-ab94-45bc-856e-02901c3dfd43 service nova] Acquiring lock "refresh_cache-52ec78db-a731-4a31-b9f1-2214c7bb9007" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.network.neutron [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.network.neutron [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Updating instance_info_cache with network_info: [{"id": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "address": "fa:16:3e:bc:d0:1e", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f2be4e-53", "ovs_interfaceid": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Releasing lock "refresh_cache-52ec78db-a731-4a31-b9f1-2214c7bb9007" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.compute.manager [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Instance network_info: |[{"id": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "address": "fa:16:3e:bc:d0:1e", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f2be4e-53", "ovs_interfaceid": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-11160868-07de-4a49-8dc7-0f399c51a9cf req-52541625-ab94-45bc-856e-02901c3dfd43 service nova] Acquired lock "refresh_cache-52ec78db-a731-4a31-b9f1-2214c7bb9007" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.network.neutron [req-11160868-07de-4a49-8dc7-0f399c51a9cf req-52541625-ab94-45bc-856e-02901c3dfd43 service nova] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Refreshing network info cache for port 91f2be4e-53e6-4330-9ac0-359a255f2f12 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Start _get_guest_xml network_info=[{"id": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "address": "fa:16:3e:bc:d0:1e", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f2be4e-53", "ovs_interfaceid": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:45:27 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:45:27 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-858682925',display_name='tempest-VolumesActionsTest-instance-858682925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-858682925',id=47,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48a6bda829b4429b87c54780795763e1',ramdisk_id='',reservation_id='r-9tbqw4mr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1889056072',owner_user_name='tempest-VolumesActionsTest-1889056072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:45:25Z,user_data=None,user_id='058da58bd1924ef78c9228777f898a5d',uuid=52ec78db-a731-4a31-b9f1-2214c7bb9007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "address": "fa:16:3e:bc:d0:1e", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f2be4e-53", "ovs_interfaceid": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Converting VIF {"id": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "address": "fa:16:3e:bc:d0:1e", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f2be4e-53", "ovs_interfaceid": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d0:1e,bridge_name='br-int',has_traffic_filtering=True,id=91f2be4e-53e6-4330-9ac0-359a255f2f12,network=Network(f410fe9a-3118-492b-99d1-e54500294d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f2be4e-53') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.objects.instance [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lazy-loading 'pci_devices' on Instance uuid 52ec78db-a731-4a31-b9f1-2214c7bb9007 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:45:27 user nova-compute[72849]:   <uuid>52ec78db-a731-4a31-b9f1-2214c7bb9007</uuid>
Aug 15 16:45:27 user nova-compute[72849]:   <name>instance-0000002f</name>
Aug 15 16:45:27 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:45:27 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:45:27 user nova-compute[72849]:   <metadata>
Aug 15 16:45:27 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:45:27 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:45:27 user nova-compute[72849]:       <nova:name>tempest-VolumesActionsTest-instance-858682925</nova:name>
Aug 15 16:45:27 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:45:27</nova:creationTime>
Aug 15 16:45:27 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:45:27 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:45:27 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:45:27 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:45:27 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:45:27 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:45:27 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:45:27 user nova-compute[72849]:       <nova:owner>
Aug 15 16:45:27 user nova-compute[72849]:         <nova:user uuid="058da58bd1924ef78c9228777f898a5d">tempest-VolumesActionsTest-1889056072-project-member</nova:user>
Aug 15 16:45:27 user nova-compute[72849]:         <nova:project uuid="48a6bda829b4429b87c54780795763e1">tempest-VolumesActionsTest-1889056072</nova:project>
Aug 15 16:45:27 user nova-compute[72849]:       </nova:owner>
Aug 15 16:45:27 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 16:45:27 user nova-compute[72849]:       <nova:ports>
Aug 15 16:45:27 user nova-compute[72849]:         <nova:port uuid="91f2be4e-53e6-4330-9ac0-359a255f2f12">
Aug 15 16:45:27 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 16:45:27 user nova-compute[72849]:         </nova:port>
Aug 15 16:45:27 user nova-compute[72849]:       </nova:ports>
Aug 15 16:45:27 user nova-compute[72849]:     </nova:instance>
Aug 15 16:45:27 user nova-compute[72849]:   </metadata>
Aug 15 16:45:27 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:45:27 user nova-compute[72849]:     <system>
Aug 15 16:45:27 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:45:27 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:45:27 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:45:27 user nova-compute[72849]:       <entry name="serial">52ec78db-a731-4a31-b9f1-2214c7bb9007</entry>
Aug 15 16:45:27 user nova-compute[72849]:       <entry name="uuid">52ec78db-a731-4a31-b9f1-2214c7bb9007</entry>
Aug 15 16:45:27 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:45:27 user nova-compute[72849]:     </system>
Aug 15 16:45:27 user nova-compute[72849]:   </sysinfo>
Aug 15 16:45:27 user nova-compute[72849]:   <os>
Aug 15 16:45:27 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:45:27 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:45:27 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:45:27 user nova-compute[72849]:   </os>
Aug 15 16:45:27 user nova-compute[72849]:   <features>
Aug 15 16:45:27 user nova-compute[72849]:     <acpi/>
Aug 15 16:45:27 user nova-compute[72849]:     <apic/>
Aug 15 16:45:27 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:45:27 user nova-compute[72849]:   </features>
Aug 15 16:45:27 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:45:27 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:45:27 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:45:27 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:45:27 user nova-compute[72849]:   </clock>
Aug 15 16:45:27 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:45:27 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:45:27 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:45:27 user nova-compute[72849]:   </cpu>
Aug 15 16:45:27 user nova-compute[72849]:   <devices>
Aug 15 16:45:27 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 16:45:27 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 16:45:27 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/disk"/>
Aug 15 16:45:27 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:45:27 user nova-compute[72849]:     </disk>
Aug 15 16:45:27 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:45:27 user nova-compute[72849]:       <mac address="fa:16:3e:bc:d0:1e"/>
Aug 15 16:45:27 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:45:27 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:45:27 user nova-compute[72849]:       <target dev="tap91f2be4e-53"/>
Aug 15 16:45:27 user nova-compute[72849]:     </interface>
Aug 15 16:45:27 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:45:27 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/console.log" append="off"/>
Aug 15 16:45:27 user nova-compute[72849]:     </serial>
Aug 15 16:45:27 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:45:27 user nova-compute[72849]:     <video>
Aug 15 16:45:27 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:45:27 user nova-compute[72849]:     </video>
Aug 15 16:45:27 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:45:27 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:45:27 user nova-compute[72849]:     </rng>
Aug 15 16:45:27 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:45:27 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:45:27 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:45:27 user nova-compute[72849]:     </memballoon>
Aug 15 16:45:27 user nova-compute[72849]:   </devices>
Aug 15 16:45:27 user nova-compute[72849]: </domain>
Aug 15 16:45:27 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-858682925',display_name='tempest-VolumesActionsTest-instance-858682925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-858682925',id=47,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48a6bda829b4429b87c54780795763e1',ramdisk_id='',reservation_id='r-9tbqw4mr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1889056072',owner_user_name='tempest-VolumesActionsTest-1889056072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:45:25Z,user_data=None,user_id='058da58bd1924ef78c9228777f898a5d',uuid=52ec78db-a731-4a31-b9f1-2214c7bb9007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "address": "fa:16:3e:bc:d0:1e", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f2be4e-53", "ovs_interfaceid": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Converting VIF {"id": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "address": "fa:16:3e:bc:d0:1e", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f2be4e-53", "ovs_interfaceid": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d0:1e,bridge_name='br-int',has_traffic_filtering=True,id=91f2be4e-53e6-4330-9ac0-359a255f2f12,network=Network(f410fe9a-3118-492b-99d1-e54500294d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f2be4e-53') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG os_vif [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d0:1e,bridge_name='br-int',has_traffic_filtering=True,id=91f2be4e-53e6-4330-9ac0-359a255f2f12,network=Network(f410fe9a-3118-492b-99d1-e54500294d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f2be4e-53') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91f2be4e-53, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91f2be4e-53, col_values=(('external_ids', {'iface-id': '91f2be4e-53e6-4330-9ac0-359a255f2f12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:d0:1e', 'vm-uuid': '52ec78db-a731-4a31-b9f1-2214c7bb9007'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:27 user nova-compute[72849]: INFO os_vif [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d0:1e,bridge_name='br-int',has_traffic_filtering=True,id=91f2be4e-53e6-4330-9ac0-359a255f2f12,network=Network(f410fe9a-3118-492b-99d1-e54500294d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f2be4e-53')
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] No VIF found with MAC fa:16:3e:bc:d0:1e, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.network.neutron [req-11160868-07de-4a49-8dc7-0f399c51a9cf req-52541625-ab94-45bc-856e-02901c3dfd43 service nova] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Updated VIF entry in instance network info cache for port 91f2be4e-53e6-4330-9ac0-359a255f2f12. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG nova.network.neutron [req-11160868-07de-4a49-8dc7-0f399c51a9cf req-52541625-ab94-45bc-856e-02901c3dfd43 service nova] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Updating instance_info_cache with network_info: [{"id": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "address": "fa:16:3e:bc:d0:1e", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f2be4e-53", "ovs_interfaceid": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:45:27 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-11160868-07de-4a49-8dc7-0f399c51a9cf req-52541625-ab94-45bc-856e-02901c3dfd43 service nova] Releasing lock "refresh_cache-52ec78db-a731-4a31-b9f1-2214c7bb9007" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:45:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:28 user nova-compute[72849]: DEBUG nova.compute.manager [req-31c14d38-9403-45bc-869a-51ca084805b5 req-b1f13106-7c52-4f6a-a232-0fb8c4749ff6 service nova] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Received event network-vif-plugged-91f2be4e-53e6-4330-9ac0-359a255f2f12 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:45:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-31c14d38-9403-45bc-869a-51ca084805b5 req-b1f13106-7c52-4f6a-a232-0fb8c4749ff6 service nova] Acquiring lock "52ec78db-a731-4a31-b9f1-2214c7bb9007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:45:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-31c14d38-9403-45bc-869a-51ca084805b5 req-b1f13106-7c52-4f6a-a232-0fb8c4749ff6 service nova] Lock "52ec78db-a731-4a31-b9f1-2214c7bb9007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:45:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-31c14d38-9403-45bc-869a-51ca084805b5 req-b1f13106-7c52-4f6a-a232-0fb8c4749ff6 service nova] Lock "52ec78db-a731-4a31-b9f1-2214c7bb9007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:45:28 user nova-compute[72849]: DEBUG nova.compute.manager [req-31c14d38-9403-45bc-869a-51ca084805b5 req-b1f13106-7c52-4f6a-a232-0fb8c4749ff6 service nova] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] No waiting events found dispatching network-vif-plugged-91f2be4e-53e6-4330-9ac0-359a255f2f12 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:45:28 user nova-compute[72849]: WARNING nova.compute.manager [req-31c14d38-9403-45bc-869a-51ca084805b5 req-b1f13106-7c52-4f6a-a232-0fb8c4749ff6 service nova] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Received unexpected event network-vif-plugged-91f2be4e-53e6-4330-9ac0-359a255f2f12 for instance with vm_state building and task_state spawning.
Aug 15 16:45:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:30 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117930.8160644, 52ec78db-a731-4a31-b9f1-2214c7bb9007 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:45:30 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] VM Resumed (Lifecycle Event)
Aug 15 16:45:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:45:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:45:30 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Instance spawned successfully.
Aug 15 16:45:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:45:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:45:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:45:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:45:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:45:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:45:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:45:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:45:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:45:30 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:45:30 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692117930.8174624, 52ec78db-a731-4a31-b9f1-2214c7bb9007 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:45:30 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] VM Started (Lifecycle Event)
Aug 15 16:45:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:45:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:45:30 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:45:30 user nova-compute[72849]: INFO nova.compute.manager [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Took 5.64 seconds to spawn the instance on the hypervisor.
Aug 15 16:45:30 user nova-compute[72849]: DEBUG nova.compute.manager [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:45:31 user nova-compute[72849]: INFO nova.compute.manager [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Took 6.19 seconds to build instance.
Aug 15 16:45:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-53b9b313-c96e-4935-b617-83ccef4d38f1 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "52ec78db-a731-4a31-b9f1-2214c7bb9007" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.287s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:45:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-1e5f243d-1231-4cdb-bab2-340addab4226 req-150ed01c-0f7e-425a-b13f-6404cd179a78 service nova] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Received event network-vif-plugged-91f2be4e-53e6-4330-9ac0-359a255f2f12 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:45:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1e5f243d-1231-4cdb-bab2-340addab4226 req-150ed01c-0f7e-425a-b13f-6404cd179a78 service nova] Acquiring lock "52ec78db-a731-4a31-b9f1-2214c7bb9007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:45:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1e5f243d-1231-4cdb-bab2-340addab4226 req-150ed01c-0f7e-425a-b13f-6404cd179a78 service nova] Lock "52ec78db-a731-4a31-b9f1-2214c7bb9007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:45:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1e5f243d-1231-4cdb-bab2-340addab4226 req-150ed01c-0f7e-425a-b13f-6404cd179a78 service nova] Lock "52ec78db-a731-4a31-b9f1-2214c7bb9007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:45:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-1e5f243d-1231-4cdb-bab2-340addab4226 req-150ed01c-0f7e-425a-b13f-6404cd179a78 service nova] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] No waiting events found dispatching network-vif-plugged-91f2be4e-53e6-4330-9ac0-359a255f2f12 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:45:31 user nova-compute[72849]: WARNING nova.compute.manager [req-1e5f243d-1231-4cdb-bab2-340addab4226 req-150ed01c-0f7e-425a-b13f-6404cd179a78 service nova] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Received unexpected event network-vif-plugged-91f2be4e-53e6-4330-9ac0-359a255f2f12 for instance with vm_state active and task_state None.
Aug 15 16:45:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:43 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:45:43 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:45:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:45:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:45:43 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:45:43 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Updating instance_info_cache with network_info: [{"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:45:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:45:43 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:45:43 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:45:44 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:45:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:47 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:45:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:48 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:45:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:45:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:45:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:45:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:45:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:45:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:49 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:45:50 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:45:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8211MB free_disk=25.172740936279297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:45:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:45:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:45:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:45:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 85da743e-e2c7-42c1-8621-f9942e115b01 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:45:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 7722de29-482a-4f75-a3ed-d4293fdd9db8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:45:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 52ec78db-a731-4a31-b9f1-2214c7bb9007 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:45:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:45:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:45:50 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:45:50 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:45:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:45:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:45:51 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:45:51 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:45:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:45:52 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:45:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-2f994218-acdc-4884-9292-800ee1e9fd20 req-ade0afb3-c4e9-4355-99e2-bf1d05dd9c08 service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Received event network-changed-dbf46f11-8d35-4234-8748-d198b36de354 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:45:53 user nova-compute[72849]: DEBUG nova.compute.manager [req-2f994218-acdc-4884-9292-800ee1e9fd20 req-ade0afb3-c4e9-4355-99e2-bf1d05dd9c08 service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Refreshing instance network info cache due to event network-changed-dbf46f11-8d35-4234-8748-d198b36de354. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:45:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2f994218-acdc-4884-9292-800ee1e9fd20 req-ade0afb3-c4e9-4355-99e2-bf1d05dd9c08 service nova] Acquiring lock "refresh_cache-85da743e-e2c7-42c1-8621-f9942e115b01" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:45:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2f994218-acdc-4884-9292-800ee1e9fd20 req-ade0afb3-c4e9-4355-99e2-bf1d05dd9c08 service nova] Acquired lock "refresh_cache-85da743e-e2c7-42c1-8621-f9942e115b01" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:45:53 user nova-compute[72849]: DEBUG nova.network.neutron [req-2f994218-acdc-4884-9292-800ee1e9fd20 req-ade0afb3-c4e9-4355-99e2-bf1d05dd9c08 service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Refreshing network info cache for port dbf46f11-8d35-4234-8748-d198b36de354 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:45:53 user nova-compute[72849]: DEBUG nova.network.neutron [req-2f994218-acdc-4884-9292-800ee1e9fd20 req-ade0afb3-c4e9-4355-99e2-bf1d05dd9c08 service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Updated VIF entry in instance network info cache for port dbf46f11-8d35-4234-8748-d198b36de354. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:45:53 user nova-compute[72849]: DEBUG nova.network.neutron [req-2f994218-acdc-4884-9292-800ee1e9fd20 req-ade0afb3-c4e9-4355-99e2-bf1d05dd9c08 service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Updating instance_info_cache with network_info: [{"id": "dbf46f11-8d35-4234-8748-d198b36de354", "address": "fa:16:3e:31:70:b3", "network": {"id": "a1da2ef5-bf52-472d-af07-d81b9cf8a5e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-544176784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2debda1cc8ff470b9c83ea54eb8ed955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf46f11-8d", "ovs_interfaceid": "dbf46f11-8d35-4234-8748-d198b36de354", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:45:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2f994218-acdc-4884-9292-800ee1e9fd20 req-ade0afb3-c4e9-4355-99e2-bf1d05dd9c08 service nova] Releasing lock "refresh_cache-85da743e-e2c7-42c1-8621-f9942e115b01" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:45:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "85da743e-e2c7-42c1-8621-f9942e115b01" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:45:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "85da743e-e2c7-42c1-8621-f9942e115b01" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:45:53 user nova-compute[72849]: DEBUG nova.objects.instance [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lazy-loading 'flavor' on Instance uuid 85da743e-e2c7-42c1-8621-f9942e115b01 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:45:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "85da743e-e2c7-42c1-8621-f9942e115b01" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:45:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "85da743e-e2c7-42c1-8621-f9942e115b01" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:45:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "85da743e-e2c7-42c1-8621-f9942e115b01" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:45:53 user nova-compute[72849]: INFO nova.compute.manager [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Attaching volume 55e28ced-5252-419e-9758-25630aa35ae4 to /dev/vdb
Aug 15 16:45:54 user nova-compute[72849]: DEBUG os_brick.utils [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d434e9-3f17-4a53-b276-6213c9969e3f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11d8002-2838-403a-bd13-515aad4a3741]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3dd2fd-7884-41e0-979a-ccedfec5c915]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06ee01b-afdc-409c-a217-74c9541ab264]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:45:54 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:45:54 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5777e2a3-cd28-42ea-9d85-a0123aa419bd]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG os_brick.utils [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Updating existing volume attachment record: e5434770-100b-483e-ac7f-94ffe86fcbae {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:45:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:45:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BCuUraJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:46:03 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:46:03 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:46:03 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc760b41-1001-4eaa-b53b-fb4190427cdc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:46:03 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaadb7b-0d12-4ea4-9517-6314c2113f90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4] added
Aug 15 16:46:03 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18733e4-4e58-486d-8fb7-9f7a55127a6f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e48dc3-8666-4c34-89d5-53abd6f5fafd]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BCuUraJO {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BCuUraJO" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[695aedc0-321a-4f29-a1c0-27d6820d9bdd]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BCuUraJO'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ed366d-74a6-4504-95cd-1a41eb853bfb]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f253de-8ffc-4151-bcf4-0ea1a02d5330]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:46:03 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:46:03 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[36814c4e-4576-496c-9a1b-1f1772e11e54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4, portal: 172.16.0.220,3260]
Aug 15 16:46:03 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4, portal: 172.16.0.220,3260] successful.
Aug 15 16:46:03 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b3efe1-185c-45a6-ad74-74b09e702e96]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f85458a-f7f1-438a-ae7e-126166c23fd3]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:46:03 user nova-compute[72849]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)
Aug 15 16:46:03 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:46:03 user nova-compute[72849]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)
Aug 15 16:46:03 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d89912-393f-4645-b3b7-57b0b3ab70ea]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:46:03 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BCuUraJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:46:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:46:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26536343361336531', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:46:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536343361336531', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:46:04 user nova-compute[72849]: DEBUG nova.objects.instance [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lazy-loading 'flavor' on Instance uuid 85da743e-e2c7-42c1-8621-f9942e115b01 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:46:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:46:04 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:46:04 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:46:04 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:46:04 user nova-compute[72849]:   <serial>55e28ced-5252-419e-9758-25630aa35ae4</serial>
Aug 15 16:46:04 user nova-compute[72849]: </disk>
Aug 15 16:46:04 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:46:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:46:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:46:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] No VIF found with MAC fa:16:3e:31:70:b3, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:46:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-077f98ef-c3cf-49a5-856b-2302170b79ff tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "85da743e-e2c7-42c1-8621-f9942e115b01" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.092s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "85da743e-e2c7-42c1-8621-f9942e115b01" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "85da743e-e2c7-42c1-8621-f9942e115b01" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.005s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lazy-loading 'flavor' on Instance uuid 85da743e-e2c7-42c1-8621-f9942e115b01 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "85da743e-e2c7-42c1-8621-f9942e115b01" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "85da743e-e2c7-42c1-8621-f9942e115b01" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "85da743e-e2c7-42c1-8621-f9942e115b01" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:08 user nova-compute[72849]: INFO nova.compute.manager [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Attaching volume 35eac035-c425-4208-98bd-ebe763ff9571 to /dev/vdc
Aug 15 16:46:08 user nova-compute[72849]: DEBUG os_brick.utils [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb9133d-8251-4457-88e5-252d0b99f1de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[76318d2a-2335-4194-8abd-26b729bd1819]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[025fa91e-77cb-41ae-983a-89e9e6a02feb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc4a329-3d46-4277-a124-7f74049bb3ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:46:08 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:46:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[946a059a-9723-40b7-b08b-987e95cdce9b]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG os_brick.utils [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:46:08 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Updating existing volume attachment record: 7ca824da-cd6d-4e6f-ab08-9222f10be773 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:46:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-85a2461f-8e73-4108-b151-c489fc50bddc req-5762a8b5-138f-441c-b772-85ce23a170c1 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received event network-changed-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:46:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-85a2461f-8e73-4108-b151-c489fc50bddc req-5762a8b5-138f-441c-b772-85ce23a170c1 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Refreshing instance network info cache due to event network-changed-4bb47a58-9f72-4291-9270-b5a0a988725c. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:46:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-85a2461f-8e73-4108-b151-c489fc50bddc req-5762a8b5-138f-441c-b772-85ce23a170c1 service nova] Acquiring lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:46:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-85a2461f-8e73-4108-b151-c489fc50bddc req-5762a8b5-138f-441c-b772-85ce23a170c1 service nova] Acquired lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:46:21 user nova-compute[72849]: DEBUG nova.network.neutron [req-85a2461f-8e73-4108-b151-c489fc50bddc req-5762a8b5-138f-441c-b772-85ce23a170c1 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Refreshing network info cache for port 4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:46:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "7722de29-482a-4f75-a3ed-d4293fdd9db8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:21 user nova-compute[72849]: INFO nova.compute.manager [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Terminating instance
Aug 15 16:46:21 user nova-compute[72849]: DEBUG nova.compute.manager [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:46:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-1d9b4275-a74e-4768-87df-9aad6adbb606 req-079e218e-81aa-4e30-bfdc-9c69ce003257 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received event network-vif-unplugged-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1d9b4275-a74e-4768-87df-9aad6adbb606 req-079e218e-81aa-4e30-bfdc-9c69ce003257 service nova] Acquiring lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1d9b4275-a74e-4768-87df-9aad6adbb606 req-079e218e-81aa-4e30-bfdc-9c69ce003257 service nova] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1d9b4275-a74e-4768-87df-9aad6adbb606 req-079e218e-81aa-4e30-bfdc-9c69ce003257 service nova] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-1d9b4275-a74e-4768-87df-9aad6adbb606 req-079e218e-81aa-4e30-bfdc-9c69ce003257 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] No waiting events found dispatching network-vif-unplugged-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG nova.compute.manager [req-1d9b4275-a74e-4768-87df-9aad6adbb606 req-079e218e-81aa-4e30-bfdc-9c69ce003257 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received event network-vif-unplugged-4bb47a58-9f72-4291-9270-b5a0a988725c for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG nova.network.neutron [req-85a2461f-8e73-4108-b151-c489fc50bddc req-5762a8b5-138f-441c-b772-85ce23a170c1 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Updated VIF entry in instance network info cache for port 4bb47a58-9f72-4291-9270-b5a0a988725c. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG nova.network.neutron [req-85a2461f-8e73-4108-b151-c489fc50bddc req-5762a8b5-138f-441c-b772-85ce23a170c1 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Updating instance_info_cache with network_info: [{"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-85a2461f-8e73-4108-b151-c489fc50bddc req-5762a8b5-138f-441c-b772-85ce23a170c1 service nova] Releasing lock "refresh_cache-7722de29-482a-4f75-a3ed-d4293fdd9db8" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:46:22 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Instance destroyed successfully.
Aug 15 16:46:22 user nova-compute[72849]: DEBUG nova.objects.instance [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lazy-loading 'resources' on Instance uuid 7722de29-482a-4f75-a3ed-d4293fdd9db8 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T16:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-648703954',display_name='tempest-TestShelveInstance-server-648703954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-648703954',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1+HLabUqq6zIPMWDL04qSO39/IVnfVMHlk8RRaC4xTbnCxgJV/Rgr0HlZCGRDxgqa2CuyuCcrgUfpLO68W7/a/HLUfrrhWm6+Zr9c4OK9ZRJUQchNl3AuGahuKsjTUww==',key_name='tempest-TestShelveInstance-1445995414',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:44:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a35bb132e2cc4dfc99e383862ce86829',ramdisk_id='',reservation_id='r-2h2pgqco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-628082297',owner_user_name='tempest-TestShelveInstance-628082297-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:44:46Z,user_data=None,user_id='ae3d508464a14dad9113a56fac6f0f32',uuid=7722de29-482a-4f75-a3ed-d4293fdd9db8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Converting VIF {"id": "4bb47a58-9f72-4291-9270-b5a0a988725c", "address": "fa:16:3e:83:2e:30", "network": {"id": "1d8f6acf-691c-4a97-a585-dd9fc43a7b32", "bridge": "br-int", "label": "tempest-TestShelveInstance-292682644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a35bb132e2cc4dfc99e383862ce86829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb47a58-9f", "ovs_interfaceid": "4bb47a58-9f72-4291-9270-b5a0a988725c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=4bb47a58-9f72-4291-9270-b5a0a988725c,network=Network(1d8f6acf-691c-4a97-a585-dd9fc43a7b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb47a58-9f') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_vif [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=4bb47a58-9f72-4291-9270-b5a0a988725c,network=Network(1d8f6acf-691c-4a97-a585-dd9fc43a7b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb47a58-9f') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bb47a58-9f, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:46:22 user nova-compute[72849]: INFO os_vif [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=4bb47a58-9f72-4291-9270-b5a0a988725c,network=Network(1d8f6acf-691c-4a97-a585-dd9fc43a7b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb47a58-9f')
Aug 15 16:46:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRkmTJKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:46:22 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5f92b0-479d-47e7-adf1-9b51805be5d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dd74a3-9168-44a1-95cc-ea58a5496380]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:46:22 user nova-compute[72849]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)
Aug 15 16:46:22 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 (non-flash)
Aug 15 16:46:22 user nova-compute[72849]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)
Aug 15 16:46:22 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3582a3b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1'): ({'sdc'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Removing single pathed devices sdc {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[216dfaaf-7a82-4b0e-a823-ac8be58fe3ac]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca41eb34-6e2e-4fab-8bbb-e44494b37780]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Flushing IO for device /dev/sdc {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b618beb1-bb5a-4ca2-8dc9-56731671f021]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[45be5538-211b-48d7-a9ea-35c506fb6890]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fee7f2a-30aa-4206-916c-7aded9679509]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c09190-64cb-4fa4-81aa-5a99c9411b45]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1, portal: 172.16.0.220,3260]
Aug 15 16:46:22 user nova-compute[72849]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1, portal: 172.16.0.220,3260] successful.
Aug 15 16:46:22 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea85e2c-f0d1-47ab-819b-736df16b67d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9bef73-ec7d-404b-810c-3d4ec0fd87ef]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] <== disconnect_volume: return (323ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:46:22 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Deleting instance files /opt/stack/data/nova/instances/7722de29-482a-4f75-a3ed-d4293fdd9db8_del
Aug 15 16:46:22 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Deletion of /opt/stack/data/nova/instances/7722de29-482a-4f75-a3ed-d4293fdd9db8_del complete
Aug 15 16:46:22 user nova-compute[72849]: INFO nova.compute.manager [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 15 16:46:22 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:46:22 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:46:23 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:46:23 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Took 0.57 seconds to deallocate network for instance.
Aug 15 16:46:24 user nova-compute[72849]: INFO nova.compute.manager [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Took 0.79 seconds to detach 1 volumes for instance.
Aug 15 16:46:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Deleting volume: bea85e2c-f0d1-47ab-819b-736df16b67d1 {{(pid=72849) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 16:46:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-8acdfd36-5ca4-442e-ba38-5d87cc215012 req-90200856-2635-4d9b-958d-d49b86b30372 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received event network-vif-plugged-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:46:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8acdfd36-5ca4-442e-ba38-5d87cc215012 req-90200856-2635-4d9b-958d-d49b86b30372 service nova] Acquiring lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8acdfd36-5ca4-442e-ba38-5d87cc215012 req-90200856-2635-4d9b-958d-d49b86b30372 service nova] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-8acdfd36-5ca4-442e-ba38-5d87cc215012 req-90200856-2635-4d9b-958d-d49b86b30372 service nova] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-8acdfd36-5ca4-442e-ba38-5d87cc215012 req-90200856-2635-4d9b-958d-d49b86b30372 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] No waiting events found dispatching network-vif-plugged-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:46:24 user nova-compute[72849]: WARNING nova.compute.manager [req-8acdfd36-5ca4-442e-ba38-5d87cc215012 req-90200856-2635-4d9b-958d-d49b86b30372 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received unexpected event network-vif-plugged-4bb47a58-9f72-4291-9270-b5a0a988725c for instance with vm_state deleted and task_state None.
Aug 15 16:46:24 user nova-compute[72849]: DEBUG nova.compute.manager [req-8acdfd36-5ca4-442e-ba38-5d87cc215012 req-90200856-2635-4d9b-958d-d49b86b30372 service nova] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Received event network-vif-deleted-4bb47a58-9f72-4291-9270-b5a0a988725c {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:46:24 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:46:24 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:46:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:24 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Deleted allocations for instance 7722de29-482a-4f75-a3ed-d4293fdd9db8
Aug 15 16:46:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-8a6ae67a-c420-4760-8259-8b598739c880 tempest-TestShelveInstance-628082297 tempest-TestShelveInstance-628082297-project-member] Lock "7722de29-482a-4f75-a3ed-d4293fdd9db8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.043s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "d565ed95-6f62-4948-a1da-7131ec7e799b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "d565ed95-6f62-4948-a1da-7131ec7e799b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:46:26 user nova-compute[72849]: INFO nova.compute.claims [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Claim successful on node user
Aug 15 16:46:26 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG nova.network.neutron [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:46:26 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:46:26 user nova-compute[72849]: DEBUG nova.compute.manager [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:46:26 user nova-compute[72849]: INFO nova.virt.block_device [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Booting with volume d4e5c524-70fb-48a2-bae9-fa9b81f760bc at /dev/vda
Aug 15 16:46:26 user nova-compute[72849]: DEBUG nova.policy [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe3f48f280e54c2099e6b1db842db2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87edcbec784a4f65b99740f34ff121bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG os_brick.utils [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc538656-15fd-43d0-a516-ca69ee6ef067]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[065050e1-9e10-41d6-8e00-ac167bdeb8b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1249073a-5e99-4565-949b-6530ca80bec6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b69b69a-60f5-46d4-968c-97891604b26b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:46:26 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:46:26 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca30d398-4090-46ce-842b-1584f9433e9e]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG os_brick.utils [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:46:26 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Updating existing volume attachment record: 58132af3-fd05-4443-afb6-fb196d667969 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:46:27 user nova-compute[72849]: DEBUG nova.network.neutron [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Successfully created port: 226ec889-a303-45bf-93ea-14bf6d11a1f6 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:46:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:28 user nova-compute[72849]: DEBUG nova.network.neutron [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Successfully updated port: 226ec889-a303-45bf-93ea-14bf6d11a1f6 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:46:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "refresh_cache-d565ed95-6f62-4948-a1da-7131ec7e799b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:46:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquired lock "refresh_cache-d565ed95-6f62-4948-a1da-7131ec7e799b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:46:28 user nova-compute[72849]: DEBUG nova.network.neutron [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:46:28 user nova-compute[72849]: DEBUG nova.compute.manager [req-b54ed691-d524-44ad-9d39-2bca34930927 req-003ef56e-1464-48d8-8a9e-7e4959d11500 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Received event network-changed-226ec889-a303-45bf-93ea-14bf6d11a1f6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:46:28 user nova-compute[72849]: DEBUG nova.compute.manager [req-b54ed691-d524-44ad-9d39-2bca34930927 req-003ef56e-1464-48d8-8a9e-7e4959d11500 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Refreshing instance network info cache due to event network-changed-226ec889-a303-45bf-93ea-14bf6d11a1f6. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:46:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b54ed691-d524-44ad-9d39-2bca34930927 req-003ef56e-1464-48d8-8a9e-7e4959d11500 service nova] Acquiring lock "refresh_cache-d565ed95-6f62-4948-a1da-7131ec7e799b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:46:28 user nova-compute[72849]: DEBUG nova.network.neutron [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:46:28 user nova-compute[72849]: DEBUG nova.network.neutron [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Updating instance_info_cache with network_info: [{"id": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "address": "fa:16:3e:5c:59:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ec889-a3", "ovs_interfaceid": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:46:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Releasing lock "refresh_cache-d565ed95-6f62-4948-a1da-7131ec7e799b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:46:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Instance network_info: |[{"id": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "address": "fa:16:3e:5c:59:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ec889-a3", "ovs_interfaceid": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:46:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b54ed691-d524-44ad-9d39-2bca34930927 req-003ef56e-1464-48d8-8a9e-7e4959d11500 service nova] Acquired lock "refresh_cache-d565ed95-6f62-4948-a1da-7131ec7e799b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:46:28 user nova-compute[72849]: DEBUG nova.network.neutron [req-b54ed691-d524-44ad-9d39-2bca34930927 req-003ef56e-1464-48d8-8a9e-7e4959d11500 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Refreshing network info cache for port 226ec889-a303-45bf-93ea-14bf6d11a1f6 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:46:29 user nova-compute[72849]: DEBUG nova.network.neutron [req-b54ed691-d524-44ad-9d39-2bca34930927 req-003ef56e-1464-48d8-8a9e-7e4959d11500 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Updated VIF entry in instance network info cache for port 226ec889-a303-45bf-93ea-14bf6d11a1f6. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:46:29 user nova-compute[72849]: DEBUG nova.network.neutron [req-b54ed691-d524-44ad-9d39-2bca34930927 req-003ef56e-1464-48d8-8a9e-7e4959d11500 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Updating instance_info_cache with network_info: [{"id": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "address": "fa:16:3e:5c:59:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ec889-a3", "ovs_interfaceid": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:46:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b54ed691-d524-44ad-9d39-2bca34930927 req-003ef56e-1464-48d8-8a9e-7e4959d11500 service nova] Releasing lock "refresh_cache-d565ed95-6f62-4948-a1da-7131ec7e799b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:46:31 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:46:31 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHnlBPQc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:46:31 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:46:31 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:46:31 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:46:31 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:46:31 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:46:31 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:46:31 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:46:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:31 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3617bfe-3e1f-471f-b416-aa7f26ee53f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:31 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:46:31 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:31 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca726c29-7e4e-489d-b948-e0d7130c49d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:31 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571] added
Aug 15 16:46:31 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:31 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dc6d28-f50b-44ff-a534-aa0c09ec1723]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:31 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:31 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95fa41b-287f-4c77-b21e-782855a47934]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHnlBPQc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHnlBPQc" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2c40b0-3aa2-4862-9102-21deaf323172]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rHnlBPQc'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed74d03-4f60-44e3-b82b-fb948b1370b1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e11fc12-582e-4769-bf9e-5a343790159d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)
Aug 15 16:46:32 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)
Aug 15 16:46:32 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3480a05-7942-4449-9b48-69979afcfe5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571, portal: 172.16.0.220,3260]
Aug 15 16:46:32 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571, portal: 172.16.0.220,3260] successful.
Aug 15 16:46:32 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a492d4a4-347c-4fbb-b951-ae871b49555d]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb336f72-0a0b-45d6-925b-d5edc1ae3cb8]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)
Aug 15 16:46:32 user nova-compute[72849]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 (non-flash)
Aug 15 16:46:32 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)
Aug 15 16:46:32 user nova-compute[72849]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 (non-flash)
Aug 15 16:46:32 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e328d4f7-ceee-4032-96e9-e3627af55ee4]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHnlBPQc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:46:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:46:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:46:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23833346337323036', 'path': '/dev/sdc'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:46:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833346337323036', 'path': '/dev/sdc'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:46:33 user nova-compute[72849]: DEBUG nova.objects.instance [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lazy-loading 'flavor' on Instance uuid 85da743e-e2c7-42c1-8621-f9942e115b01 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:46:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 16:46:33 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:46:33 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:46:33 user nova-compute[72849]:   <target dev="vdc" bus="virtio"/>
Aug 15 16:46:33 user nova-compute[72849]:   <serial>35eac035-c425-4208-98bd-ebe763ff9571</serial>
Aug 15 16:46:33 user nova-compute[72849]: </disk>
Aug 15 16:46:33 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 16:46:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:46:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:46:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:46:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] No VIF found with MAC fa:16:3e:31:70:b3, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:46:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-9c5b9215-83bc-4b04-b108-94c435ee0a40 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "85da743e-e2c7-42c1-8621-f9942e115b01" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.463s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "85da743e-e2c7-42c1-8621-f9942e115b01" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "85da743e-e2c7-42c1-8621-f9942e115b01" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:34 user nova-compute[72849]: INFO nova.compute.manager [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Detaching volume 35eac035-c425-4208-98bd-ebe763ff9571
Aug 15 16:46:34 user nova-compute[72849]: INFO nova.virt.block_device [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Attempting to driver detach volume 35eac035-c425-4208-98bd-ebe763ff9571 from mountpoint /dev/vdc
Aug 15 16:46:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Attempting to detach device vdc from instance 85da743e-e2c7-42c1-8621-f9942e115b01 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:46:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:46:34 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:46:34 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:46:34 user nova-compute[72849]:   <target dev="vdc" bus="virtio"/>
Aug 15 16:46:34 user nova-compute[72849]:   <serial>35eac035-c425-4208-98bd-ebe763ff9571</serial>
Aug 15 16:46:34 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 16:46:34 user nova-compute[72849]: </disk>
Aug 15 16:46:34 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:46:34 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Successfully detached device vdc from instance 85da743e-e2c7-42c1-8621-f9942e115b01 from the persistent domain config.
Aug 15 16:46:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 85da743e-e2c7-42c1-8621-f9942e115b01 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:46:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:46:34 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:46:34 user nova-compute[72849]:   <source dev="/dev/sdc"/>
Aug 15 16:46:34 user nova-compute[72849]:   <target dev="vdc" bus="virtio"/>
Aug 15 16:46:34 user nova-compute[72849]:   <serial>35eac035-c425-4208-98bd-ebe763ff9571</serial>
Aug 15 16:46:34 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 16:46:34 user nova-compute[72849]: </disk>
Aug 15 16:46:34 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:46:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692117994.957054, 85da743e-e2c7-42c1-8621-f9942e115b01 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:46:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 85da743e-e2c7-42c1-8621-f9942e115b01 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:46:34 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Successfully detached device vdc from instance 85da743e-e2c7-42c1-8621-f9942e115b01 from the live domain config.
Aug 15 16:46:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:46:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHnlBPQc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:46:34 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:46:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:46:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:46:34 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:46:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:34 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cd15f1-7e5d-4b2e-a591-cee325a9dec5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:34 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6789d31d-5d5f-4a92-9fdf-07874cb64574]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)
Aug 15 16:46:35 user nova-compute[72849]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 (non-flash)
Aug 15 16:46:35 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)
Aug 15 16:46:35 user nova-compute[72849]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 (non-flash)
Aug 15 16:46:35 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3581a6e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571'): ({'sdc'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Removing single pathed devices sdc {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4034c347-3d1e-4ef7-99d8-84114e882cbc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c92158-da43-4e5d-b534-05b85942c39f]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Flushing IO for device /dev/sdc {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d68f07-a1ab-4a09-855d-5a3e65b6b9b6]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[89afbbac-30b6-4e7e-8ec7-c4659be7f640]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[104feb1d-eb64-41cb-b61b-e8afe8fe1dda]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[65992125-56d4-49b4-ba07-99a80f50cf76]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571, portal: 172.16.0.220,3260]
Aug 15 16:46:35 user nova-compute[72849]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571, portal: 172.16.0.220,3260] successful.
Aug 15 16:46:35 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35eac035-c425-4208-98bd-ebe763ff9571 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9410ab8-52cc-449f-b60a-f1ee6086b4ce]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] <== disconnect_volume: return (278ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:46:35 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:46:36 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Creating image(s)
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Did not create local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Ensure instance console log exists: /opt/stack/data/nova/instances/d565ed95-6f62-4948-a1da-7131ec7e799b/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Start _get_guest_xml network_info=[{"id": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "address": "fa:16:3e:5c:59:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ec889-a3", "ovs_interfaceid": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsciIZQE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd565ed95-6f62-4948-a1da-7131ec7e799b', 'attached_at': '', 'detached_at': '', 'volume_id': 'd4e5c524-70fb-48a2-bae9-fa9b81f760bc', 'serial': 'd4e5c524-70fb-48a2-bae9-fa9b81f760bc'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '58132af3-fd05-4443-afb6-fb196d667969', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:46:36 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:46:36 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsciIZQE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:46:36 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:46:36 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:46:36 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c44974-9388-41b8-b328-cf51d434ee35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:46:36 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[683341b7-1e2b-4a87-b13f-9e677746f6b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc] added
Aug 15 16:46:36 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8223c0-91da-41a6-bfcf-9117160ade82]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46edda1-19d9-45e8-ad76-c536bbcae043]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsciIZQE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsciIZQE" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[83873290-b235-4841-9023-fc70fc47451a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fsciIZQE'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4d99e6-57fd-44e1-b686-9646e7a91983]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7e673f-0aef-4b65-b43e-f9ba247d826d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)
Aug 15 16:46:36 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)
Aug 15 16:46:36 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a601e57b-05bb-4e7c-98ff-530567923393]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc, portal: 172.16.0.220,3260]
Aug 15 16:46:36 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc, portal: 172.16.0.220,3260] successful.
Aug 15 16:46:36 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c013be-f870-4323-8d5e-7d42acfef8cd]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef790245-7890-4ba9-aa7a-f3a5060ae404]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)
Aug 15 16:46:36 user nova-compute[72849]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc (non-flash)
Aug 15 16:46:36 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)
Aug 15 16:46:36 user nova-compute[72849]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc (non-flash)
Aug 15 16:46:36 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca5c8f3-b873-45b7-84c1-e7061036124e]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:46:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsciIZQE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692117982.4579716, 7722de29-482a-4f75-a3ed-d4293fdd9db8 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:46:37 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] VM Stopped (Lifecycle Event)
Aug 15 16:46:37 user nova-compute[72849]: DEBUG nova.compute.manager [None req-1604fd84-7d35-467f-9187-7d2c0ac2f1e9 None None] [instance: 7722de29-482a-4f75-a3ed-d4293fdd9db8] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23537666562623737', 'path': '/dev/sdc'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537666562623737', 'path': '/dev/sdc'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-623490894',display_name='tempest-TestVolumeBootPattern-volume-backed-server-623490894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-623490894',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuKoLKLKkLfi68DUuF66ZF1UtVTkKXhtTV53jjHwxsjGpCsCJqheAV2p7tkYJQkT8d3gp9N+MgUNTE7fMpeQOK6ysn464fZzreiLkeZsd+iwyKWhwY12eqROkUcIMRlWQ==',key_name='tempest-keypair-1796876014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87edcbec784a4f65b99740f34ff121bb',ramdisk_id='',reservation_id='r-89upasnx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1900922481',owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe3f48f280e54c2099e6b1db842db2cd',uuid=d565ed95-6f62-4948-a1da-7131ec7e799b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "address": "fa:16:3e:5c:59:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ec889-a3", "ovs_interfaceid": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converting VIF {"id": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "address": "fa:16:3e:5c:59:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ec889-a3", "ovs_interfaceid": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:59:16,bridge_name='br-int',has_traffic_filtering=True,id=226ec889-a303-45bf-93ea-14bf6d11a1f6,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226ec889-a3') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG nova.objects.instance [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lazy-loading 'pci_devices' on Instance uuid d565ed95-6f62-4948-a1da-7131ec7e799b {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:46:37 user nova-compute[72849]:   <uuid>d565ed95-6f62-4948-a1da-7131ec7e799b</uuid>
Aug 15 16:46:37 user nova-compute[72849]:   <name>instance-00000030</name>
Aug 15 16:46:37 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:46:37 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:46:37 user nova-compute[72849]:   <metadata>
Aug 15 16:46:37 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:46:37 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:46:37 user nova-compute[72849]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-623490894</nova:name>
Aug 15 16:46:37 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:46:36</nova:creationTime>
Aug 15 16:46:37 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:46:37 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:46:37 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:46:37 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:46:37 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:46:37 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:46:37 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:46:37 user nova-compute[72849]:       <nova:owner>
Aug 15 16:46:37 user nova-compute[72849]:         <nova:user uuid="fe3f48f280e54c2099e6b1db842db2cd">tempest-TestVolumeBootPattern-1900922481-project-member</nova:user>
Aug 15 16:46:37 user nova-compute[72849]:         <nova:project uuid="87edcbec784a4f65b99740f34ff121bb">tempest-TestVolumeBootPattern-1900922481</nova:project>
Aug 15 16:46:37 user nova-compute[72849]:       </nova:owner>
Aug 15 16:46:37 user nova-compute[72849]:       <nova:ports>
Aug 15 16:46:37 user nova-compute[72849]:         <nova:port uuid="226ec889-a303-45bf-93ea-14bf6d11a1f6">
Aug 15 16:46:37 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 16:46:37 user nova-compute[72849]:         </nova:port>
Aug 15 16:46:37 user nova-compute[72849]:       </nova:ports>
Aug 15 16:46:37 user nova-compute[72849]:     </nova:instance>
Aug 15 16:46:37 user nova-compute[72849]:   </metadata>
Aug 15 16:46:37 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:46:37 user nova-compute[72849]:     <system>
Aug 15 16:46:37 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:46:37 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:46:37 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:46:37 user nova-compute[72849]:       <entry name="serial">d565ed95-6f62-4948-a1da-7131ec7e799b</entry>
Aug 15 16:46:37 user nova-compute[72849]:       <entry name="uuid">d565ed95-6f62-4948-a1da-7131ec7e799b</entry>
Aug 15 16:46:37 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:46:37 user nova-compute[72849]:     </system>
Aug 15 16:46:37 user nova-compute[72849]:   </sysinfo>
Aug 15 16:46:37 user nova-compute[72849]:   <os>
Aug 15 16:46:37 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:46:37 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:46:37 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:46:37 user nova-compute[72849]:   </os>
Aug 15 16:46:37 user nova-compute[72849]:   <features>
Aug 15 16:46:37 user nova-compute[72849]:     <acpi/>
Aug 15 16:46:37 user nova-compute[72849]:     <apic/>
Aug 15 16:46:37 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:46:37 user nova-compute[72849]:   </features>
Aug 15 16:46:37 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:46:37 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:46:37 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:46:37 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:46:37 user nova-compute[72849]:   </clock>
Aug 15 16:46:37 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:46:37 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:46:37 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:46:37 user nova-compute[72849]:   </cpu>
Aug 15 16:46:37 user nova-compute[72849]:   <devices>
Aug 15 16:46:37 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:46:37 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:46:37 user nova-compute[72849]:       <source dev="/dev/sdc"/>
Aug 15 16:46:37 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:46:37 user nova-compute[72849]:       <serial>d4e5c524-70fb-48a2-bae9-fa9b81f760bc</serial>
Aug 15 16:46:37 user nova-compute[72849]:     </disk>
Aug 15 16:46:37 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:46:37 user nova-compute[72849]:       <mac address="fa:16:3e:5c:59:16"/>
Aug 15 16:46:37 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:46:37 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:46:37 user nova-compute[72849]:       <target dev="tap226ec889-a3"/>
Aug 15 16:46:37 user nova-compute[72849]:     </interface>
Aug 15 16:46:37 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:46:37 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/d565ed95-6f62-4948-a1da-7131ec7e799b/console.log" append="off"/>
Aug 15 16:46:37 user nova-compute[72849]:     </serial>
Aug 15 16:46:37 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:46:37 user nova-compute[72849]:     <video>
Aug 15 16:46:37 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:46:37 user nova-compute[72849]:     </video>
Aug 15 16:46:37 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:46:37 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:46:37 user nova-compute[72849]:     </rng>
Aug 15 16:46:37 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:46:37 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:46:37 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:46:37 user nova-compute[72849]:     </memballoon>
Aug 15 16:46:37 user nova-compute[72849]:   </devices>
Aug 15 16:46:37 user nova-compute[72849]: </domain>
Aug 15 16:46:37 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-623490894',display_name='tempest-TestVolumeBootPattern-volume-backed-server-623490894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-623490894',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuKoLKLKkLfi68DUuF66ZF1UtVTkKXhtTV53jjHwxsjGpCsCJqheAV2p7tkYJQkT8d3gp9N+MgUNTE7fMpeQOK6ysn464fZzreiLkeZsd+iwyKWhwY12eqROkUcIMRlWQ==',key_name='tempest-keypair-1796876014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87edcbec784a4f65b99740f34ff121bb',ramdisk_id='',reservation_id='r-89upasnx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1900922481',owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe3f48f280e54c2099e6b1db842db2cd',uuid=d565ed95-6f62-4948-a1da-7131ec7e799b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "address": "fa:16:3e:5c:59:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ec889-a3", "ovs_interfaceid": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converting VIF {"id": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "address": "fa:16:3e:5c:59:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ec889-a3", "ovs_interfaceid": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:59:16,bridge_name='br-int',has_traffic_filtering=True,id=226ec889-a303-45bf-93ea-14bf6d11a1f6,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226ec889-a3') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG os_vif [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:59:16,bridge_name='br-int',has_traffic_filtering=True,id=226ec889-a303-45bf-93ea-14bf6d11a1f6,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226ec889-a3') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap226ec889-a3, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap226ec889-a3, col_values=(('external_ids', {'iface-id': '226ec889-a303-45bf-93ea-14bf6d11a1f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:59:16', 'vm-uuid': 'd565ed95-6f62-4948-a1da-7131ec7e799b'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:37 user nova-compute[72849]: INFO os_vif [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:59:16,bridge_name='br-int',has_traffic_filtering=True,id=226ec889-a303-45bf-93ea-14bf6d11a1f6,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226ec889-a3')
Aug 15 16:46:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] No VIF found with MAC fa:16:3e:5c:59:16, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG nova.objects.instance [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lazy-loading 'flavor' on Instance uuid 85da743e-e2c7-42c1-8621-f9942e115b01 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:46:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-a9f02855-561a-4241-922f-92c076305a49 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "85da743e-e2c7-42c1-8621-f9942e115b01" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.408s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-7ec3e7a1-7960-4bc3-a74f-4930f1d04f13 req-05d1fa67-fc53-434e-9ee3-62bc2432db72 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Received event network-vif-plugged-226ec889-a303-45bf-93ea-14bf6d11a1f6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:46:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7ec3e7a1-7960-4bc3-a74f-4930f1d04f13 req-05d1fa67-fc53-434e-9ee3-62bc2432db72 service nova] Acquiring lock "d565ed95-6f62-4948-a1da-7131ec7e799b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7ec3e7a1-7960-4bc3-a74f-4930f1d04f13 req-05d1fa67-fc53-434e-9ee3-62bc2432db72 service nova] Lock "d565ed95-6f62-4948-a1da-7131ec7e799b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:39 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7ec3e7a1-7960-4bc3-a74f-4930f1d04f13 req-05d1fa67-fc53-434e-9ee3-62bc2432db72 service nova] Lock "d565ed95-6f62-4948-a1da-7131ec7e799b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:39 user nova-compute[72849]: DEBUG nova.compute.manager [req-7ec3e7a1-7960-4bc3-a74f-4930f1d04f13 req-05d1fa67-fc53-434e-9ee3-62bc2432db72 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] No waiting events found dispatching network-vif-plugged-226ec889-a303-45bf-93ea-14bf6d11a1f6 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:46:39 user nova-compute[72849]: WARNING nova.compute.manager [req-7ec3e7a1-7960-4bc3-a74f-4930f1d04f13 req-05d1fa67-fc53-434e-9ee3-62bc2432db72 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Received unexpected event network-vif-plugged-226ec889-a303-45bf-93ea-14bf6d11a1f6 for instance with vm_state building and task_state spawning.
Aug 15 16:46:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:41 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692118001.033715, d565ed95-6f62-4948-a1da-7131ec7e799b => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:46:41 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] VM Resumed (Lifecycle Event)
Aug 15 16:46:41 user nova-compute[72849]: DEBUG nova.compute.manager [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:46:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:46:41 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Instance spawned successfully.
Aug 15 16:46:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:46:41 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:46:41 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:46:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:46:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:46:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:46:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:46:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:46:41 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:46:41 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:46:41 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692118001.0352051, d565ed95-6f62-4948-a1da-7131ec7e799b => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:46:41 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] VM Started (Lifecycle Event)
Aug 15 16:46:41 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:46:41 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:46:41 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:46:41 user nova-compute[72849]: INFO nova.compute.manager [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Took 4.88 seconds to spawn the instance on the hypervisor.
Aug 15 16:46:41 user nova-compute[72849]: DEBUG nova.compute.manager [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:46:41 user nova-compute[72849]: INFO nova.compute.manager [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Took 15.11 seconds to build instance.
Aug 15 16:46:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-25435fb3-20ac-48a6-8c98-781baa17acb1 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "d565ed95-6f62-4948-a1da-7131ec7e799b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.213s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-5c9f04f1-640b-4e0c-b6f7-d998774d362b req-49aa183f-82ce-4883-b832-36a2e1cc59e5 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Received event network-vif-plugged-226ec889-a303-45bf-93ea-14bf6d11a1f6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:46:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5c9f04f1-640b-4e0c-b6f7-d998774d362b req-49aa183f-82ce-4883-b832-36a2e1cc59e5 service nova] Acquiring lock "d565ed95-6f62-4948-a1da-7131ec7e799b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5c9f04f1-640b-4e0c-b6f7-d998774d362b req-49aa183f-82ce-4883-b832-36a2e1cc59e5 service nova] Lock "d565ed95-6f62-4948-a1da-7131ec7e799b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:41 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-5c9f04f1-640b-4e0c-b6f7-d998774d362b req-49aa183f-82ce-4883-b832-36a2e1cc59e5 service nova] Lock "d565ed95-6f62-4948-a1da-7131ec7e799b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:41 user nova-compute[72849]: DEBUG nova.compute.manager [req-5c9f04f1-640b-4e0c-b6f7-d998774d362b req-49aa183f-82ce-4883-b832-36a2e1cc59e5 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] No waiting events found dispatching network-vif-plugged-226ec889-a303-45bf-93ea-14bf6d11a1f6 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:46:41 user nova-compute[72849]: WARNING nova.compute.manager [req-5c9f04f1-640b-4e0c-b6f7-d998774d362b req-49aa183f-82ce-4883-b832-36a2e1cc59e5 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Received unexpected event network-vif-plugged-226ec889-a303-45bf-93ea-14bf6d11a1f6 for instance with vm_state active and task_state None.
Aug 15 16:46:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:43 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:46:43 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:46:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-85da743e-e2c7-42c1-8621-f9942e115b01" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:46:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-85da743e-e2c7-42c1-8621-f9942e115b01" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:46:43 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:46:43 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Updating instance_info_cache with network_info: [{"id": "dbf46f11-8d35-4234-8748-d198b36de354", "address": "fa:16:3e:31:70:b3", "network": {"id": "a1da2ef5-bf52-472d-af07-d81b9cf8a5e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-544176784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2debda1cc8ff470b9c83ea54eb8ed955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf46f11-8d", "ovs_interfaceid": "dbf46f11-8d35-4234-8748-d198b36de354", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:46:43 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-85da743e-e2c7-42c1-8621-f9942e115b01" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:46:43 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:46:43 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:46:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:46 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:46:47 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:46:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:48 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:46:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:46:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:46:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:46:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:49 user nova-compute[72849]: INFO nova.compute.manager [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Terminating instance
Aug 15 16:46:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:46:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:46:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG nova.compute.manager [req-19799592-9c4f-4903-a666-661995efbc09 req-907a6785-ad45-4376-8366-1c5fbc6a1288 service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Received event network-vif-unplugged-6730cbf2-c90b-49ba-b2f7-085a3700cdc1 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-19799592-9c4f-4903-a666-661995efbc09 req-907a6785-ad45-4376-8366-1c5fbc6a1288 service nova] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-19799592-9c4f-4903-a666-661995efbc09 req-907a6785-ad45-4376-8366-1c5fbc6a1288 service nova] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-19799592-9c4f-4903-a666-661995efbc09 req-907a6785-ad45-4376-8366-1c5fbc6a1288 service nova] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG nova.compute.manager [req-19799592-9c4f-4903-a666-661995efbc09 req-907a6785-ad45-4376-8366-1c5fbc6a1288 service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] No waiting events found dispatching network-vif-unplugged-6730cbf2-c90b-49ba-b2f7-085a3700cdc1 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG nova.compute.manager [req-19799592-9c4f-4903-a666-661995efbc09 req-907a6785-ad45-4376-8366-1c5fbc6a1288 service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Received event network-vif-unplugged-6730cbf2-c90b-49ba-b2f7-085a3700cdc1 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:46:50 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Instance destroyed successfully.
Aug 15 16:46:50 user nova-compute[72849]: DEBUG nova.objects.instance [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lazy-loading 'resources' on Instance uuid ff3d801d-ddc7-4f90-8cc8-a577d6482270 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:46:50 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:46:50 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:46:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8300MB free_disk=25.159095764160156GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1079645563',display_name='tempest-SnapshotDataIntegrityTests-server-1079645563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1079645563',id=42,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvnT+eAwlt9cDEjqLosifCxdPcXDVj0AGxz4cwnMnmBVXy4le3IAK9McncxpOpLoQ8qPGhfI3OlQoSvgL38O4KbPumZWqmX9HI8bENTvelG6Etcx0SBqdkYcFxQfctVhA==',key_name='tempest-keypair-620977284',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:39:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5023408270042d1849f75aa91a764c6',ramdisk_id='',reservation_id='r-t52ehmsa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1276713083',owner_user_name='tempest-SnapshotDataIntegrityTests-1276713083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:39:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdf8e22aac8640f0a9982f84f82c545b',uuid=ff3d801d-ddc7-4f90-8cc8-a577d6482270,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "address": "fa:16:3e:79:89:fb", "network": {"id": "e58f7f18-d91b-491d-a7df-8dcfd65e8c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1908380537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5023408270042d1849f75aa91a764c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730cbf2-c9", "ovs_interfaceid": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Converting VIF {"id": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "address": "fa:16:3e:79:89:fb", "network": {"id": "e58f7f18-d91b-491d-a7df-8dcfd65e8c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1908380537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5023408270042d1849f75aa91a764c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730cbf2-c9", "ovs_interfaceid": "6730cbf2-c90b-49ba-b2f7-085a3700cdc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:89:fb,bridge_name='br-int',has_traffic_filtering=True,id=6730cbf2-c90b-49ba-b2f7-085a3700cdc1,network=Network(e58f7f18-d91b-491d-a7df-8dcfd65e8c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730cbf2-c9') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG os_vif [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:89:fb,bridge_name='br-int',has_traffic_filtering=True,id=6730cbf2-c90b-49ba-b2f7-085a3700cdc1,network=Network(e58f7f18-d91b-491d-a7df-8dcfd65e8c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730cbf2-c9') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6730cbf2-c9, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:50 user nova-compute[72849]: INFO os_vif [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:89:fb,bridge_name='br-int',has_traffic_filtering=True,id=6730cbf2-c90b-49ba-b2f7-085a3700cdc1,network=Network(e58f7f18-d91b-491d-a7df-8dcfd65e8c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730cbf2-c9')
Aug 15 16:46:50 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Deleting instance files /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270_del
Aug 15 16:46:50 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Deletion of /opt/stack/data/nova/instances/ff3d801d-ddc7-4f90-8cc8-a577d6482270_del complete
Aug 15 16:46:50 user nova-compute[72849]: INFO nova.compute.manager [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 15 16:46:50 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance ff3d801d-ddc7-4f90-8cc8-a577d6482270 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 85da743e-e2c7-42c1-8621-f9942e115b01 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 52ec78db-a731-4a31-b9f1-2214c7bb9007 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance d565ed95-6f62-4948-a1da-7131ec7e799b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:46:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:46:51 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:46:51 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:46:51 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:46:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:51 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:46:51 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Took 0.85 seconds to deallocate network for instance.
Aug 15 16:46:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:51 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:46:51 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:46:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:51 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Deleted allocations for instance ff3d801d-ddc7-4f90-8cc8-a577d6482270
Aug 15 16:46:51 user nova-compute[72849]: DEBUG nova.compute.manager [req-a63d7697-d753-4773-a6ad-b8d0f26f66a3 req-0231e030-6fdb-4ff8-8663-11267eb6d324 service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Received event network-vif-plugged-6730cbf2-c90b-49ba-b2f7-085a3700cdc1 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:46:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a63d7697-d753-4773-a6ad-b8d0f26f66a3 req-0231e030-6fdb-4ff8-8663-11267eb6d324 service nova] Acquiring lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:46:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a63d7697-d753-4773-a6ad-b8d0f26f66a3 req-0231e030-6fdb-4ff8-8663-11267eb6d324 service nova] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:46:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a63d7697-d753-4773-a6ad-b8d0f26f66a3 req-0231e030-6fdb-4ff8-8663-11267eb6d324 service nova] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:51 user nova-compute[72849]: DEBUG nova.compute.manager [req-a63d7697-d753-4773-a6ad-b8d0f26f66a3 req-0231e030-6fdb-4ff8-8663-11267eb6d324 service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] No waiting events found dispatching network-vif-plugged-6730cbf2-c90b-49ba-b2f7-085a3700cdc1 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:46:51 user nova-compute[72849]: WARNING nova.compute.manager [req-a63d7697-d753-4773-a6ad-b8d0f26f66a3 req-0231e030-6fdb-4ff8-8663-11267eb6d324 service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Received unexpected event network-vif-plugged-6730cbf2-c90b-49ba-b2f7-085a3700cdc1 for instance with vm_state deleted and task_state None.
Aug 15 16:46:51 user nova-compute[72849]: DEBUG nova.compute.manager [req-a63d7697-d753-4773-a6ad-b8d0f26f66a3 req-0231e030-6fdb-4ff8-8663-11267eb6d324 service nova] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Received event network-vif-deleted-6730cbf2-c90b-49ba-b2f7-085a3700cdc1 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:46:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-11aa5bd7-3272-48a6-9b59-0c0bc01e6b8a tempest-SnapshotDataIntegrityTests-1276713083 tempest-SnapshotDataIntegrityTests-1276713083-project-member] Lock "ff3d801d-ddc7-4f90-8cc8-a577d6482270" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.500s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:46:52 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:46:52 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:46:52 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:46:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:46:53 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:46:55 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:46:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:46:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:05 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692118010.3804178, ff3d801d-ddc7-4f90-8cc8-a577d6482270 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:47:05 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] VM Stopped (Lifecycle Event)
Aug 15 16:47:05 user nova-compute[72849]: DEBUG nova.compute.manager [None req-5552f862-1b18-45a0-9f18-1e0a48713ca1 None None] [instance: ff3d801d-ddc7-4f90-8cc8-a577d6482270] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:47:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquiring lock "52ec78db-a731-4a31-b9f1-2214c7bb9007" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:47:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "52ec78db-a731-4a31-b9f1-2214c7bb9007" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:47:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquiring lock "52ec78db-a731-4a31-b9f1-2214c7bb9007-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:47:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "52ec78db-a731-4a31-b9f1-2214c7bb9007-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:47:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "52ec78db-a731-4a31-b9f1-2214c7bb9007-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:47:15 user nova-compute[72849]: INFO nova.compute.manager [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Terminating instance
Aug 15 16:47:15 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:47:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-fdb1957a-1dd5-4b7f-b015-62fc9c6d5dac req-b52e33d6-9784-4f3f-bc8a-e2ce9858b84a service nova] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Received event network-vif-unplugged-91f2be4e-53e6-4330-9ac0-359a255f2f12 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:47:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fdb1957a-1dd5-4b7f-b015-62fc9c6d5dac req-b52e33d6-9784-4f3f-bc8a-e2ce9858b84a service nova] Acquiring lock "52ec78db-a731-4a31-b9f1-2214c7bb9007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:47:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fdb1957a-1dd5-4b7f-b015-62fc9c6d5dac req-b52e33d6-9784-4f3f-bc8a-e2ce9858b84a service nova] Lock "52ec78db-a731-4a31-b9f1-2214c7bb9007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:47:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-fdb1957a-1dd5-4b7f-b015-62fc9c6d5dac req-b52e33d6-9784-4f3f-bc8a-e2ce9858b84a service nova] Lock "52ec78db-a731-4a31-b9f1-2214c7bb9007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:47:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-fdb1957a-1dd5-4b7f-b015-62fc9c6d5dac req-b52e33d6-9784-4f3f-bc8a-e2ce9858b84a service nova] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] No waiting events found dispatching network-vif-unplugged-91f2be4e-53e6-4330-9ac0-359a255f2f12 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:47:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-fdb1957a-1dd5-4b7f-b015-62fc9c6d5dac req-b52e33d6-9784-4f3f-bc8a-e2ce9858b84a service nova] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Received event network-vif-unplugged-91f2be4e-53e6-4330-9ac0-359a255f2f12 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:47:16 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Instance destroyed successfully.
Aug 15 16:47:16 user nova-compute[72849]: DEBUG nova.objects.instance [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lazy-loading 'resources' on Instance uuid 52ec78db-a731-4a31-b9f1-2214c7bb9007 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:47:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-858682925',display_name='tempest-VolumesActionsTest-instance-858682925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-858682925',id=47,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:45:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48a6bda829b4429b87c54780795763e1',ramdisk_id='',reservation_id='r-9tbqw4mr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1889056072',owner_user_name='tempest-VolumesActionsTest-1889056072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:45:31Z,user_data=None,user_id='058da58bd1924ef78c9228777f898a5d',uuid=52ec78db-a731-4a31-b9f1-2214c7bb9007,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "address": "fa:16:3e:bc:d0:1e", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f2be4e-53", "ovs_interfaceid": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:47:16 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Converting VIF {"id": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "address": "fa:16:3e:bc:d0:1e", "network": {"id": "f410fe9a-3118-492b-99d1-e54500294d5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1330078780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a6bda829b4429b87c54780795763e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f2be4e-53", "ovs_interfaceid": "91f2be4e-53e6-4330-9ac0-359a255f2f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:47:16 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d0:1e,bridge_name='br-int',has_traffic_filtering=True,id=91f2be4e-53e6-4330-9ac0-359a255f2f12,network=Network(f410fe9a-3118-492b-99d1-e54500294d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f2be4e-53') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:47:16 user nova-compute[72849]: DEBUG os_vif [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d0:1e,bridge_name='br-int',has_traffic_filtering=True,id=91f2be4e-53e6-4330-9ac0-359a255f2f12,network=Network(f410fe9a-3118-492b-99d1-e54500294d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f2be4e-53') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:47:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91f2be4e-53, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:47:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:47:16 user nova-compute[72849]: INFO os_vif [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d0:1e,bridge_name='br-int',has_traffic_filtering=True,id=91f2be4e-53e6-4330-9ac0-359a255f2f12,network=Network(f410fe9a-3118-492b-99d1-e54500294d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f2be4e-53')
Aug 15 16:47:16 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Deleting instance files /opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007_del
Aug 15 16:47:16 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Deletion of /opt/stack/data/nova/instances/52ec78db-a731-4a31-b9f1-2214c7bb9007_del complete
Aug 15 16:47:16 user nova-compute[72849]: INFO nova.compute.manager [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 15 16:47:16 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:47:16 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:47:16 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:47:16 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:47:16 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Took 0.52 seconds to deallocate network for instance.
Aug 15 16:47:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:47:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:47:16 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:47:16 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:47:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:47:17 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Deleted allocations for instance 52ec78db-a731-4a31-b9f1-2214c7bb9007
Aug 15 16:47:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-3bb5a03a-0041-457f-ba11-55923954b919 tempest-VolumesActionsTest-1889056072 tempest-VolumesActionsTest-1889056072-project-member] Lock "52ec78db-a731-4a31-b9f1-2214c7bb9007" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.543s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:47:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-d7ee9b26-1ce3-4459-9d34-1e92854c246b req-022906e4-7bcd-4a93-910b-c8414cb2c6fe service nova] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Received event network-vif-plugged-91f2be4e-53e6-4330-9ac0-359a255f2f12 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:47:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d7ee9b26-1ce3-4459-9d34-1e92854c246b req-022906e4-7bcd-4a93-910b-c8414cb2c6fe service nova] Acquiring lock "52ec78db-a731-4a31-b9f1-2214c7bb9007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:47:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d7ee9b26-1ce3-4459-9d34-1e92854c246b req-022906e4-7bcd-4a93-910b-c8414cb2c6fe service nova] Lock "52ec78db-a731-4a31-b9f1-2214c7bb9007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:47:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d7ee9b26-1ce3-4459-9d34-1e92854c246b req-022906e4-7bcd-4a93-910b-c8414cb2c6fe service nova] Lock "52ec78db-a731-4a31-b9f1-2214c7bb9007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:47:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-d7ee9b26-1ce3-4459-9d34-1e92854c246b req-022906e4-7bcd-4a93-910b-c8414cb2c6fe service nova] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] No waiting events found dispatching network-vif-plugged-91f2be4e-53e6-4330-9ac0-359a255f2f12 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:47:18 user nova-compute[72849]: WARNING nova.compute.manager [req-d7ee9b26-1ce3-4459-9d34-1e92854c246b req-022906e4-7bcd-4a93-910b-c8414cb2c6fe service nova] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Received unexpected event network-vif-plugged-91f2be4e-53e6-4330-9ac0-359a255f2f12 for instance with vm_state deleted and task_state None.
Aug 15 16:47:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-d7ee9b26-1ce3-4459-9d34-1e92854c246b req-022906e4-7bcd-4a93-910b-c8414cb2c6fe service nova] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Received event network-vif-deleted-91f2be4e-53e6-4330-9ac0-359a255f2f12 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:47:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "85da743e-e2c7-42c1-8621-f9942e115b01" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:47:24 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "85da743e-e2c7-42c1-8621-f9942e115b01" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:47:24 user nova-compute[72849]: INFO nova.compute.manager [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Detaching volume 55e28ced-5252-419e-9758-25630aa35ae4
Aug 15 16:47:24 user nova-compute[72849]: INFO nova.virt.block_device [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Attempting to driver detach volume 55e28ced-5252-419e-9758-25630aa35ae4 from mountpoint /dev/vdb
Aug 15 16:47:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Attempting to detach device vdb from instance 85da743e-e2c7-42c1-8621-f9942e115b01 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:47:25 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:47:25 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:47:25 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:47:25 user nova-compute[72849]:   <serial>55e28ced-5252-419e-9758-25630aa35ae4</serial>
Aug 15 16:47:25 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:47:25 user nova-compute[72849]: </disk>
Aug 15 16:47:25 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:47:25 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Successfully detached device vdb from instance 85da743e-e2c7-42c1-8621-f9942e115b01 from the persistent domain config.
Aug 15 16:47:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85da743e-e2c7-42c1-8621-f9942e115b01 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 16:47:25 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:47:25 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 16:47:25 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 16:47:25 user nova-compute[72849]:   <serial>55e28ced-5252-419e-9758-25630aa35ae4</serial>
Aug 15 16:47:25 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 16:47:25 user nova-compute[72849]: </disk>
Aug 15 16:47:25 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692118045.4463465, 85da743e-e2c7-42c1-8621-f9942e115b01 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85da743e-e2c7-42c1-8621-f9942e115b01 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 16:47:25 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Successfully detached device vdb from instance 85da743e-e2c7-42c1-8621-f9942e115b01 from the live domain config.
Aug 15 16:47:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BCuUraJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:47:25 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:47:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c2156b-9fb5-4aa3-a90f-77790f342dac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d058426b-802f-4e51-9255-b21a15e19a9f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)
Aug 15 16:47:25 user nova-compute[72849]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc (non-flash)
Aug 15 16:47:25 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 (non-flash)
Aug 15 16:47:25 user nova-compute[72849]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc (non-flash)
Aug 15 16:47:25 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3587e51b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b135eae-c1b7-47df-b517-f3c2c5417467]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6969793d-4509-4521-9053-c34460c5176d]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51635d4-a0ab-4b80-82ca-ed6af9a735ea]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[32598b22-a5d9-4a71-9975-aa09174de4e8]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daef820-24ff-49b4-853b-adc16fbbac94]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37b84fa-34a3-486d-bde6-dca5fa482701]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4, portal: 172.16.0.220,3260]
Aug 15 16:47:25 user nova-compute[72849]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4, portal: 172.16.0.220,3260] successful.
Aug 15 16:47:25 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e28ced-5252-419e-9758-25630aa35ae4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e46fd8-11b0-4464-b34f-29b70b08da2c]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] <== disconnect_volume: return (263ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:47:25 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:47:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:47:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:47:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:47:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:47:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:26 user nova-compute[72849]: DEBUG nova.objects.instance [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lazy-loading 'flavor' on Instance uuid 85da743e-e2c7-42c1-8621-f9942e115b01 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:47:26 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-1562de0f-e46d-494f-b366-ea29ae74f215 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "85da743e-e2c7-42c1-8621-f9942e115b01" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.573s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:47:31 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692118036.1203146, 52ec78db-a731-4a31-b9f1-2214c7bb9007 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:47:31 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] VM Stopped (Lifecycle Event)
Aug 15 16:47:31 user nova-compute[72849]: DEBUG nova.compute.manager [None req-1c404eb1-be64-4a40-8dfd-2fcf5cea53da None None] [instance: 52ec78db-a731-4a31-b9f1-2214c7bb9007] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:47:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:47:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:43 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:47:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:44 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:47:44 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:47:44 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:47:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-85da743e-e2c7-42c1-8621-f9942e115b01" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:47:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-85da743e-e2c7-42c1-8621-f9942e115b01" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:47:44 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:47:44 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid 85da743e-e2c7-42c1-8621-f9942e115b01 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:47:44 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Updating instance_info_cache with network_info: [{"id": "dbf46f11-8d35-4234-8748-d198b36de354", "address": "fa:16:3e:31:70:b3", "network": {"id": "a1da2ef5-bf52-472d-af07-d81b9cf8a5e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-544176784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2debda1cc8ff470b9c83ea54eb8ed955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf46f11-8d", "ovs_interfaceid": "dbf46f11-8d35-4234-8748-d198b36de354", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:47:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-85da743e-e2c7-42c1-8621-f9942e115b01" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:47:44 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:47:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:46 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:47:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:48 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:47:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:47:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:47:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:47:48 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:47:48 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:47:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:47:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:47:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:47:48 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:47:49 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:47:49 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:47:49 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8474MB free_disk=25.205020904541016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:47:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:47:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:47:49 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 85da743e-e2c7-42c1-8621-f9942e115b01 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:47:49 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance d565ed95-6f62-4948-a1da-7131ec7e799b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:47:49 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:47:49 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:47:49 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing inventories for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 16:47:49 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating ProviderTree inventory for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 16:47:49 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating inventory in ProviderTree for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 16:47:49 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing aggregate associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, aggregates: None {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 16:47:49 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing trait associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 16:47:49 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:47:49 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:47:49 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:47:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:47:50 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:47:50 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:47:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:52 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:47:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 16:47:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] There are 0 instances to clean {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 16:47:53 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:47:54 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:47:54 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:47:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:47:57 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:47:58 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:48:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:05 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:48:05 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72849) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 16:48:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "85da743e-e2c7-42c1-8621-f9942e115b01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:48:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "85da743e-e2c7-42c1-8621-f9942e115b01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:48:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "85da743e-e2c7-42c1-8621-f9942e115b01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:48:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "85da743e-e2c7-42c1-8621-f9942e115b01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:48:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "85da743e-e2c7-42c1-8621-f9942e115b01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:48:15 user nova-compute[72849]: INFO nova.compute.manager [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Terminating instance
Aug 15 16:48:15 user nova-compute[72849]: DEBUG nova.compute.manager [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:48:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-a7fd4db5-d2cc-4809-b563-02b43585845b req-9a51f152-c4be-43a3-bd26-9c3444e5f748 service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Received event network-vif-unplugged-dbf46f11-8d35-4234-8748-d198b36de354 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:48:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a7fd4db5-d2cc-4809-b563-02b43585845b req-9a51f152-c4be-43a3-bd26-9c3444e5f748 service nova] Acquiring lock "85da743e-e2c7-42c1-8621-f9942e115b01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:48:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a7fd4db5-d2cc-4809-b563-02b43585845b req-9a51f152-c4be-43a3-bd26-9c3444e5f748 service nova] Lock "85da743e-e2c7-42c1-8621-f9942e115b01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:48:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-a7fd4db5-d2cc-4809-b563-02b43585845b req-9a51f152-c4be-43a3-bd26-9c3444e5f748 service nova] Lock "85da743e-e2c7-42c1-8621-f9942e115b01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:48:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-a7fd4db5-d2cc-4809-b563-02b43585845b req-9a51f152-c4be-43a3-bd26-9c3444e5f748 service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] No waiting events found dispatching network-vif-unplugged-dbf46f11-8d35-4234-8748-d198b36de354 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:48:15 user nova-compute[72849]: DEBUG nova.compute.manager [req-a7fd4db5-d2cc-4809-b563-02b43585845b req-9a51f152-c4be-43a3-bd26-9c3444e5f748 service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Received event network-vif-unplugged-dbf46f11-8d35-4234-8748-d198b36de354 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:48:16 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Instance destroyed successfully.
Aug 15 16:48:16 user nova-compute[72849]: DEBUG nova.objects.instance [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lazy-loading 'resources' on Instance uuid 85da743e-e2c7-42c1-8621-f9942e115b01 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:48:16 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:44:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1296328350',display_name='tempest-TestServerVolumeAttachmentScenario-server-1296328350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1296328350',id=46,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtN2Q5jfP2RntBU9L6ER0E7a/zCyVtC68ApwpubADq3M1CkZzk5zVtAM5ppxhhaaPcKmzE+u7QSONVOgUWC/CCFql4PWWgla/afPH4qQE8KTzlCDPip2aL8+dGrolbJ+g==',key_name='tempest-keypair-2081832247',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:44:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2debda1cc8ff470b9c83ea54eb8ed955',ramdisk_id='',reservation_id='r-33rrb6sw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1356741363',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1356741363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:44:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff5000940b6d4cc79590b52201b8cd8c',uuid=85da743e-e2c7-42c1-8621-f9942e115b01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbf46f11-8d35-4234-8748-d198b36de354", "address": "fa:16:3e:31:70:b3", "network": {"id": "a1da2ef5-bf52-472d-af07-d81b9cf8a5e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-544176784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2debda1cc8ff470b9c83ea54eb8ed955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf46f11-8d", "ovs_interfaceid": "dbf46f11-8d35-4234-8748-d198b36de354", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:48:16 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Converting VIF {"id": "dbf46f11-8d35-4234-8748-d198b36de354", "address": "fa:16:3e:31:70:b3", "network": {"id": "a1da2ef5-bf52-472d-af07-d81b9cf8a5e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-544176784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2debda1cc8ff470b9c83ea54eb8ed955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf46f11-8d", "ovs_interfaceid": "dbf46f11-8d35-4234-8748-d198b36de354", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:48:16 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:70:b3,bridge_name='br-int',has_traffic_filtering=True,id=dbf46f11-8d35-4234-8748-d198b36de354,network=Network(a1da2ef5-bf52-472d-af07-d81b9cf8a5e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf46f11-8d') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:48:16 user nova-compute[72849]: DEBUG os_vif [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:70:b3,bridge_name='br-int',has_traffic_filtering=True,id=dbf46f11-8d35-4234-8748-d198b36de354,network=Network(a1da2ef5-bf52-472d-af07-d81b9cf8a5e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf46f11-8d') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:48:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbf46f11-8d, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:48:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:16 user nova-compute[72849]: INFO os_vif [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:70:b3,bridge_name='br-int',has_traffic_filtering=True,id=dbf46f11-8d35-4234-8748-d198b36de354,network=Network(a1da2ef5-bf52-472d-af07-d81b9cf8a5e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf46f11-8d')
Aug 15 16:48:16 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Deleting instance files /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01_del
Aug 15 16:48:16 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Deletion of /opt/stack/data/nova/instances/85da743e-e2c7-42c1-8621-f9942e115b01_del complete
Aug 15 16:48:16 user nova-compute[72849]: INFO nova.compute.manager [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 15 16:48:16 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:48:16 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:48:16 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:48:17 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:48:17 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Took 1.09 seconds to deallocate network for instance.
Aug 15 16:48:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:48:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:48:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-141aac86-45e1-4bd5-ad9f-d24d07613e68 req-e7044c06-8acc-45dc-b115-78ba22d40ab2 service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Received event network-vif-deleted-dbf46f11-8d35-4234-8748-d198b36de354 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:48:17 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:48:17 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:48:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:48:17 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Deleted allocations for instance 85da743e-e2c7-42c1-8621-f9942e115b01
Aug 15 16:48:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-6ac2c533-8610-4112-afce-0279d3031ce1 req-b7e162e1-ce59-4932-b0ae-729cb97ac940 service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Received event network-vif-plugged-dbf46f11-8d35-4234-8748-d198b36de354 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:48:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6ac2c533-8610-4112-afce-0279d3031ce1 req-b7e162e1-ce59-4932-b0ae-729cb97ac940 service nova] Acquiring lock "85da743e-e2c7-42c1-8621-f9942e115b01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:48:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6ac2c533-8610-4112-afce-0279d3031ce1 req-b7e162e1-ce59-4932-b0ae-729cb97ac940 service nova] Lock "85da743e-e2c7-42c1-8621-f9942e115b01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:48:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6ac2c533-8610-4112-afce-0279d3031ce1 req-b7e162e1-ce59-4932-b0ae-729cb97ac940 service nova] Lock "85da743e-e2c7-42c1-8621-f9942e115b01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:48:17 user nova-compute[72849]: DEBUG nova.compute.manager [req-6ac2c533-8610-4112-afce-0279d3031ce1 req-b7e162e1-ce59-4932-b0ae-729cb97ac940 service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] No waiting events found dispatching network-vif-plugged-dbf46f11-8d35-4234-8748-d198b36de354 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:48:17 user nova-compute[72849]: WARNING nova.compute.manager [req-6ac2c533-8610-4112-afce-0279d3031ce1 req-b7e162e1-ce59-4932-b0ae-729cb97ac940 service nova] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Received unexpected event network-vif-plugged-dbf46f11-8d35-4234-8748-d198b36de354 for instance with vm_state deleted and task_state None.
Aug 15 16:48:17 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-eed529fb-0fe3-4b89-bc15-909509981156 tempest-TestServerVolumeAttachmentScenario-1356741363 tempest-TestServerVolumeAttachmentScenario-1356741363-project-member] Lock "85da743e-e2c7-42c1-8621-f9942e115b01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.365s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:48:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-527b26f6-c313-4003-9735-80689e632d29 req-c2e48586-b953-42ed-8cc7-d364d02a8bb4 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Received event network-changed-226ec889-a303-45bf-93ea-14bf6d11a1f6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:48:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-527b26f6-c313-4003-9735-80689e632d29 req-c2e48586-b953-42ed-8cc7-d364d02a8bb4 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Refreshing instance network info cache due to event network-changed-226ec889-a303-45bf-93ea-14bf6d11a1f6. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:48:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-527b26f6-c313-4003-9735-80689e632d29 req-c2e48586-b953-42ed-8cc7-d364d02a8bb4 service nova] Acquiring lock "refresh_cache-d565ed95-6f62-4948-a1da-7131ec7e799b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:48:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-527b26f6-c313-4003-9735-80689e632d29 req-c2e48586-b953-42ed-8cc7-d364d02a8bb4 service nova] Acquired lock "refresh_cache-d565ed95-6f62-4948-a1da-7131ec7e799b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:48:19 user nova-compute[72849]: DEBUG nova.network.neutron [req-527b26f6-c313-4003-9735-80689e632d29 req-c2e48586-b953-42ed-8cc7-d364d02a8bb4 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Refreshing network info cache for port 226ec889-a303-45bf-93ea-14bf6d11a1f6 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:48:20 user nova-compute[72849]: DEBUG nova.network.neutron [req-527b26f6-c313-4003-9735-80689e632d29 req-c2e48586-b953-42ed-8cc7-d364d02a8bb4 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Updated VIF entry in instance network info cache for port 226ec889-a303-45bf-93ea-14bf6d11a1f6. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:48:20 user nova-compute[72849]: DEBUG nova.network.neutron [req-527b26f6-c313-4003-9735-80689e632d29 req-c2e48586-b953-42ed-8cc7-d364d02a8bb4 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Updating instance_info_cache with network_info: [{"id": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "address": "fa:16:3e:5c:59:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ec889-a3", "ovs_interfaceid": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:48:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-527b26f6-c313-4003-9735-80689e632d29 req-c2e48586-b953-42ed-8cc7-d364d02a8bb4 service nova] Releasing lock "refresh_cache-d565ed95-6f62-4948-a1da-7131ec7e799b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:48:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:48:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:48:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:48:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:48:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:48:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:48:28 user nova-compute[72849]: INFO nova.compute.claims [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Claim successful on node user
Aug 15 16:48:29 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:48:29 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:48:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:48:29 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:48:29 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:48:29 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:48:29 user nova-compute[72849]: DEBUG nova.network.neutron [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:48:29 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:48:29 user nova-compute[72849]: INFO nova.virt.block_device [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Booting with volume snapshot 858c5674-a70e-432e-bac9-1a75b5d5cc0b at /dev/vda
Aug 15 16:48:29 user nova-compute[72849]: DEBUG nova.policy [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe3f48f280e54c2099e6b1db842db2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87edcbec784a4f65b99740f34ff121bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:48:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:30 user nova-compute[72849]: DEBUG nova.network.neutron [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Successfully created port: 050bda2e-dc4e-4b65-a62c-723f8339e06e {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:48:31 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692118096.1150813, 85da743e-e2c7-42c1-8621-f9942e115b01 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:48:31 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] VM Stopped (Lifecycle Event)
Aug 15 16:48:31 user nova-compute[72849]: DEBUG nova.compute.manager [None req-8cee6e45-8094-424e-8fa9-343330d8cd64 None None] [instance: 85da743e-e2c7-42c1-8621-f9942e115b01] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:48:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:31 user nova-compute[72849]: DEBUG nova.network.neutron [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Successfully updated port: 050bda2e-dc4e-4b65-a62c-723f8339e06e {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:48:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "refresh_cache-cc249cfe-1ee7-4d32-b960-628fd77d07a4" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:48:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquired lock "refresh_cache-cc249cfe-1ee7-4d32-b960-628fd77d07a4" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:48:31 user nova-compute[72849]: DEBUG nova.network.neutron [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:48:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-2bb63e2f-af25-468e-9272-a74595f2db9b req-319cadff-18be-4e20-a133-ae5ab4223c6a service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Received event network-changed-050bda2e-dc4e-4b65-a62c-723f8339e06e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:48:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-2bb63e2f-af25-468e-9272-a74595f2db9b req-319cadff-18be-4e20-a133-ae5ab4223c6a service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Refreshing instance network info cache due to event network-changed-050bda2e-dc4e-4b65-a62c-723f8339e06e. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:48:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2bb63e2f-af25-468e-9272-a74595f2db9b req-319cadff-18be-4e20-a133-ae5ab4223c6a service nova] Acquiring lock "refresh_cache-cc249cfe-1ee7-4d32-b960-628fd77d07a4" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:48:31 user nova-compute[72849]: DEBUG nova.network.neutron [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:48:31 user nova-compute[72849]: DEBUG nova.network.neutron [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Updating instance_info_cache with network_info: [{"id": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "address": "fa:16:3e:18:6e:83", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050bda2e-dc", "ovs_interfaceid": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:48:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Releasing lock "refresh_cache-cc249cfe-1ee7-4d32-b960-628fd77d07a4" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:48:31 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Instance network_info: |[{"id": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "address": "fa:16:3e:18:6e:83", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050bda2e-dc", "ovs_interfaceid": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:48:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2bb63e2f-af25-468e-9272-a74595f2db9b req-319cadff-18be-4e20-a133-ae5ab4223c6a service nova] Acquired lock "refresh_cache-cc249cfe-1ee7-4d32-b960-628fd77d07a4" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:48:31 user nova-compute[72849]: DEBUG nova.network.neutron [req-2bb63e2f-af25-468e-9272-a74595f2db9b req-319cadff-18be-4e20-a133-ae5ab4223c6a service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Refreshing network info cache for port 050bda2e-dc4e-4b65-a62c-723f8339e06e {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:48:32 user nova-compute[72849]: DEBUG nova.network.neutron [req-2bb63e2f-af25-468e-9272-a74595f2db9b req-319cadff-18be-4e20-a133-ae5ab4223c6a service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Updated VIF entry in instance network info cache for port 050bda2e-dc4e-4b65-a62c-723f8339e06e. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:48:32 user nova-compute[72849]: DEBUG nova.network.neutron [req-2bb63e2f-af25-468e-9272-a74595f2db9b req-319cadff-18be-4e20-a133-ae5ab4223c6a service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Updating instance_info_cache with network_info: [{"id": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "address": "fa:16:3e:18:6e:83", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050bda2e-dc", "ovs_interfaceid": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:48:32 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-2bb63e2f-af25-468e-9272-a74595f2db9b req-319cadff-18be-4e20-a133-ae5ab4223c6a service nova] Releasing lock "refresh_cache-cc249cfe-1ee7-4d32-b960-628fd77d07a4" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:48:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG os_brick.utils [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[51950307-091c-437f-8360-292db68470f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[be94261e-4be5-44df-869f-faceaa7e6e39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.049s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0abf162-ce8f-441d-91c8-9150e7c85cdc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0792fbc3-9483-4d80-a8c7-fa1193cda7a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:48:35 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:48:35 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[144d1ca2-e1ee-4fd4-8e2f-41cd346556e8]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG os_brick.utils [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:48:35 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Updating existing volume attachment record: f8ac9de4-c183-4337-ba7d-22e7bdfc5210 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:48:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:48:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:48:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:48:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:48:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:43 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-d565ed95-6f62-4948-a1da-7131ec7e799b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-d565ed95-6f62-4948-a1da-7131ec7e799b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:48:44 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Creating image(s)
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Did not create local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Ensure instance console log exists: /opt/stack/data/nova/instances/cc249cfe-1ee7-4d32-b960-628fd77d07a4/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Start _get_guest_xml network_info=[{"id": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "address": "fa:16:3e:18:6e:83", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050bda2e-dc", "ovs_interfaceid": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-15T16:48:19Z,direct_url=<?>,disk_format='qcow2',id=3715755e-1cd0-469d-8f60-2025ac2deb67,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-679647656',owner='87edcbec784a4f65b99740f34ff121bb',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-15T16:48:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aSFfhkPI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cc249cfe-1ee7-4d32-b960-628fd77d07a4', 'attached_at': '', 'detached_at': '', 'volume_id': 'c54dae5e-528e-4382-9959-ccdcbfbf6768', 'serial': 'c54dae5e-528e-4382-9959-ccdcbfbf6768'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'f8ac9de4-c183-4337-ba7d-22e7bdfc5210', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:48:44 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:48:44 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-15T16:48:19Z,direct_url=<?>,disk_format='qcow2',id=3715755e-1cd0-469d-8f60-2025ac2deb67,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-679647656',owner='87edcbec784a4f65b99740f34ff121bb',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-15T16:48:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aSFfhkPI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:48:44 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:48:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:48:44 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:48:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:48:44 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:48:45 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Updating instance_info_cache with network_info: [{"id": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "address": "fa:16:3e:5c:59:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ec889-a3", "ovs_interfaceid": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e96ace9-c23f-4cb3-9cf6-75430a343a97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:48:45 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-d565ed95-6f62-4948-a1da-7131ec7e799b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c28308-fd4e-4110-9781-af9e59f22e29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768] added
Aug 15 16:48:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.056s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a2b370-8a65-4f54-b877-bc2c867ba9e2]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0051a2f3-49fd-4946-946c-bbca0d0f2a70]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aSFfhkPI {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aSFfhkPI" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[abba2559-ea1f-4e3d-8612-f87a85c7bac5]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aSFfhkPI'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5f6b91-003c-483b-9f92-7b4bc1844ba2]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ff7a69-2d15-49b9-9450-5eb484e09f02]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc (non-flash)
Aug 15 16:48:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc (non-flash)
Aug 15 16:48:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8100d46d-6627-42b8-9b88-51bf0c1eee4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768, portal: 172.16.0.220,3260]
Aug 15 16:48:45 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768, portal: 172.16.0.220,3260] successful.
Aug 15 16:48:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f5235f-b4c7-46f6-8f86-54cc03bb118c]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9dad1f-9bb6-4cc6-a5c2-9265e6d8beec]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc (non-flash)
Aug 15 16:48:45 user nova-compute[72849]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 (non-flash)
Aug 15 16:48:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc (non-flash)
Aug 15 16:48:45 user nova-compute[72849]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 (non-flash)
Aug 15 16:48:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fcbd2e-2bbb-46cc-96c6-e47685670f19]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:48:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aSFfhkPI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26439336464336532', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439336464336532', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:48:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1458424135',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1458424135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1458424135',id=49,image_ref='3715755e-1cd0-469d-8f60-2025ac2deb67',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyew872ebB6QRy866X5y6Hr3u2ekvc5m60Cvm2EY6kkZptEiVXnQ8PHJ46shW7votxxmdmZSbO/ltKuEp85oNyi2aF6ZctXHnoS645ID+6WHuajinxX7AoQVtNCkZ/Otg==',key_name='tempest-keypair-244237884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87edcbec784a4f65b99740f34ff121bb',ramdisk_id='',reservation_id='r-b74f7wir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1900922481',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1900922481',owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:48:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe3f48f280e54c2099e6b1db842db2cd',uuid=cc249cfe-1ee7-4d32-b960-628fd77d07a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "address": "fa:16:3e:18:6e:83", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050bda2e-dc", "ovs_interfaceid": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converting VIF {"id": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "address": "fa:16:3e:18:6e:83", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050bda2e-dc", "ovs_interfaceid": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:6e:83,bridge_name='br-int',has_traffic_filtering=True,id=050bda2e-dc4e-4b65-a62c-723f8339e06e,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap050bda2e-dc') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG nova.objects.instance [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lazy-loading 'pci_devices' on Instance uuid cc249cfe-1ee7-4d32-b960-628fd77d07a4 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:48:46 user nova-compute[72849]:   <uuid>cc249cfe-1ee7-4d32-b960-628fd77d07a4</uuid>
Aug 15 16:48:46 user nova-compute[72849]:   <name>instance-00000031</name>
Aug 15 16:48:46 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:48:46 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:48:46 user nova-compute[72849]:   <metadata>
Aug 15 16:48:46 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:48:46 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:48:46 user nova-compute[72849]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1458424135</nova:name>
Aug 15 16:48:46 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:48:44</nova:creationTime>
Aug 15 16:48:46 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:48:46 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:48:46 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:48:46 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:48:46 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:48:46 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:48:46 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:48:46 user nova-compute[72849]:       <nova:owner>
Aug 15 16:48:46 user nova-compute[72849]:         <nova:user uuid="fe3f48f280e54c2099e6b1db842db2cd">tempest-TestVolumeBootPattern-1900922481-project-member</nova:user>
Aug 15 16:48:46 user nova-compute[72849]:         <nova:project uuid="87edcbec784a4f65b99740f34ff121bb">tempest-TestVolumeBootPattern-1900922481</nova:project>
Aug 15 16:48:46 user nova-compute[72849]:       </nova:owner>
Aug 15 16:48:46 user nova-compute[72849]:       <nova:root type="image" uuid="3715755e-1cd0-469d-8f60-2025ac2deb67"/>
Aug 15 16:48:46 user nova-compute[72849]:       <nova:ports>
Aug 15 16:48:46 user nova-compute[72849]:         <nova:port uuid="050bda2e-dc4e-4b65-a62c-723f8339e06e">
Aug 15 16:48:46 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 16:48:46 user nova-compute[72849]:         </nova:port>
Aug 15 16:48:46 user nova-compute[72849]:       </nova:ports>
Aug 15 16:48:46 user nova-compute[72849]:     </nova:instance>
Aug 15 16:48:46 user nova-compute[72849]:   </metadata>
Aug 15 16:48:46 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:48:46 user nova-compute[72849]:     <system>
Aug 15 16:48:46 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:48:46 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:48:46 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:48:46 user nova-compute[72849]:       <entry name="serial">cc249cfe-1ee7-4d32-b960-628fd77d07a4</entry>
Aug 15 16:48:46 user nova-compute[72849]:       <entry name="uuid">cc249cfe-1ee7-4d32-b960-628fd77d07a4</entry>
Aug 15 16:48:46 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:48:46 user nova-compute[72849]:     </system>
Aug 15 16:48:46 user nova-compute[72849]:   </sysinfo>
Aug 15 16:48:46 user nova-compute[72849]:   <os>
Aug 15 16:48:46 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:48:46 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:48:46 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:48:46 user nova-compute[72849]:   </os>
Aug 15 16:48:46 user nova-compute[72849]:   <features>
Aug 15 16:48:46 user nova-compute[72849]:     <acpi/>
Aug 15 16:48:46 user nova-compute[72849]:     <apic/>
Aug 15 16:48:46 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:48:46 user nova-compute[72849]:   </features>
Aug 15 16:48:46 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:48:46 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:48:46 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:48:46 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:48:46 user nova-compute[72849]:   </clock>
Aug 15 16:48:46 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:48:46 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:48:46 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:48:46 user nova-compute[72849]:   </cpu>
Aug 15 16:48:46 user nova-compute[72849]:   <devices>
Aug 15 16:48:46 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:48:46 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:48:46 user nova-compute[72849]:       <source dev="/dev/sdb"/>
Aug 15 16:48:46 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:48:46 user nova-compute[72849]:       <serial>c54dae5e-528e-4382-9959-ccdcbfbf6768</serial>
Aug 15 16:48:46 user nova-compute[72849]:     </disk>
Aug 15 16:48:46 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:48:46 user nova-compute[72849]:       <mac address="fa:16:3e:18:6e:83"/>
Aug 15 16:48:46 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:48:46 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:48:46 user nova-compute[72849]:       <target dev="tap050bda2e-dc"/>
Aug 15 16:48:46 user nova-compute[72849]:     </interface>
Aug 15 16:48:46 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:48:46 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/cc249cfe-1ee7-4d32-b960-628fd77d07a4/console.log" append="off"/>
Aug 15 16:48:46 user nova-compute[72849]:     </serial>
Aug 15 16:48:46 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:48:46 user nova-compute[72849]:     <video>
Aug 15 16:48:46 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:48:46 user nova-compute[72849]:     </video>
Aug 15 16:48:46 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:48:46 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:48:46 user nova-compute[72849]:     </rng>
Aug 15 16:48:46 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:48:46 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:48:46 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:48:46 user nova-compute[72849]:     </memballoon>
Aug 15 16:48:46 user nova-compute[72849]:   </devices>
Aug 15 16:48:46 user nova-compute[72849]: </domain>
Aug 15 16:48:46 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:48:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1458424135',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1458424135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1458424135',id=49,image_ref='3715755e-1cd0-469d-8f60-2025ac2deb67',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyew872ebB6QRy866X5y6Hr3u2ekvc5m60Cvm2EY6kkZptEiVXnQ8PHJ46shW7votxxmdmZSbO/ltKuEp85oNyi2aF6ZctXHnoS645ID+6WHuajinxX7AoQVtNCkZ/Otg==',key_name='tempest-keypair-244237884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87edcbec784a4f65b99740f34ff121bb',ramdisk_id='',reservation_id='r-b74f7wir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1900922481',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1900922481',owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:48:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe3f48f280e54c2099e6b1db842db2cd',uuid=cc249cfe-1ee7-4d32-b960-628fd77d07a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "address": "fa:16:3e:18:6e:83", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050bda2e-dc", "ovs_interfaceid": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converting VIF {"id": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "address": "fa:16:3e:18:6e:83", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050bda2e-dc", "ovs_interfaceid": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:6e:83,bridge_name='br-int',has_traffic_filtering=True,id=050bda2e-dc4e-4b65-a62c-723f8339e06e,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap050bda2e-dc') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG os_vif [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:6e:83,bridge_name='br-int',has_traffic_filtering=True,id=050bda2e-dc4e-4b65-a62c-723f8339e06e,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap050bda2e-dc') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap050bda2e-dc, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap050bda2e-dc, col_values=(('external_ids', {'iface-id': '050bda2e-dc4e-4b65-a62c-723f8339e06e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:6e:83', 'vm-uuid': 'cc249cfe-1ee7-4d32-b960-628fd77d07a4'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:46 user nova-compute[72849]: INFO os_vif [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:6e:83,bridge_name='br-int',has_traffic_filtering=True,id=050bda2e-dc4e-4b65-a62c-723f8339e06e,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap050bda2e-dc')
Aug 15 16:48:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:48:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] No VIF found with MAC fa:16:3e:18:6e:83, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:48:47 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:48:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:47 user nova-compute[72849]: DEBUG nova.compute.manager [req-7e12bda3-77cb-4eec-b6cb-9bd779ae0548 req-f55305a6-bca1-47f7-9280-6e1ef17290ae service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Received event network-vif-plugged-050bda2e-dc4e-4b65-a62c-723f8339e06e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:48:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7e12bda3-77cb-4eec-b6cb-9bd779ae0548 req-f55305a6-bca1-47f7-9280-6e1ef17290ae service nova] Acquiring lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:48:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7e12bda3-77cb-4eec-b6cb-9bd779ae0548 req-f55305a6-bca1-47f7-9280-6e1ef17290ae service nova] Lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:48:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-7e12bda3-77cb-4eec-b6cb-9bd779ae0548 req-f55305a6-bca1-47f7-9280-6e1ef17290ae service nova] Lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:48:47 user nova-compute[72849]: DEBUG nova.compute.manager [req-7e12bda3-77cb-4eec-b6cb-9bd779ae0548 req-f55305a6-bca1-47f7-9280-6e1ef17290ae service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] No waiting events found dispatching network-vif-plugged-050bda2e-dc4e-4b65-a62c-723f8339e06e {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:48:48 user nova-compute[72849]: WARNING nova.compute.manager [req-7e12bda3-77cb-4eec-b6cb-9bd779ae0548 req-f55305a6-bca1-47f7-9280-6e1ef17290ae service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Received unexpected event network-vif-plugged-050bda2e-dc4e-4b65-a62c-723f8339e06e for instance with vm_state building and task_state spawning.
Aug 15 16:48:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:49 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:48:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:49 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692118129.898467, cc249cfe-1ee7-4d32-b960-628fd77d07a4 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:48:49 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] VM Resumed (Lifecycle Event)
Aug 15 16:48:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:48:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:48:49 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Instance spawned successfully.
Aug 15 16:48:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:48:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:48:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:48:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:48:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:48:49 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:48:49 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692118129.9009607, cc249cfe-1ee7-4d32-b960-628fd77d07a4 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:48:49 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] VM Started (Lifecycle Event)
Aug 15 16:48:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:48:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:48:50 user nova-compute[72849]: INFO nova.compute.manager [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Took 5.11 seconds to spawn the instance on the hypervisor.
Aug 15 16:48:50 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:48:50 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:48:50 user nova-compute[72849]: DEBUG nova.compute.manager [req-b3c71fce-0d75-466b-9291-7ec6d9acf07a req-e0fad7b7-83ff-42d8-8e43-9f0ac3364efd service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Received event network-vif-plugged-050bda2e-dc4e-4b65-a62c-723f8339e06e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b3c71fce-0d75-466b-9291-7ec6d9acf07a req-e0fad7b7-83ff-42d8-8e43-9f0ac3364efd service nova] Acquiring lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b3c71fce-0d75-466b-9291-7ec6d9acf07a req-e0fad7b7-83ff-42d8-8e43-9f0ac3364efd service nova] Lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b3c71fce-0d75-466b-9291-7ec6d9acf07a req-e0fad7b7-83ff-42d8-8e43-9f0ac3364efd service nova] Lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG nova.compute.manager [req-b3c71fce-0d75-466b-9291-7ec6d9acf07a req-e0fad7b7-83ff-42d8-8e43-9f0ac3364efd service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] No waiting events found dispatching network-vif-plugged-050bda2e-dc4e-4b65-a62c-723f8339e06e {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:48:50 user nova-compute[72849]: WARNING nova.compute.manager [req-b3c71fce-0d75-466b-9291-7ec6d9acf07a req-e0fad7b7-83ff-42d8-8e43-9f0ac3364efd service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Received unexpected event network-vif-plugged-050bda2e-dc4e-4b65-a62c-723f8339e06e for instance with vm_state building and task_state spawning.
Aug 15 16:48:50 user nova-compute[72849]: INFO nova.compute.manager [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Took 21.17 seconds to build instance.
Aug 15 16:48:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0fce379c-34fd-44f2-8e65-43cc3350b79a tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.274s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.003s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:48:50 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:48:50 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:48:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8582MB free_disk=25.2301025390625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance d565ed95-6f62-4948-a1da-7131ec7e799b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc249cfe-1ee7-4d32-b960-628fd77d07a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:48:50 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:48:51 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:48:51 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:48:51 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:48:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:48:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:55 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:48:55 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:48:55 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:48:56 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:48:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:48:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:48:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:48:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:48:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:48:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:48:57 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:49:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:49:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:49:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:49:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:49:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:49:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:49:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:49:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:49:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:49:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:49:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:49:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:49:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:49:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:49:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:49:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:49:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:49:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:49:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:49:44 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:49:45 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:49:45 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:49:45 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:49:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-d565ed95-6f62-4948-a1da-7131ec7e799b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:49:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-d565ed95-6f62-4948-a1da-7131ec7e799b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:49:45 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:49:45 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid d565ed95-6f62-4948-a1da-7131ec7e799b {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:49:45 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Updating instance_info_cache with network_info: [{"id": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "address": "fa:16:3e:5c:59:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ec889-a3", "ovs_interfaceid": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:49:45 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-d565ed95-6f62-4948-a1da-7131ec7e799b" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:49:45 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:49:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:49:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:49:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:49:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:49:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:49:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:49:49 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:49:50 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:49:51 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:49:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:49:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:49:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:49:51 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:49:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:49:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:49:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:49:51 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:49:51 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:49:51 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8622MB free_disk=25.227378845214844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:49:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:49:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:49:51 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance d565ed95-6f62-4948-a1da-7131ec7e799b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:49:51 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance cc249cfe-1ee7-4d32-b960-628fd77d07a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:49:51 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:49:51 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:49:51 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:49:51 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:49:51 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:49:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:49:52 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:49:54 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:49:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:49:57 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:49:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:49:59 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:50:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:50:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:50:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-eb494304-ec7d-4e10-af50-3e73ed3f126e req-74f87734-9512-4acd-9f57-1a4e9452f6f0 service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Received event network-changed-050bda2e-dc4e-4b65-a62c-723f8339e06e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:50:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-eb494304-ec7d-4e10-af50-3e73ed3f126e req-74f87734-9512-4acd-9f57-1a4e9452f6f0 service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Refreshing instance network info cache due to event network-changed-050bda2e-dc4e-4b65-a62c-723f8339e06e. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:50:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eb494304-ec7d-4e10-af50-3e73ed3f126e req-74f87734-9512-4acd-9f57-1a4e9452f6f0 service nova] Acquiring lock "refresh_cache-cc249cfe-1ee7-4d32-b960-628fd77d07a4" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:50:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eb494304-ec7d-4e10-af50-3e73ed3f126e req-74f87734-9512-4acd-9f57-1a4e9452f6f0 service nova] Acquired lock "refresh_cache-cc249cfe-1ee7-4d32-b960-628fd77d07a4" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:50:20 user nova-compute[72849]: DEBUG nova.network.neutron [req-eb494304-ec7d-4e10-af50-3e73ed3f126e req-74f87734-9512-4acd-9f57-1a4e9452f6f0 service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Refreshing network info cache for port 050bda2e-dc4e-4b65-a62c-723f8339e06e {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:50:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:50:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.007s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:50:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:50:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:50:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:50:20 user nova-compute[72849]: INFO nova.compute.manager [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Terminating instance
Aug 15 16:50:20 user nova-compute[72849]: DEBUG nova.compute.manager [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:50:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:20 user nova-compute[72849]: DEBUG nova.network.neutron [req-eb494304-ec7d-4e10-af50-3e73ed3f126e req-74f87734-9512-4acd-9f57-1a4e9452f6f0 service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Updated VIF entry in instance network info cache for port 050bda2e-dc4e-4b65-a62c-723f8339e06e. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:50:20 user nova-compute[72849]: DEBUG nova.network.neutron [req-eb494304-ec7d-4e10-af50-3e73ed3f126e req-74f87734-9512-4acd-9f57-1a4e9452f6f0 service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Updating instance_info_cache with network_info: [{"id": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "address": "fa:16:3e:18:6e:83", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050bda2e-dc", "ovs_interfaceid": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:50:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-eb494304-ec7d-4e10-af50-3e73ed3f126e req-74f87734-9512-4acd-9f57-1a4e9452f6f0 service nova] Releasing lock "refresh_cache-cc249cfe-1ee7-4d32-b960-628fd77d07a4" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-3fe76389-343e-4ef5-a21a-0f82b562747f req-53c64a75-41c8-45b6-8d81-56cce83430cc service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Received event network-vif-unplugged-050bda2e-dc4e-4b65-a62c-723f8339e06e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3fe76389-343e-4ef5-a21a-0f82b562747f req-53c64a75-41c8-45b6-8d81-56cce83430cc service nova] Acquiring lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3fe76389-343e-4ef5-a21a-0f82b562747f req-53c64a75-41c8-45b6-8d81-56cce83430cc service nova] Lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3fe76389-343e-4ef5-a21a-0f82b562747f req-53c64a75-41c8-45b6-8d81-56cce83430cc service nova] Lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-3fe76389-343e-4ef5-a21a-0f82b562747f req-53c64a75-41c8-45b6-8d81-56cce83430cc service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] No waiting events found dispatching network-vif-unplugged-050bda2e-dc4e-4b65-a62c-723f8339e06e {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-3fe76389-343e-4ef5-a21a-0f82b562747f req-53c64a75-41c8-45b6-8d81-56cce83430cc service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Received event network-vif-unplugged-050bda2e-dc4e-4b65-a62c-723f8339e06e for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:21 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Instance destroyed successfully.
Aug 15 16:50:21 user nova-compute[72849]: DEBUG nova.objects.instance [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lazy-loading 'resources' on Instance uuid cc249cfe-1ee7-4d32-b960-628fd77d07a4 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:48:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1458424135',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1458424135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1458424135',id=49,image_ref='3715755e-1cd0-469d-8f60-2025ac2deb67',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyew872ebB6QRy866X5y6Hr3u2ekvc5m60Cvm2EY6kkZptEiVXnQ8PHJ46shW7votxxmdmZSbO/ltKuEp85oNyi2aF6ZctXHnoS645ID+6WHuajinxX7AoQVtNCkZ/Otg==',key_name='tempest-keypair-244237884',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:48:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87edcbec784a4f65b99740f34ff121bb',ramdisk_id='',reservation_id='r-b74f7wir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1900922481',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1900922481',owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe3f48f280e54c2099e6b1db842db2cd',uuid=cc249cfe-1ee7-4d32-b960-628fd77d07a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "address": "fa:16:3e:18:6e:83", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050bda2e-dc", "ovs_interfaceid": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converting VIF {"id": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "address": "fa:16:3e:18:6e:83", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap050bda2e-dc", "ovs_interfaceid": "050bda2e-dc4e-4b65-a62c-723f8339e06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:6e:83,bridge_name='br-int',has_traffic_filtering=True,id=050bda2e-dc4e-4b65-a62c-723f8339e06e,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap050bda2e-dc') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_vif [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:6e:83,bridge_name='br-int',has_traffic_filtering=True,id=050bda2e-dc4e-4b65-a62c-723f8339e06e,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap050bda2e-dc') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap050bda2e-dc, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:50:21 user nova-compute[72849]: INFO os_vif [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:6e:83,bridge_name='br-int',has_traffic_filtering=True,id=050bda2e-dc4e-4b65-a62c-723f8339e06e,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap050bda2e-dc')
Aug 15 16:50:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aSFfhkPI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:50:21 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d88748-136b-4d63-b977-cf5a2db6fcf0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8012ada-cdee-4de5-a4e7-41caf555b843]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc (non-flash)
Aug 15 16:50:21 user nova-compute[72849]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 (non-flash)
Aug 15 16:50:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc (non-flash)
Aug 15 16:50:21 user nova-compute[72849]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 (non-flash)
Aug 15 16:50:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3581a5bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4c1c90-9c5a-45f4-9565-1644c4d04980]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca8700d-487b-4595-97f2-45a4f1fe2873]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3a8426-62e3-4505-bbe4-f1edb04065bd]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fe302b-31ae-46a8-b291-06b0568718db]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4ef3c009-d93dd3e2fbad10ff', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4ef3c009', '/dev/disk/by-id/scsi-26439336464336532') {{(pid=84060) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 16:50:21 user nova-compute[72849]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO4ef3c009-d93dd3e2fbad10ff
Aug 15 16:50:21 user nova-compute[72849]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_4ef3c009
Aug 15 16:50:21 user nova-compute[72849]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26439336464336532
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bd5fce-a362-454b-b0dc-82a132911635]: (4, None) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40a8d43-7961-49eb-9faf-2bb70f4aeea4]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[58226916-6dae-405f-8bac-e845dd79a08c]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768, portal: 172.16.0.220,3260]
Aug 15 16:50:21 user nova-compute[72849]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768, portal: 172.16.0.220,3260] successful.
Aug 15 16:50:21 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c54dae5e-528e-4382-9959-ccdcbfbf6768 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b104c1ca-4a2b-4629-94d4-86bc4d87d295]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] <== disconnect_volume: return (297ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:50:21 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Deleting instance files /opt/stack/data/nova/instances/cc249cfe-1ee7-4d32-b960-628fd77d07a4_del
Aug 15 16:50:21 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Deletion of /opt/stack/data/nova/instances/cc249cfe-1ee7-4d32-b960-628fd77d07a4_del complete
Aug 15 16:50:21 user nova-compute[72849]: INFO nova.compute.manager [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 15 16:50:21 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:22 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:50:22 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Took 0.78 seconds to deallocate network for instance.
Aug 15 16:50:23 user nova-compute[72849]: DEBUG nova.compute.manager [req-60dc7e3a-6892-4531-bfbf-92976acff87d req-8db115e0-02f2-469d-88f1-d133c48a0cfe service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Received event network-vif-plugged-050bda2e-dc4e-4b65-a62c-723f8339e06e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:50:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-60dc7e3a-6892-4531-bfbf-92976acff87d req-8db115e0-02f2-469d-88f1-d133c48a0cfe service nova] Acquiring lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:50:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-60dc7e3a-6892-4531-bfbf-92976acff87d req-8db115e0-02f2-469d-88f1-d133c48a0cfe service nova] Lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:50:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-60dc7e3a-6892-4531-bfbf-92976acff87d req-8db115e0-02f2-469d-88f1-d133c48a0cfe service nova] Lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:50:23 user nova-compute[72849]: DEBUG nova.compute.manager [req-60dc7e3a-6892-4531-bfbf-92976acff87d req-8db115e0-02f2-469d-88f1-d133c48a0cfe service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] No waiting events found dispatching network-vif-plugged-050bda2e-dc4e-4b65-a62c-723f8339e06e {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:50:23 user nova-compute[72849]: WARNING nova.compute.manager [req-60dc7e3a-6892-4531-bfbf-92976acff87d req-8db115e0-02f2-469d-88f1-d133c48a0cfe service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Received unexpected event network-vif-plugged-050bda2e-dc4e-4b65-a62c-723f8339e06e for instance with vm_state active and task_state deleting.
Aug 15 16:50:23 user nova-compute[72849]: DEBUG nova.compute.manager [req-60dc7e3a-6892-4531-bfbf-92976acff87d req-8db115e0-02f2-469d-88f1-d133c48a0cfe service nova] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Received event network-vif-deleted-050bda2e-dc4e-4b65-a62c-723f8339e06e {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:50:23 user nova-compute[72849]: INFO nova.compute.manager [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Took 0.73 seconds to detach 1 volumes for instance.
Aug 15 16:50:23 user nova-compute[72849]: DEBUG nova.compute.manager [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Deleting volume: c54dae5e-528e-4382-9959-ccdcbfbf6768 {{(pid=72849) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 16:50:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:50:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:50:23 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:50:23 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:50:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:50:23 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Deleted allocations for instance cc249cfe-1ee7-4d32-b960-628fd77d07a4
Aug 15 16:50:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-742d6b1e-19fd-4205-a680-58153bf6312f tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "cc249cfe-1ee7-4d32-b960-628fd77d07a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.108s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:50:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:50:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:50:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:50:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:50:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:50:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:36 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692118221.439239, cc249cfe-1ee7-4d32-b960-628fd77d07a4 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:50:36 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] VM Stopped (Lifecycle Event)
Aug 15 16:50:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ed40aba2-cdf7-4e38-903b-f1387663f234 None None] [instance: cc249cfe-1ee7-4d32-b960-628fd77d07a4] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:50:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:50:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:50:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:50:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:50:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:50:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:50:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:50:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:50:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:44 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:50:46 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:50:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:50:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Didn't find any instances for network info cache update. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 16:50:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:50:50 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:50:51 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:50:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:50:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:50:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:50:51 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:50:51 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:50:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:51 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:50:51 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:50:51 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8721MB free_disk=25.217803955078125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:50:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:50:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:50:51 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance d565ed95-6f62-4948-a1da-7131ec7e799b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:50:51 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:50:51 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:50:51 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:50:51 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:50:51 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:50:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:50:52 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:50:53 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:50:54 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:50:56 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:50:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:50:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:50:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:50:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:50:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:50:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:50:58 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:50:58 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:51:01 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:51:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:51:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:51:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:51:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:51:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:51:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:51:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:51:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:51:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "d565ed95-6f62-4948-a1da-7131ec7e799b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:51:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "d565ed95-6f62-4948-a1da-7131ec7e799b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:51:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "d565ed95-6f62-4948-a1da-7131ec7e799b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:51:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "d565ed95-6f62-4948-a1da-7131ec7e799b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:51:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "d565ed95-6f62-4948-a1da-7131ec7e799b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:51:16 user nova-compute[72849]: INFO nova.compute.manager [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Terminating instance
Aug 15 16:51:16 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:51:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:51:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:51:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:51:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:51:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:51:16 user nova-compute[72849]: DEBUG nova.compute.manager [req-9543ebb1-8c33-427b-9564-c49f0c83212a req-eeefa414-f60b-4ca5-abbf-82404e8a3e2a service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Received event network-vif-unplugged-226ec889-a303-45bf-93ea-14bf6d11a1f6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:51:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9543ebb1-8c33-427b-9564-c49f0c83212a req-eeefa414-f60b-4ca5-abbf-82404e8a3e2a service nova] Acquiring lock "d565ed95-6f62-4948-a1da-7131ec7e799b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:51:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9543ebb1-8c33-427b-9564-c49f0c83212a req-eeefa414-f60b-4ca5-abbf-82404e8a3e2a service nova] Lock "d565ed95-6f62-4948-a1da-7131ec7e799b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:51:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9543ebb1-8c33-427b-9564-c49f0c83212a req-eeefa414-f60b-4ca5-abbf-82404e8a3e2a service nova] Lock "d565ed95-6f62-4948-a1da-7131ec7e799b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:51:16 user nova-compute[72849]: DEBUG nova.compute.manager [req-9543ebb1-8c33-427b-9564-c49f0c83212a req-eeefa414-f60b-4ca5-abbf-82404e8a3e2a service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] No waiting events found dispatching network-vif-unplugged-226ec889-a303-45bf-93ea-14bf6d11a1f6 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:51:16 user nova-compute[72849]: DEBUG nova.compute.manager [req-9543ebb1-8c33-427b-9564-c49f0c83212a req-eeefa414-f60b-4ca5-abbf-82404e8a3e2a service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Received event network-vif-unplugged-226ec889-a303-45bf-93ea-14bf6d11a1f6 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:51:17 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Instance destroyed successfully.
Aug 15 16:51:17 user nova-compute[72849]: DEBUG nova.objects.instance [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lazy-loading 'resources' on Instance uuid d565ed95-6f62-4948-a1da-7131ec7e799b {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-623490894',display_name='tempest-TestVolumeBootPattern-volume-backed-server-623490894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-623490894',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuKoLKLKkLfi68DUuF66ZF1UtVTkKXhtTV53jjHwxsjGpCsCJqheAV2p7tkYJQkT8d3gp9N+MgUNTE7fMpeQOK6ysn464fZzreiLkeZsd+iwyKWhwY12eqROkUcIMRlWQ==',key_name='tempest-keypair-1796876014',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:46:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87edcbec784a4f65b99740f34ff121bb',ramdisk_id='',reservation_id='r-89upasnx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1900922481',owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:46:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe3f48f280e54c2099e6b1db842db2cd',uuid=d565ed95-6f62-4948-a1da-7131ec7e799b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "address": "fa:16:3e:5c:59:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ec889-a3", "ovs_interfaceid": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converting VIF {"id": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "address": "fa:16:3e:5c:59:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226ec889-a3", "ovs_interfaceid": "226ec889-a303-45bf-93ea-14bf6d11a1f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:59:16,bridge_name='br-int',has_traffic_filtering=True,id=226ec889-a303-45bf-93ea-14bf6d11a1f6,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226ec889-a3') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_vif [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:59:16,bridge_name='br-int',has_traffic_filtering=True,id=226ec889-a303-45bf-93ea-14bf6d11a1f6,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226ec889-a3') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap226ec889-a3, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:51:17 user nova-compute[72849]: INFO os_vif [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:59:16,bridge_name='br-int',has_traffic_filtering=True,id=226ec889-a303-45bf-93ea-14bf6d11a1f6,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226ec889-a3')
Aug 15 16:51:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsciIZQE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:51:17 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3d61fd-9bed-4a1c-b67a-504fa646e45b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75bfc033-8807-47b2-9ff2-d01bcd1f451f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8909faf-eca3-4bce-a21a-992e38165beb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ffe4fc-d59d-4dad-a584-a9a18602446b]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75bfc033-8807-47b2-9ff2-d01bcd1f451f (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8909faf-eca3-4bce-a21a-992e38165beb (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc (non-flash)
Aug 15 16:51:17 user nova-compute[72849]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75bfc033-8807-47b2-9ff2-d01bcd1f451f (non-flash)
Aug 15 16:51:17 user nova-compute[72849]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8909faf-eca3-4bce-a21a-992e38165beb (non-flash)
Aug 15 16:51:17 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc (non-flash)
Aug 15 16:51:17 user nova-compute[72849]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75bfc033-8807-47b2-9ff2-d01bcd1f451f (non-flash)
Aug 15 16:51:17 user nova-compute[72849]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8909faf-eca3-4bce-a21a-992e38165beb (non-flash)
Aug 15 16:51:17 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc338660ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc'): ({'sdc'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Removing single pathed devices sdc {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[816d76f8-ca4c-48bd-a839-0b45f5d1cee5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc92fa73-9d50-442b-b70f-80d2a40bad1b]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Flushing IO for device /dev/sdc {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[02702fc9-55cc-4e32-8ee7-56b5eee0c02f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1580b4c-7b06-4806-9566-70a14af1fe34]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30e7b8b-99fe-4f5b-a64a-7a38ba8d09f2]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9398d8c-3315-4b0b-b56c-15d4805e555e]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc, portal: 172.16.0.220,3260]
Aug 15 16:51:17 user nova-compute[72849]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc, portal: 172.16.0.220,3260] successful.
Aug 15 16:51:17 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e5c524-70fb-48a2-bae9-fa9b81f760bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9e897c-74d2-41a6-8164-0a8f73eb7507]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] <== disconnect_volume: return (306ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:51:17 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Deleting instance files /opt/stack/data/nova/instances/d565ed95-6f62-4948-a1da-7131ec7e799b_del
Aug 15 16:51:17 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Deletion of /opt/stack/data/nova/instances/d565ed95-6f62-4948-a1da-7131ec7e799b_del complete
Aug 15 16:51:17 user nova-compute[72849]: INFO nova.compute.manager [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 15 16:51:17 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:51:17 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:51:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-1458832f-8fee-4cd8-964c-527680f69356 req-cfe89c7e-f0a9-4527-8f51-80139a4430b9 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Received event network-vif-plugged-226ec889-a303-45bf-93ea-14bf6d11a1f6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:51:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1458832f-8fee-4cd8-964c-527680f69356 req-cfe89c7e-f0a9-4527-8f51-80139a4430b9 service nova] Acquiring lock "d565ed95-6f62-4948-a1da-7131ec7e799b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:51:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1458832f-8fee-4cd8-964c-527680f69356 req-cfe89c7e-f0a9-4527-8f51-80139a4430b9 service nova] Lock "d565ed95-6f62-4948-a1da-7131ec7e799b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:51:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1458832f-8fee-4cd8-964c-527680f69356 req-cfe89c7e-f0a9-4527-8f51-80139a4430b9 service nova] Lock "d565ed95-6f62-4948-a1da-7131ec7e799b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:51:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-1458832f-8fee-4cd8-964c-527680f69356 req-cfe89c7e-f0a9-4527-8f51-80139a4430b9 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] No waiting events found dispatching network-vif-plugged-226ec889-a303-45bf-93ea-14bf6d11a1f6 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:51:18 user nova-compute[72849]: WARNING nova.compute.manager [req-1458832f-8fee-4cd8-964c-527680f69356 req-cfe89c7e-f0a9-4527-8f51-80139a4430b9 service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Received unexpected event network-vif-plugged-226ec889-a303-45bf-93ea-14bf6d11a1f6 for instance with vm_state active and task_state deleting.
Aug 15 16:51:19 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:51:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-0e50c39a-1356-4be6-867a-9eac37b8d9fd req-b7524a3e-31e3-4efc-89d8-553fb631e40c service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Received event network-vif-deleted-226ec889-a303-45bf-93ea-14bf6d11a1f6 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:51:19 user nova-compute[72849]: INFO nova.compute.manager [req-0e50c39a-1356-4be6-867a-9eac37b8d9fd req-b7524a3e-31e3-4efc-89d8-553fb631e40c service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Neutron deleted interface 226ec889-a303-45bf-93ea-14bf6d11a1f6; detaching it from the instance and deleting it from the info cache
Aug 15 16:51:19 user nova-compute[72849]: DEBUG nova.network.neutron [req-0e50c39a-1356-4be6-867a-9eac37b8d9fd req-b7524a3e-31e3-4efc-89d8-553fb631e40c service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:51:19 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Took 1.40 seconds to deallocate network for instance.
Aug 15 16:51:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-0e50c39a-1356-4be6-867a-9eac37b8d9fd req-b7524a3e-31e3-4efc-89d8-553fb631e40c service nova] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Detach interface failed, port_id=226ec889-a303-45bf-93ea-14bf6d11a1f6, reason: Instance d565ed95-6f62-4948-a1da-7131ec7e799b could not be found. {{(pid=72849) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 16:51:19 user nova-compute[72849]: INFO nova.compute.manager [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Took 0.76 seconds to detach 1 volumes for instance.
Aug 15 16:51:20 user nova-compute[72849]: DEBUG nova.compute.manager [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Deleting volume: d4e5c524-70fb-48a2-bae9-fa9b81f760bc {{(pid=72849) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 16:51:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:51:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:51:20 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:51:20 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:51:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:51:20 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Deleted allocations for instance d565ed95-6f62-4948-a1da-7131ec7e799b
Aug 15 16:51:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-c15fcfee-f74c-413c-b143-7a0726712860 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "d565ed95-6f62-4948-a1da-7131ec7e799b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.775s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:51:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:51:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:51:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:51:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:51:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:51:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:51:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:51:32 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692118277.3757365, d565ed95-6f62-4948-a1da-7131ec7e799b => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:51:32 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] VM Stopped (Lifecycle Event)
Aug 15 16:51:32 user nova-compute[72849]: DEBUG nova.compute.manager [None req-45b476b0-8cde-48f1-9473-bc0eda44856e None None] [instance: d565ed95-6f62-4948-a1da-7131ec7e799b] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:51:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:51:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:51:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:51:45 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:51:46 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:51:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:51:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:51:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Didn't find any instances for network info cache update. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 16:51:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:51:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:51:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:51:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:51:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:51:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:51:52 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:51:52 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:51:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:51:53 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:51:53 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:51:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:51:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:51:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:51:53 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:51:53 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:51:53 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:51:53 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8854MB free_disk=25.216121673583984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:51:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:51:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:51:53 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:51:53 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:51:53 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:51:53 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:51:53 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:51:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:51:56 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:51:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:00 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:52:00 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:52:02 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:52:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:52:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:52:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:52:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:52:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:52:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:52:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:52:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:52:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:52:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:52:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:52:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Verify base images {{(pid=72849) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 15 16:52:13 user nova-compute[72849]: WARNING nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Unknown base file: /opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e
Aug 15 16:52:13 user nova-compute[72849]: WARNING nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a6d35f0f6b941ddf8c27e3e1154eb3e13855c955
Aug 15 16:52:13 user nova-compute[72849]: WARNING nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Unknown base file: /opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858
Aug 15 16:52:13 user nova-compute[72849]: WARNING nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Unknown base file: /opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3
Aug 15 16:52:13 user nova-compute[72849]: WARNING nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374
Aug 15 16:52:13 user nova-compute[72849]: WARNING nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67
Aug 15 16:52:13 user nova-compute[72849]: WARNING nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a07cfa6a47a4b2823c50414f94d807dba68d324a
Aug 15 16:52:13 user nova-compute[72849]: WARNING nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3a8dc7acd339b1c29a17068871cefe19059c16ed
Aug 15 16:52:13 user nova-compute[72849]: WARNING nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd
Aug 15 16:52:13 user nova-compute[72849]: WARNING nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784
Aug 15 16:52:13 user nova-compute[72849]: INFO nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Removable base files: /opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e /opt/stack/data/nova/instances/_base/a6d35f0f6b941ddf8c27e3e1154eb3e13855c955 /opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858 /opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3 /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 /opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67 /opt/stack/data/nova/instances/_base/a07cfa6a47a4b2823c50414f94d807dba68d324a /opt/stack/data/nova/instances/_base/3a8dc7acd339b1c29a17068871cefe19059c16ed /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd /opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784
Aug 15 16:52:13 user nova-compute[72849]: INFO nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/40180a2dd9644b85ec6b0fe098ecdced7fd9ae8e
Aug 15 16:52:13 user nova-compute[72849]: INFO nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a6d35f0f6b941ddf8c27e3e1154eb3e13855c955
Aug 15 16:52:13 user nova-compute[72849]: INFO nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/80c52bfad9db378496e6680225be6aad486b5858
Aug 15 16:52:13 user nova-compute[72849]: INFO nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/373bd9fa5fba49f160b4aec32986cbd35921a0d3
Aug 15 16:52:13 user nova-compute[72849]: INFO nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374
Aug 15 16:52:13 user nova-compute[72849]: INFO nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4accd05796863797750940347dc9da9e7d064b67
Aug 15 16:52:13 user nova-compute[72849]: INFO nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a07cfa6a47a4b2823c50414f94d807dba68d324a
Aug 15 16:52:13 user nova-compute[72849]: INFO nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3a8dc7acd339b1c29a17068871cefe19059c16ed
Aug 15 16:52:13 user nova-compute[72849]: INFO nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1ad6c6e8c673325b9852ca2af02396dc1f376fdd
Aug 15 16:52:13 user nova-compute[72849]: INFO nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ad73ea786b3e534ec57424e6d8bc48dfd91cc784
Aug 15 16:52:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Verification complete {{(pid=72849) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 15 16:52:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Verify swap images {{(pid=72849) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 15 16:52:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.imagecache [None req-73033403-2388-433c-826a-1227b87393f7 None None] Verify ephemeral images {{(pid=72849) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 15 16:52:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:52:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:52:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:52:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:52:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "68d5fd35-5430-486a-918c-ee215f81c7a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:52:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "68d5fd35-5430-486a-918c-ee215f81c7a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:52:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:52:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:52:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:52:19 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:52:19 user nova-compute[72849]: INFO nova.compute.claims [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Claim successful on node user
Aug 15 16:52:19 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:52:19 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:52:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.184s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:52:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:52:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:52:19 user nova-compute[72849]: DEBUG nova.network.neutron [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:52:20 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:52:20 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:52:20 user nova-compute[72849]: INFO nova.virt.block_device [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Booting with volume 57d73236-1389-4b02-b2d8-5f397f18a05c at /dev/vda
Aug 15 16:52:20 user nova-compute[72849]: DEBUG nova.policy [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe3f48f280e54c2099e6b1db842db2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87edcbec784a4f65b99740f34ff121bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG os_brick.utils [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c35e4f-c566-4cbe-b420-8674b363e40f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdd3f26-30b6-4def-9ed8-c86b39573b3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[131ebc0e-fa20-433e-bb6d-d93af385fd55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7bced2-4d0a-4125-b2c4-64ef32bb7a09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:52:20 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:52:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7dc9aa-5d53-446e-b20a-046b39a7d82e]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG os_brick.utils [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Updating existing volume attachment record: 62ec464c-714a-4fcc-a14f-bb961b5abc7b {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:52:20 user nova-compute[72849]: DEBUG nova.network.neutron [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Successfully created port: 74d2d77a-a67c-49bd-be56-77b88b404a74 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:52:21 user nova-compute[72849]: DEBUG nova.network.neutron [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Successfully updated port: 74d2d77a-a67c-49bd-be56-77b88b404a74 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:52:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "refresh_cache-68d5fd35-5430-486a-918c-ee215f81c7a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:52:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquired lock "refresh_cache-68d5fd35-5430-486a-918c-ee215f81c7a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:52:21 user nova-compute[72849]: DEBUG nova.network.neutron [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:52:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-9ca2d852-fd9a-43eb-9b1f-1f2ef21865ad req-5af1326f-44d3-4e36-a127-b0f980b116d0 service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Received event network-changed-74d2d77a-a67c-49bd-be56-77b88b404a74 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:52:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-9ca2d852-fd9a-43eb-9b1f-1f2ef21865ad req-5af1326f-44d3-4e36-a127-b0f980b116d0 service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Refreshing instance network info cache due to event network-changed-74d2d77a-a67c-49bd-be56-77b88b404a74. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:52:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9ca2d852-fd9a-43eb-9b1f-1f2ef21865ad req-5af1326f-44d3-4e36-a127-b0f980b116d0 service nova] Acquiring lock "refresh_cache-68d5fd35-5430-486a-918c-ee215f81c7a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:52:21 user nova-compute[72849]: DEBUG nova.network.neutron [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:52:22 user nova-compute[72849]: DEBUG nova.network.neutron [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Updating instance_info_cache with network_info: [{"id": "74d2d77a-a67c-49bd-be56-77b88b404a74", "address": "fa:16:3e:ae:26:c6", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d2d77a-a6", "ovs_interfaceid": "74d2d77a-a67c-49bd-be56-77b88b404a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:52:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Releasing lock "refresh_cache-68d5fd35-5430-486a-918c-ee215f81c7a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:52:22 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Instance network_info: |[{"id": "74d2d77a-a67c-49bd-be56-77b88b404a74", "address": "fa:16:3e:ae:26:c6", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d2d77a-a6", "ovs_interfaceid": "74d2d77a-a67c-49bd-be56-77b88b404a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:52:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9ca2d852-fd9a-43eb-9b1f-1f2ef21865ad req-5af1326f-44d3-4e36-a127-b0f980b116d0 service nova] Acquired lock "refresh_cache-68d5fd35-5430-486a-918c-ee215f81c7a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:52:22 user nova-compute[72849]: DEBUG nova.network.neutron [req-9ca2d852-fd9a-43eb-9b1f-1f2ef21865ad req-5af1326f-44d3-4e36-a127-b0f980b116d0 service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Refreshing network info cache for port 74d2d77a-a67c-49bd-be56-77b88b404a74 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:52:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:22 user nova-compute[72849]: DEBUG nova.network.neutron [req-9ca2d852-fd9a-43eb-9b1f-1f2ef21865ad req-5af1326f-44d3-4e36-a127-b0f980b116d0 service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Updated VIF entry in instance network info cache for port 74d2d77a-a67c-49bd-be56-77b88b404a74. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:52:22 user nova-compute[72849]: DEBUG nova.network.neutron [req-9ca2d852-fd9a-43eb-9b1f-1f2ef21865ad req-5af1326f-44d3-4e36-a127-b0f980b116d0 service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Updating instance_info_cache with network_info: [{"id": "74d2d77a-a67c-49bd-be56-77b88b404a74", "address": "fa:16:3e:ae:26:c6", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d2d77a-a6", "ovs_interfaceid": "74d2d77a-a67c-49bd-be56-77b88b404a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:52:22 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9ca2d852-fd9a-43eb-9b1f-1f2ef21865ad req-5af1326f-44d3-4e36-a127-b0f980b116d0 service nova] Releasing lock "refresh_cache-68d5fd35-5430-486a-918c-ee215f81c7a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:52:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:52:28 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Creating image(s)
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Did not create local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Ensure instance console log exists: /opt/stack/data/nova/instances/68d5fd35-5430-486a-918c-ee215f81c7a9/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Start _get_guest_xml network_info=[{"id": "74d2d77a-a67c-49bd-be56-77b88b404a74", "address": "fa:16:3e:ae:26:c6", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d2d77a-a6", "ovs_interfaceid": "74d2d77a-a67c-49bd-be56-77b88b404a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LFJDjyKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '68d5fd35-5430-486a-918c-ee215f81c7a9', 'attached_at': '', 'detached_at': '', 'volume_id': '57d73236-1389-4b02-b2d8-5f397f18a05c', 'serial': '57d73236-1389-4b02-b2d8-5f397f18a05c'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '62ec464c-714a-4fcc-a14f-bb961b5abc7b', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:52:28 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:52:28 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:52:28 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LFJDjyKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:52:29 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:52:29 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:52:29 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d59564-c474-4036-b05d-9adcf389a8b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:52:29 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3243e062-b3b9-4800-b597-9968abc84491]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c] added
Aug 15 16:52:29 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[041c7257-e006-4519-af26-508bd4d415d2]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4135737-ee00-4694-9242-c4a8fe3e03e6]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LFJDjyKs {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LFJDjyKs" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be03a0f-0346-4233-8d02-f38f4ce6b941]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LFJDjyKs'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[253c1e97-027a-4f5d-a9bc-04d391273db9]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40182a1-1602-4b6f-8af9-1609ed84c7cf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:52:29 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:52:29 user nova-compute[72849]:  {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:52:29 user nova-compute[72849]: WARNING os_brick.initiator.connectors.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 16:52:29 user nova-compute[72849]: 
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc606973-757f-4c0c-b513-87827d0a9e35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c, portal: 172.16.0.220,3260]
Aug 15 16:52:29 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c, portal: 172.16.0.220,3260] successful.
Aug 15 16:52:29 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[df061ce3-049b-4cea-a475-f2d8723a8ee9]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2562c762-5a2b-4b09-991b-49b5eb31ca1a]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)
Aug 15 16:52:29 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)
Aug 15 16:52:29 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2323a630-ef21-461c-8702-c7d28cb35336]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:52:29 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LFJDjyKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '26637353263633036', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637353263633036', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:52:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-149658121',display_name='tempest-TestVolumeBootPattern-server-149658121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-149658121',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFwEX72mp3NUKtYVln/Z+8GBwAx+xwvd9Fh1Mp2Wo1kGDe71MixlTitg7j4YrqUQjn7OCDU06CqQdMxxXQ6ba1l/e9gv1vFv9Hg9h2krod/tMNxb2w9GPXstWzAUISHAw==',key_name='tempest-TestVolumeBootPattern-1380441197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87edcbec784a4f65b99740f34ff121bb',ramdisk_id='',reservation_id='r-yqyjpkux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1900922481',owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:52:20Z,user_data=None,user_id='fe3f48f280e54c2099e6b1db842db2cd',uuid=68d5fd35-5430-486a-918c-ee215f81c7a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74d2d77a-a67c-49bd-be56-77b88b404a74", "address": "fa:16:3e:ae:26:c6", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d2d77a-a6", "ovs_interfaceid": "74d2d77a-a67c-49bd-be56-77b88b404a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converting VIF {"id": "74d2d77a-a67c-49bd-be56-77b88b404a74", "address": "fa:16:3e:ae:26:c6", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d2d77a-a6", "ovs_interfaceid": "74d2d77a-a67c-49bd-be56-77b88b404a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:26:c6,bridge_name='br-int',has_traffic_filtering=True,id=74d2d77a-a67c-49bd-be56-77b88b404a74,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74d2d77a-a6') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG nova.objects.instance [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lazy-loading 'pci_devices' on Instance uuid 68d5fd35-5430-486a-918c-ee215f81c7a9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:52:30 user nova-compute[72849]:   <uuid>68d5fd35-5430-486a-918c-ee215f81c7a9</uuid>
Aug 15 16:52:30 user nova-compute[72849]:   <name>instance-00000032</name>
Aug 15 16:52:30 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:52:30 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:52:30 user nova-compute[72849]:   <metadata>
Aug 15 16:52:30 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:52:30 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:52:30 user nova-compute[72849]:       <nova:name>tempest-TestVolumeBootPattern-server-149658121</nova:name>
Aug 15 16:52:30 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:52:28</nova:creationTime>
Aug 15 16:52:30 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:52:30 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:52:30 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:52:30 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:52:30 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:52:30 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:52:30 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:52:30 user nova-compute[72849]:       <nova:owner>
Aug 15 16:52:30 user nova-compute[72849]:         <nova:user uuid="fe3f48f280e54c2099e6b1db842db2cd">tempest-TestVolumeBootPattern-1900922481-project-member</nova:user>
Aug 15 16:52:30 user nova-compute[72849]:         <nova:project uuid="87edcbec784a4f65b99740f34ff121bb">tempest-TestVolumeBootPattern-1900922481</nova:project>
Aug 15 16:52:30 user nova-compute[72849]:       </nova:owner>
Aug 15 16:52:30 user nova-compute[72849]:       <nova:ports>
Aug 15 16:52:30 user nova-compute[72849]:         <nova:port uuid="74d2d77a-a67c-49bd-be56-77b88b404a74">
Aug 15 16:52:30 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 16:52:30 user nova-compute[72849]:         </nova:port>
Aug 15 16:52:30 user nova-compute[72849]:       </nova:ports>
Aug 15 16:52:30 user nova-compute[72849]:     </nova:instance>
Aug 15 16:52:30 user nova-compute[72849]:   </metadata>
Aug 15 16:52:30 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:52:30 user nova-compute[72849]:     <system>
Aug 15 16:52:30 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:52:30 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:52:30 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:52:30 user nova-compute[72849]:       <entry name="serial">68d5fd35-5430-486a-918c-ee215f81c7a9</entry>
Aug 15 16:52:30 user nova-compute[72849]:       <entry name="uuid">68d5fd35-5430-486a-918c-ee215f81c7a9</entry>
Aug 15 16:52:30 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:52:30 user nova-compute[72849]:     </system>
Aug 15 16:52:30 user nova-compute[72849]:   </sysinfo>
Aug 15 16:52:30 user nova-compute[72849]:   <os>
Aug 15 16:52:30 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:52:30 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:52:30 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:52:30 user nova-compute[72849]:   </os>
Aug 15 16:52:30 user nova-compute[72849]:   <features>
Aug 15 16:52:30 user nova-compute[72849]:     <acpi/>
Aug 15 16:52:30 user nova-compute[72849]:     <apic/>
Aug 15 16:52:30 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:52:30 user nova-compute[72849]:   </features>
Aug 15 16:52:30 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:52:30 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:52:30 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:52:30 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:52:30 user nova-compute[72849]:   </clock>
Aug 15 16:52:30 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:52:30 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:52:30 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:52:30 user nova-compute[72849]:   </cpu>
Aug 15 16:52:30 user nova-compute[72849]:   <devices>
Aug 15 16:52:30 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:52:30 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:52:30 user nova-compute[72849]:       <source dev="/dev/sdb"/>
Aug 15 16:52:30 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:52:30 user nova-compute[72849]:       <serial>57d73236-1389-4b02-b2d8-5f397f18a05c</serial>
Aug 15 16:52:30 user nova-compute[72849]:     </disk>
Aug 15 16:52:30 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:52:30 user nova-compute[72849]:       <mac address="fa:16:3e:ae:26:c6"/>
Aug 15 16:52:30 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:52:30 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:52:30 user nova-compute[72849]:       <target dev="tap74d2d77a-a6"/>
Aug 15 16:52:30 user nova-compute[72849]:     </interface>
Aug 15 16:52:30 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:52:30 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/68d5fd35-5430-486a-918c-ee215f81c7a9/console.log" append="off"/>
Aug 15 16:52:30 user nova-compute[72849]:     </serial>
Aug 15 16:52:30 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:52:30 user nova-compute[72849]:     <video>
Aug 15 16:52:30 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:52:30 user nova-compute[72849]:     </video>
Aug 15 16:52:30 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:52:30 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:52:30 user nova-compute[72849]:     </rng>
Aug 15 16:52:30 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:52:30 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:52:30 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:52:30 user nova-compute[72849]:     </memballoon>
Aug 15 16:52:30 user nova-compute[72849]:   </devices>
Aug 15 16:52:30 user nova-compute[72849]: </domain>
Aug 15 16:52:30 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:52:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-149658121',display_name='tempest-TestVolumeBootPattern-server-149658121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-149658121',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFwEX72mp3NUKtYVln/Z+8GBwAx+xwvd9Fh1Mp2Wo1kGDe71MixlTitg7j4YrqUQjn7OCDU06CqQdMxxXQ6ba1l/e9gv1vFv9Hg9h2krod/tMNxb2w9GPXstWzAUISHAw==',key_name='tempest-TestVolumeBootPattern-1380441197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87edcbec784a4f65b99740f34ff121bb',ramdisk_id='',reservation_id='r-yqyjpkux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1900922481',owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:52:20Z,user_data=None,user_id='fe3f48f280e54c2099e6b1db842db2cd',uuid=68d5fd35-5430-486a-918c-ee215f81c7a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74d2d77a-a67c-49bd-be56-77b88b404a74", "address": "fa:16:3e:ae:26:c6", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d2d77a-a6", "ovs_interfaceid": "74d2d77a-a67c-49bd-be56-77b88b404a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converting VIF {"id": "74d2d77a-a67c-49bd-be56-77b88b404a74", "address": "fa:16:3e:ae:26:c6", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d2d77a-a6", "ovs_interfaceid": "74d2d77a-a67c-49bd-be56-77b88b404a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:26:c6,bridge_name='br-int',has_traffic_filtering=True,id=74d2d77a-a67c-49bd-be56-77b88b404a74,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74d2d77a-a6') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG os_vif [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:26:c6,bridge_name='br-int',has_traffic_filtering=True,id=74d2d77a-a67c-49bd-be56-77b88b404a74,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74d2d77a-a6') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74d2d77a-a6, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74d2d77a-a6, col_values=(('external_ids', {'iface-id': '74d2d77a-a67c-49bd-be56-77b88b404a74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:26:c6', 'vm-uuid': '68d5fd35-5430-486a-918c-ee215f81c7a9'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:30 user nova-compute[72849]: INFO os_vif [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:26:c6,bridge_name='br-int',has_traffic_filtering=True,id=74d2d77a-a67c-49bd-be56-77b88b404a74,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74d2d77a-a6')
Aug 15 16:52:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:52:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] No VIF found with MAC fa:16:3e:ae:26:c6, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:52:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-f97962fd-d455-45e5-8f06-df18043af441 req-a1ac06a4-ce90-44e0-bbb5-764f9b8a11b9 service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Received event network-vif-plugged-74d2d77a-a67c-49bd-be56-77b88b404a74 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:52:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f97962fd-d455-45e5-8f06-df18043af441 req-a1ac06a4-ce90-44e0-bbb5-764f9b8a11b9 service nova] Acquiring lock "68d5fd35-5430-486a-918c-ee215f81c7a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:52:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f97962fd-d455-45e5-8f06-df18043af441 req-a1ac06a4-ce90-44e0-bbb5-764f9b8a11b9 service nova] Lock "68d5fd35-5430-486a-918c-ee215f81c7a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:52:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f97962fd-d455-45e5-8f06-df18043af441 req-a1ac06a4-ce90-44e0-bbb5-764f9b8a11b9 service nova] Lock "68d5fd35-5430-486a-918c-ee215f81c7a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:52:31 user nova-compute[72849]: DEBUG nova.compute.manager [req-f97962fd-d455-45e5-8f06-df18043af441 req-a1ac06a4-ce90-44e0-bbb5-764f9b8a11b9 service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] No waiting events found dispatching network-vif-plugged-74d2d77a-a67c-49bd-be56-77b88b404a74 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:52:31 user nova-compute[72849]: WARNING nova.compute.manager [req-f97962fd-d455-45e5-8f06-df18043af441 req-a1ac06a4-ce90-44e0-bbb5-764f9b8a11b9 service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Received unexpected event network-vif-plugged-74d2d77a-a67c-49bd-be56-77b88b404a74 for instance with vm_state building and task_state spawning.
Aug 15 16:52:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:33 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692118353.839647, 68d5fd35-5430-486a-918c-ee215f81c7a9 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:52:33 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] VM Resumed (Lifecycle Event)
Aug 15 16:52:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:52:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:52:33 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Instance spawned successfully.
Aug 15 16:52:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:52:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:52:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:52:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:52:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:52:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:52:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:52:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:52:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:52:33 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:52:33 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692118353.8408456, 68d5fd35-5430-486a-918c-ee215f81c7a9 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:52:33 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] VM Started (Lifecycle Event)
Aug 15 16:52:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:52:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:52:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-c673e870-13c8-4a6e-832a-ae192b713393 req-15708068-9c83-4ed0-9ba0-1b54f2499227 service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Received event network-vif-plugged-74d2d77a-a67c-49bd-be56-77b88b404a74 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:52:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c673e870-13c8-4a6e-832a-ae192b713393 req-15708068-9c83-4ed0-9ba0-1b54f2499227 service nova] Acquiring lock "68d5fd35-5430-486a-918c-ee215f81c7a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:52:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c673e870-13c8-4a6e-832a-ae192b713393 req-15708068-9c83-4ed0-9ba0-1b54f2499227 service nova] Lock "68d5fd35-5430-486a-918c-ee215f81c7a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:52:33 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-c673e870-13c8-4a6e-832a-ae192b713393 req-15708068-9c83-4ed0-9ba0-1b54f2499227 service nova] Lock "68d5fd35-5430-486a-918c-ee215f81c7a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:52:33 user nova-compute[72849]: DEBUG nova.compute.manager [req-c673e870-13c8-4a6e-832a-ae192b713393 req-15708068-9c83-4ed0-9ba0-1b54f2499227 service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] No waiting events found dispatching network-vif-plugged-74d2d77a-a67c-49bd-be56-77b88b404a74 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:52:33 user nova-compute[72849]: WARNING nova.compute.manager [req-c673e870-13c8-4a6e-832a-ae192b713393 req-15708068-9c83-4ed0-9ba0-1b54f2499227 service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Received unexpected event network-vif-plugged-74d2d77a-a67c-49bd-be56-77b88b404a74 for instance with vm_state building and task_state spawning.
Aug 15 16:52:33 user nova-compute[72849]: INFO nova.compute.manager [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Took 4.99 seconds to spawn the instance on the hypervisor.
Aug 15 16:52:33 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:52:33 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:52:34 user nova-compute[72849]: INFO nova.compute.manager [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Took 14.32 seconds to build instance.
Aug 15 16:52:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4530b01b-dea3-4184-8f0f-88bfaab80a8d tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "68d5fd35-5430-486a-918c-ee215f81c7a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.410s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:52:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:46 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:52:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:52:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:52:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-68d5fd35-5430-486a-918c-ee215f81c7a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:52:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-68d5fd35-5430-486a-918c-ee215f81c7a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:52:46 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:52:46 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid 68d5fd35-5430-486a-918c-ee215f81c7a9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:52:46 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Updating instance_info_cache with network_info: [{"id": "74d2d77a-a67c-49bd-be56-77b88b404a74", "address": "fa:16:3e:ae:26:c6", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d2d77a-a6", "ovs_interfaceid": "74d2d77a-a67c-49bd-be56-77b88b404a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:52:46 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-68d5fd35-5430-486a-918c-ee215f81c7a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:52:46 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:52:46 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:52:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:53 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:52:54 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:52:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:55 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:52:55 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:52:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:52:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:52:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:52:55 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:52:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:52:55 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:52:55 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:52:55 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:52:55 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8715MB free_disk=25.213706970214844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:52:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:52:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:52:56 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 68d5fd35-5430-486a-918c-ee215f81c7a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:52:56 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:52:56 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:52:56 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing inventories for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 16:52:56 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating ProviderTree inventory for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 16:52:56 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating inventory in ProviderTree for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 16:52:56 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing aggregate associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, aggregates: None {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 16:52:56 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing trait associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 16:52:56 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:52:56 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:52:56 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:52:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:52:57 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:52:58 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:52:58 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:52:58 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 16:52:58 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] There are 0 instances to clean {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 16:52:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:53:00 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:53:00 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:53:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:53:03 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:53:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:53:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:53:07 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:53:10 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:53:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72849) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 16:53:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:53:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:53:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:53:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:53:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:53:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:53:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:53:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:53:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:53:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:53:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:53:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:53:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:53:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:53:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:53:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:53:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:53:36 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 68d5fd35-5430-486a-918c-ee215f81c7a9 {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 16:53:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "68d5fd35-5430-486a-918c-ee215f81c7a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:53:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "68d5fd35-5430-486a-918c-ee215f81c7a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:53:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "68d5fd35-5430-486a-918c-ee215f81c7a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:53:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:53:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:53:48 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:53:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:53:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:53:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-68d5fd35-5430-486a-918c-ee215f81c7a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:53:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-68d5fd35-5430-486a-918c-ee215f81c7a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:53:48 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:53:48 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid 68d5fd35-5430-486a-918c-ee215f81c7a9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:53:48 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Updating instance_info_cache with network_info: [{"id": "74d2d77a-a67c-49bd-be56-77b88b404a74", "address": "fa:16:3e:ae:26:c6", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d2d77a-a6", "ovs_interfaceid": "74d2d77a-a67c-49bd-be56-77b88b404a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:53:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-68d5fd35-5430-486a-918c-ee215f81c7a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:53:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:53:48 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:53:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:53:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:53:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:53:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:53:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:53:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:53:54 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:53:54 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:53:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:53:56 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:53:57 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:53:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:53:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:53:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:53:57 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:53:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:53:57 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:53:57 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:53:57 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8777MB free_disk=25.21314239501953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:53:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:53:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:53:57 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 68d5fd35-5430-486a-918c-ee215f81c7a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:53:57 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:53:57 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:53:57 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:53:57 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:53:57 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:53:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:53:58 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:54:00 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:54:00 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:54:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:54:05 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:54:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:54:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:54:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:54:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-4cf4b099-c23e-453c-82b1-8c5c3a8d6575 req-ffdde736-8dc2-44f0-bf7e-385fde13adab service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Received event network-changed-74d2d77a-a67c-49bd-be56-77b88b404a74 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:54:11 user nova-compute[72849]: DEBUG nova.compute.manager [req-4cf4b099-c23e-453c-82b1-8c5c3a8d6575 req-ffdde736-8dc2-44f0-bf7e-385fde13adab service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Refreshing instance network info cache due to event network-changed-74d2d77a-a67c-49bd-be56-77b88b404a74. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:54:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4cf4b099-c23e-453c-82b1-8c5c3a8d6575 req-ffdde736-8dc2-44f0-bf7e-385fde13adab service nova] Acquiring lock "refresh_cache-68d5fd35-5430-486a-918c-ee215f81c7a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:54:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4cf4b099-c23e-453c-82b1-8c5c3a8d6575 req-ffdde736-8dc2-44f0-bf7e-385fde13adab service nova] Acquired lock "refresh_cache-68d5fd35-5430-486a-918c-ee215f81c7a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:54:11 user nova-compute[72849]: DEBUG nova.network.neutron [req-4cf4b099-c23e-453c-82b1-8c5c3a8d6575 req-ffdde736-8dc2-44f0-bf7e-385fde13adab service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Refreshing network info cache for port 74d2d77a-a67c-49bd-be56-77b88b404a74 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:54:12 user nova-compute[72849]: DEBUG nova.network.neutron [req-4cf4b099-c23e-453c-82b1-8c5c3a8d6575 req-ffdde736-8dc2-44f0-bf7e-385fde13adab service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Updated VIF entry in instance network info cache for port 74d2d77a-a67c-49bd-be56-77b88b404a74. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:54:12 user nova-compute[72849]: DEBUG nova.network.neutron [req-4cf4b099-c23e-453c-82b1-8c5c3a8d6575 req-ffdde736-8dc2-44f0-bf7e-385fde13adab service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Updating instance_info_cache with network_info: [{"id": "74d2d77a-a67c-49bd-be56-77b88b404a74", "address": "fa:16:3e:ae:26:c6", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d2d77a-a6", "ovs_interfaceid": "74d2d77a-a67c-49bd-be56-77b88b404a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:54:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4cf4b099-c23e-453c-82b1-8c5c3a8d6575 req-ffdde736-8dc2-44f0-bf7e-385fde13adab service nova] Releasing lock "refresh_cache-68d5fd35-5430-486a-918c-ee215f81c7a9" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:54:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "68d5fd35-5430-486a-918c-ee215f81c7a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:54:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "68d5fd35-5430-486a-918c-ee215f81c7a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:54:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "68d5fd35-5430-486a-918c-ee215f81c7a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:54:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "68d5fd35-5430-486a-918c-ee215f81c7a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:54:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "68d5fd35-5430-486a-918c-ee215f81c7a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:54:12 user nova-compute[72849]: INFO nova.compute.manager [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Terminating instance
Aug 15 16:54:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:54:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:54:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:54:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:54:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:54:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-1c0f2ee0-a800-4acc-824d-e4edb108d9cd req-fecc5775-6801-4ca8-b5ce-fed13bca5ea4 service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Received event network-vif-unplugged-74d2d77a-a67c-49bd-be56-77b88b404a74 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:54:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1c0f2ee0-a800-4acc-824d-e4edb108d9cd req-fecc5775-6801-4ca8-b5ce-fed13bca5ea4 service nova] Acquiring lock "68d5fd35-5430-486a-918c-ee215f81c7a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:54:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1c0f2ee0-a800-4acc-824d-e4edb108d9cd req-fecc5775-6801-4ca8-b5ce-fed13bca5ea4 service nova] Lock "68d5fd35-5430-486a-918c-ee215f81c7a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:54:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-1c0f2ee0-a800-4acc-824d-e4edb108d9cd req-fecc5775-6801-4ca8-b5ce-fed13bca5ea4 service nova] Lock "68d5fd35-5430-486a-918c-ee215f81c7a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:54:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-1c0f2ee0-a800-4acc-824d-e4edb108d9cd req-fecc5775-6801-4ca8-b5ce-fed13bca5ea4 service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] No waiting events found dispatching network-vif-unplugged-74d2d77a-a67c-49bd-be56-77b88b404a74 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:54:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-1c0f2ee0-a800-4acc-824d-e4edb108d9cd req-fecc5775-6801-4ca8-b5ce-fed13bca5ea4 service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Received event network-vif-unplugged-74d2d77a-a67c-49bd-be56-77b88b404a74 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:54:13 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Instance destroyed successfully.
Aug 15 16:54:13 user nova-compute[72849]: DEBUG nova.objects.instance [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lazy-loading 'resources' on Instance uuid 68d5fd35-5430-486a-918c-ee215f81c7a9 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:52:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-149658121',display_name='tempest-TestVolumeBootPattern-server-149658121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-149658121',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFwEX72mp3NUKtYVln/Z+8GBwAx+xwvd9Fh1Mp2Wo1kGDe71MixlTitg7j4YrqUQjn7OCDU06CqQdMxxXQ6ba1l/e9gv1vFv9Hg9h2krod/tMNxb2w9GPXstWzAUISHAw==',key_name='tempest-TestVolumeBootPattern-1380441197',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:52:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87edcbec784a4f65b99740f34ff121bb',ramdisk_id='',reservation_id='r-yqyjpkux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1900922481',owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:52:34Z,user_data=None,user_id='fe3f48f280e54c2099e6b1db842db2cd',uuid=68d5fd35-5430-486a-918c-ee215f81c7a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74d2d77a-a67c-49bd-be56-77b88b404a74", "address": "fa:16:3e:ae:26:c6", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d2d77a-a6", "ovs_interfaceid": "74d2d77a-a67c-49bd-be56-77b88b404a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converting VIF {"id": "74d2d77a-a67c-49bd-be56-77b88b404a74", "address": "fa:16:3e:ae:26:c6", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74d2d77a-a6", "ovs_interfaceid": "74d2d77a-a67c-49bd-be56-77b88b404a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:26:c6,bridge_name='br-int',has_traffic_filtering=True,id=74d2d77a-a67c-49bd-be56-77b88b404a74,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74d2d77a-a6') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_vif [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:26:c6,bridge_name='br-int',has_traffic_filtering=True,id=74d2d77a-a67c-49bd-be56-77b88b404a74,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74d2d77a-a6') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74d2d77a-a6, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:54:13 user nova-compute[72849]: INFO os_vif [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:26:c6,bridge_name='br-int',has_traffic_filtering=True,id=74d2d77a-a67c-49bd-be56-77b88b404a74,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74d2d77a-a6')
Aug 15 16:54:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LFJDjyKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:54:13 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c84abd-5217-4b25-ae80-e75a7855d092]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4de391-4a23-4806-80e1-6e2a546487d6]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)
Aug 15 16:54:13 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)
Aug 15 16:54:13 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3387a48b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4df4571-44b3-47ca-88f2-30240e1c1fe0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9f4250-75a0-40b6-a017-2777cd3233c8]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc255e44-6577-4b50-acc3-cbfb0eca507a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae1d059-a11a-43c4-bb3f-2335f26a834c]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26637353263633036', '/dev/disk/by-id/scsi-1SCST_BIOf241c61b-f752cc06a5c75a24', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f241c61b') {{(pid=84060) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfb6b15-9daa-4bae-9942-76972e8729a8]: (4, None) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f277d6-a147-43be-8f0e-c671601b47a7]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f23dca0-a49a-4ac2-8c55-5d5c8d2f08b1]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c, portal: 172.16.0.220,3260]
Aug 15 16:54:13 user nova-compute[72849]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c, portal: 172.16.0.220,3260] successful.
Aug 15 16:54:13 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[99642fec-940f-4a7e-ad28-2c4ca98f88ac]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] <== disconnect_volume: return (295ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:54:13 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Deleting instance files /opt/stack/data/nova/instances/68d5fd35-5430-486a-918c-ee215f81c7a9_del
Aug 15 16:54:13 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Deletion of /opt/stack/data/nova/instances/68d5fd35-5430-486a-918c-ee215f81c7a9_del complete
Aug 15 16:54:13 user nova-compute[72849]: INFO nova.compute.manager [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 15 16:54:13 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:54:13 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:54:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:54:14 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:54:14 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Took 1.25 seconds to deallocate network for instance.
Aug 15 16:54:14 user nova-compute[72849]: DEBUG nova.compute.manager [req-b2a4ef89-e47a-469e-9565-81f43f7942c9 req-97b2a208-330e-4c1f-b780-feeb71490255 service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Received event network-vif-plugged-74d2d77a-a67c-49bd-be56-77b88b404a74 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:54:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b2a4ef89-e47a-469e-9565-81f43f7942c9 req-97b2a208-330e-4c1f-b780-feeb71490255 service nova] Acquiring lock "68d5fd35-5430-486a-918c-ee215f81c7a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:54:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b2a4ef89-e47a-469e-9565-81f43f7942c9 req-97b2a208-330e-4c1f-b780-feeb71490255 service nova] Lock "68d5fd35-5430-486a-918c-ee215f81c7a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:54:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-b2a4ef89-e47a-469e-9565-81f43f7942c9 req-97b2a208-330e-4c1f-b780-feeb71490255 service nova] Lock "68d5fd35-5430-486a-918c-ee215f81c7a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:54:14 user nova-compute[72849]: DEBUG nova.compute.manager [req-b2a4ef89-e47a-469e-9565-81f43f7942c9 req-97b2a208-330e-4c1f-b780-feeb71490255 service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] No waiting events found dispatching network-vif-plugged-74d2d77a-a67c-49bd-be56-77b88b404a74 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:54:14 user nova-compute[72849]: WARNING nova.compute.manager [req-b2a4ef89-e47a-469e-9565-81f43f7942c9 req-97b2a208-330e-4c1f-b780-feeb71490255 service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Received unexpected event network-vif-plugged-74d2d77a-a67c-49bd-be56-77b88b404a74 for instance with vm_state active and task_state deleting.
Aug 15 16:54:14 user nova-compute[72849]: DEBUG nova.compute.manager [req-b2a4ef89-e47a-469e-9565-81f43f7942c9 req-97b2a208-330e-4c1f-b780-feeb71490255 service nova] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Received event network-vif-deleted-74d2d77a-a67c-49bd-be56-77b88b404a74 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:54:15 user nova-compute[72849]: INFO nova.compute.manager [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Took 0.71 seconds to detach 1 volumes for instance.
Aug 15 16:54:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:54:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:54:15 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:54:15 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:54:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:54:15 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Deleted allocations for instance 68d5fd35-5430-486a-918c-ee215f81c7a9
Aug 15 16:54:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-243692c5-dc24-4026-91da-1d972522e940 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "68d5fd35-5430-486a-918c-ee215f81c7a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.387s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:54:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:54:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:54:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:54:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:54:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:54:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:54:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:54:28 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692118453.1627867, 68d5fd35-5430-486a-918c-ee215f81c7a9 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:54:28 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] VM Stopped (Lifecycle Event)
Aug 15 16:54:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-3c4413b0-8a95-4e54-8e3c-489a76251f4c None None] [instance: 68d5fd35-5430-486a-918c-ee215f81c7a9] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:54:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:54:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:54:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:54:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:54:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:54:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:54:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:54:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:54:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:54:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:54:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:54:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:54:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:54:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:54:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:54:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:54:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:54:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:54:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:54:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:54:48 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:54:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:54:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:54:48 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Didn't find any instances for network info cache update. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 16:54:48 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:54:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:54:55 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:54:55 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:54:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:54:58 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:54:58 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:54:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:54:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:54:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:54:58 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:54:58 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:54:58 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:54:58 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=25.212295532226562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:54:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:54:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:54:58 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:54:58 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:54:58 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:54:58 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:54:58 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:54:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:54:59 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:55:00 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:55:00 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:55:00 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:55:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:55:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:55:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:55:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:55:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:05 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:55:06 user nova-compute[72849]: INFO nova.compute.claims [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Claim successful on node user
Aug 15 16:55:06 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.190s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG nova.network.neutron [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:55:06 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:55:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:55:06 user nova-compute[72849]: INFO nova.virt.block_device [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Booting with volume 57d73236-1389-4b02-b2d8-5f397f18a05c at /dev/vda
Aug 15 16:55:06 user nova-compute[72849]: DEBUG os_brick.utils [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e106c5e-7eaf-4390-a2f3-a2bd9b27ff1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG nova.policy [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe3f48f280e54c2099e6b1db842db2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87edcbec784a4f65b99740f34ff121bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[be735682-73c4-4f2f-9d67-ba8b11906bce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[04156fc3-2cfb-4c95-a0ab-79155428099a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b37282-5fe2-484a-a4b5-50ee955a5c40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:55:06 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:55:06 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3547b3-95ea-4bab-940e-e5afc6ee9d10]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG os_brick.utils [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:55:06 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Updating existing volume attachment record: c6ab2459-e519-4190-9e59-17983ce3c759 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:55:07 user nova-compute[72849]: DEBUG nova.network.neutron [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Successfully created port: 5c2b9c43-3698-434a-8868-7391c2254764 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:55:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:08 user nova-compute[72849]: DEBUG nova.network.neutron [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Successfully updated port: 5c2b9c43-3698-434a-8868-7391c2254764 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:55:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:55:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquired lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:55:08 user nova-compute[72849]: DEBUG nova.network.neutron [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:55:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-35de78fd-76a0-4731-91fe-5b0c5ab82dcd req-3d6e134f-baab-4939-9fe8-1ed0529da7b9 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Received event network-changed-5c2b9c43-3698-434a-8868-7391c2254764 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:55:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-35de78fd-76a0-4731-91fe-5b0c5ab82dcd req-3d6e134f-baab-4939-9fe8-1ed0529da7b9 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Refreshing instance network info cache due to event network-changed-5c2b9c43-3698-434a-8868-7391c2254764. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:55:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-35de78fd-76a0-4731-91fe-5b0c5ab82dcd req-3d6e134f-baab-4939-9fe8-1ed0529da7b9 service nova] Acquiring lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:55:08 user nova-compute[72849]: DEBUG nova.network.neutron [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:55:08 user nova-compute[72849]: DEBUG nova.network.neutron [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Updating instance_info_cache with network_info: [{"id": "5c2b9c43-3698-434a-8868-7391c2254764", "address": "fa:16:3e:7f:57:04", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2b9c43-36", "ovs_interfaceid": "5c2b9c43-3698-434a-8868-7391c2254764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:55:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Releasing lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:55:08 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Instance network_info: |[{"id": "5c2b9c43-3698-434a-8868-7391c2254764", "address": "fa:16:3e:7f:57:04", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2b9c43-36", "ovs_interfaceid": "5c2b9c43-3698-434a-8868-7391c2254764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:55:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-35de78fd-76a0-4731-91fe-5b0c5ab82dcd req-3d6e134f-baab-4939-9fe8-1ed0529da7b9 service nova] Acquired lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:55:08 user nova-compute[72849]: DEBUG nova.network.neutron [req-35de78fd-76a0-4731-91fe-5b0c5ab82dcd req-3d6e134f-baab-4939-9fe8-1ed0529da7b9 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Refreshing network info cache for port 5c2b9c43-3698-434a-8868-7391c2254764 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:55:09 user nova-compute[72849]: DEBUG nova.network.neutron [req-35de78fd-76a0-4731-91fe-5b0c5ab82dcd req-3d6e134f-baab-4939-9fe8-1ed0529da7b9 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Updated VIF entry in instance network info cache for port 5c2b9c43-3698-434a-8868-7391c2254764. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:55:09 user nova-compute[72849]: DEBUG nova.network.neutron [req-35de78fd-76a0-4731-91fe-5b0c5ab82dcd req-3d6e134f-baab-4939-9fe8-1ed0529da7b9 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Updating instance_info_cache with network_info: [{"id": "5c2b9c43-3698-434a-8868-7391c2254764", "address": "fa:16:3e:7f:57:04", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2b9c43-36", "ovs_interfaceid": "5c2b9c43-3698-434a-8868-7391c2254764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:55:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-35de78fd-76a0-4731-91fe-5b0c5ab82dcd req-3d6e134f-baab-4939-9fe8-1ed0529da7b9 service nova] Releasing lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:55:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:55:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:55:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:55:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:55:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:55:15 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Creating image(s)
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Did not create local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Ensure instance console log exists: /opt/stack/data/nova/instances/b9c0e14e-2356-48b8-bcbf-adc4f2755e41/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Start _get_guest_xml network_info=[{"id": "5c2b9c43-3698-434a-8868-7391c2254764", "address": "fa:16:3e:7f:57:04", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2b9c43-36", "ovs_interfaceid": "5c2b9c43-3698-434a-8868-7391c2254764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LFJDjyKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b9c0e14e-2356-48b8-bcbf-adc4f2755e41', 'attached_at': '', 'detached_at': '', 'volume_id': '57d73236-1389-4b02-b2d8-5f397f18a05c', 'serial': '57d73236-1389-4b02-b2d8-5f397f18a05c'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'c6ab2459-e519-4190-9e59-17983ce3c759', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:55:15 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:55:15 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LFJDjyKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:55:15 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:55:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:55:15 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:55:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:55:15 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:55:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7996f7-6446-4b72-8f78-2e96cb0f9aa8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:55:15 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d329ba-9a6b-4766-8527-8a35161dd302]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c] added
Aug 15 16:55:15 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:55:15 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7f13bd-5471-4b48-9dea-18d3a1732208]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2beacd-715c-46eb-af84-70884eb63193]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LFJDjyKs {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LFJDjyKs" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27cd330-2a61-44e2-87d8-ae6275ac41a0]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LFJDjyKs'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c37e06-d436-45fd-8058-1c7b0358d61f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[53193992-016e-4ce3-b088-e8312fd9b1a0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:55:16 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 16:55:16 user nova-compute[72849]:  {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:55:16 user nova-compute[72849]: WARNING os_brick.initiator.connectors.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 16:55:16 user nova-compute[72849]: 
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[543bdb6a-6f26-4ab9-8d6b-85f49608ba39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c, portal: 172.16.0.220,3260]
Aug 15 16:55:16 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c, portal: 172.16.0.220,3260] successful.
Aug 15 16:55:16 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[82066b77-b58c-4d4c-adde-0dc84877264a]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9b2aa9-7afc-4541-a338-1da5db3ac8e9]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)
Aug 15 16:55:16 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)
Aug 15 16:55:16 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b823a1-9600-4745-bb09-a0cab2977c8e]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:55:16 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LFJDjyKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26637353263633036', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637353263633036', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:55:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1792446250',display_name='tempest-TestVolumeBootPattern-server-1792446250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1792446250',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFwEX72mp3NUKtYVln/Z+8GBwAx+xwvd9Fh1Mp2Wo1kGDe71MixlTitg7j4YrqUQjn7OCDU06CqQdMxxXQ6ba1l/e9gv1vFv9Hg9h2krod/tMNxb2w9GPXstWzAUISHAw==',key_name='tempest-TestVolumeBootPattern-1380441197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87edcbec784a4f65b99740f34ff121bb',ramdisk_id='',reservation_id='r-zcal7mzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1900922481',owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:55:07Z,user_data=None,user_id='fe3f48f280e54c2099e6b1db842db2cd',uuid=b9c0e14e-2356-48b8-bcbf-adc4f2755e41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c2b9c43-3698-434a-8868-7391c2254764", "address": "fa:16:3e:7f:57:04", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2b9c43-36", "ovs_interfaceid": "5c2b9c43-3698-434a-8868-7391c2254764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converting VIF {"id": "5c2b9c43-3698-434a-8868-7391c2254764", "address": "fa:16:3e:7f:57:04", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2b9c43-36", "ovs_interfaceid": "5c2b9c43-3698-434a-8868-7391c2254764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:57:04,bridge_name='br-int',has_traffic_filtering=True,id=5c2b9c43-3698-434a-8868-7391c2254764,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2b9c43-36') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG nova.objects.instance [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lazy-loading 'pci_devices' on Instance uuid b9c0e14e-2356-48b8-bcbf-adc4f2755e41 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:55:17 user nova-compute[72849]:   <uuid>b9c0e14e-2356-48b8-bcbf-adc4f2755e41</uuid>
Aug 15 16:55:17 user nova-compute[72849]:   <name>instance-00000033</name>
Aug 15 16:55:17 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:55:17 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:55:17 user nova-compute[72849]:   <metadata>
Aug 15 16:55:17 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:55:17 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:55:17 user nova-compute[72849]:       <nova:name>tempest-TestVolumeBootPattern-server-1792446250</nova:name>
Aug 15 16:55:17 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:55:15</nova:creationTime>
Aug 15 16:55:17 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:55:17 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:55:17 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:55:17 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:55:17 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:55:17 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:55:17 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:55:17 user nova-compute[72849]:       <nova:owner>
Aug 15 16:55:17 user nova-compute[72849]:         <nova:user uuid="fe3f48f280e54c2099e6b1db842db2cd">tempest-TestVolumeBootPattern-1900922481-project-member</nova:user>
Aug 15 16:55:17 user nova-compute[72849]:         <nova:project uuid="87edcbec784a4f65b99740f34ff121bb">tempest-TestVolumeBootPattern-1900922481</nova:project>
Aug 15 16:55:17 user nova-compute[72849]:       </nova:owner>
Aug 15 16:55:17 user nova-compute[72849]:       <nova:ports>
Aug 15 16:55:17 user nova-compute[72849]:         <nova:port uuid="5c2b9c43-3698-434a-8868-7391c2254764">
Aug 15 16:55:17 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 16:55:17 user nova-compute[72849]:         </nova:port>
Aug 15 16:55:17 user nova-compute[72849]:       </nova:ports>
Aug 15 16:55:17 user nova-compute[72849]:     </nova:instance>
Aug 15 16:55:17 user nova-compute[72849]:   </metadata>
Aug 15 16:55:17 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:55:17 user nova-compute[72849]:     <system>
Aug 15 16:55:17 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:55:17 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:55:17 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:55:17 user nova-compute[72849]:       <entry name="serial">b9c0e14e-2356-48b8-bcbf-adc4f2755e41</entry>
Aug 15 16:55:17 user nova-compute[72849]:       <entry name="uuid">b9c0e14e-2356-48b8-bcbf-adc4f2755e41</entry>
Aug 15 16:55:17 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:55:17 user nova-compute[72849]:     </system>
Aug 15 16:55:17 user nova-compute[72849]:   </sysinfo>
Aug 15 16:55:17 user nova-compute[72849]:   <os>
Aug 15 16:55:17 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:55:17 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:55:17 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:55:17 user nova-compute[72849]:   </os>
Aug 15 16:55:17 user nova-compute[72849]:   <features>
Aug 15 16:55:17 user nova-compute[72849]:     <acpi/>
Aug 15 16:55:17 user nova-compute[72849]:     <apic/>
Aug 15 16:55:17 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:55:17 user nova-compute[72849]:   </features>
Aug 15 16:55:17 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:55:17 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:55:17 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:55:17 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:55:17 user nova-compute[72849]:   </clock>
Aug 15 16:55:17 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:55:17 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:55:17 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:55:17 user nova-compute[72849]:   </cpu>
Aug 15 16:55:17 user nova-compute[72849]:   <devices>
Aug 15 16:55:17 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:55:17 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:55:17 user nova-compute[72849]:       <source dev="/dev/sdb"/>
Aug 15 16:55:17 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:55:17 user nova-compute[72849]:       <serial>57d73236-1389-4b02-b2d8-5f397f18a05c</serial>
Aug 15 16:55:17 user nova-compute[72849]:     </disk>
Aug 15 16:55:17 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:55:17 user nova-compute[72849]:       <mac address="fa:16:3e:7f:57:04"/>
Aug 15 16:55:17 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:55:17 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:55:17 user nova-compute[72849]:       <target dev="tap5c2b9c43-36"/>
Aug 15 16:55:17 user nova-compute[72849]:     </interface>
Aug 15 16:55:17 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:55:17 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/b9c0e14e-2356-48b8-bcbf-adc4f2755e41/console.log" append="off"/>
Aug 15 16:55:17 user nova-compute[72849]:     </serial>
Aug 15 16:55:17 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:55:17 user nova-compute[72849]:     <video>
Aug 15 16:55:17 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:55:17 user nova-compute[72849]:     </video>
Aug 15 16:55:17 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:55:17 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:55:17 user nova-compute[72849]:     </rng>
Aug 15 16:55:17 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:55:17 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:55:17 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:55:17 user nova-compute[72849]:     </memballoon>
Aug 15 16:55:17 user nova-compute[72849]:   </devices>
Aug 15 16:55:17 user nova-compute[72849]: </domain>
Aug 15 16:55:17 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:55:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1792446250',display_name='tempest-TestVolumeBootPattern-server-1792446250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1792446250',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFwEX72mp3NUKtYVln/Z+8GBwAx+xwvd9Fh1Mp2Wo1kGDe71MixlTitg7j4YrqUQjn7OCDU06CqQdMxxXQ6ba1l/e9gv1vFv9Hg9h2krod/tMNxb2w9GPXstWzAUISHAw==',key_name='tempest-TestVolumeBootPattern-1380441197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87edcbec784a4f65b99740f34ff121bb',ramdisk_id='',reservation_id='r-zcal7mzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1900922481',owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:55:07Z,user_data=None,user_id='fe3f48f280e54c2099e6b1db842db2cd',uuid=b9c0e14e-2356-48b8-bcbf-adc4f2755e41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c2b9c43-3698-434a-8868-7391c2254764", "address": "fa:16:3e:7f:57:04", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2b9c43-36", "ovs_interfaceid": "5c2b9c43-3698-434a-8868-7391c2254764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converting VIF {"id": "5c2b9c43-3698-434a-8868-7391c2254764", "address": "fa:16:3e:7f:57:04", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2b9c43-36", "ovs_interfaceid": "5c2b9c43-3698-434a-8868-7391c2254764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:57:04,bridge_name='br-int',has_traffic_filtering=True,id=5c2b9c43-3698-434a-8868-7391c2254764,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2b9c43-36') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG os_vif [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:57:04,bridge_name='br-int',has_traffic_filtering=True,id=5c2b9c43-3698-434a-8868-7391c2254764,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2b9c43-36') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c2b9c43-36, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5c2b9c43-36, col_values=(('external_ids', {'iface-id': '5c2b9c43-3698-434a-8868-7391c2254764', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:57:04', 'vm-uuid': 'b9c0e14e-2356-48b8-bcbf-adc4f2755e41'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:17 user nova-compute[72849]: INFO os_vif [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:57:04,bridge_name='br-int',has_traffic_filtering=True,id=5c2b9c43-3698-434a-8868-7391c2254764,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2b9c43-36')
Aug 15 16:55:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:55:17 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] No VIF found with MAC fa:16:3e:7f:57:04, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:55:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-6dd521cd-8d93-41b3-a167-046d5a3bae59 req-09e25df9-e658-478c-a0df-7754f79f1a53 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Received event network-vif-plugged-5c2b9c43-3698-434a-8868-7391c2254764 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:55:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6dd521cd-8d93-41b3-a167-046d5a3bae59 req-09e25df9-e658-478c-a0df-7754f79f1a53 service nova] Acquiring lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:55:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6dd521cd-8d93-41b3-a167-046d5a3bae59 req-09e25df9-e658-478c-a0df-7754f79f1a53 service nova] Lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:55:18 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6dd521cd-8d93-41b3-a167-046d5a3bae59 req-09e25df9-e658-478c-a0df-7754f79f1a53 service nova] Lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:55:18 user nova-compute[72849]: DEBUG nova.compute.manager [req-6dd521cd-8d93-41b3-a167-046d5a3bae59 req-09e25df9-e658-478c-a0df-7754f79f1a53 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] No waiting events found dispatching network-vif-plugged-5c2b9c43-3698-434a-8868-7391c2254764 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:55:18 user nova-compute[72849]: WARNING nova.compute.manager [req-6dd521cd-8d93-41b3-a167-046d5a3bae59 req-09e25df9-e658-478c-a0df-7754f79f1a53 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Received unexpected event network-vif-plugged-5c2b9c43-3698-434a-8868-7391c2254764 for instance with vm_state building and task_state spawning.
Aug 15 16:55:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:20 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692118520.665631, b9c0e14e-2356-48b8-bcbf-adc4f2755e41 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:55:20 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] VM Resumed (Lifecycle Event)
Aug 15 16:55:20 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:55:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:55:20 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Instance spawned successfully.
Aug 15 16:55:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:55:20 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:55:20 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:55:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:55:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:55:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:55:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:55:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:55:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:55:20 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:55:20 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692118520.6700747, b9c0e14e-2356-48b8-bcbf-adc4f2755e41 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:55:20 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] VM Started (Lifecycle Event)
Aug 15 16:55:20 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:55:20 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:55:20 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:55:20 user nova-compute[72849]: INFO nova.compute.manager [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Took 4.91 seconds to spawn the instance on the hypervisor.
Aug 15 16:55:20 user nova-compute[72849]: DEBUG nova.compute.manager [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:55:20 user nova-compute[72849]: INFO nova.compute.manager [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Took 14.51 seconds to build instance.
Aug 15 16:55:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-ab198112-577b-488b-ab14-13d1e5883587 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.632s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:55:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-bfe72ac1-3f69-42f3-b0d9-202d149ae491 req-b152949a-fbef-4e68-a5ef-96e64c3230a1 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Received event network-vif-plugged-5c2b9c43-3698-434a-8868-7391c2254764 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:55:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-bfe72ac1-3f69-42f3-b0d9-202d149ae491 req-b152949a-fbef-4e68-a5ef-96e64c3230a1 service nova] Acquiring lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:55:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-bfe72ac1-3f69-42f3-b0d9-202d149ae491 req-b152949a-fbef-4e68-a5ef-96e64c3230a1 service nova] Lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:55:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-bfe72ac1-3f69-42f3-b0d9-202d149ae491 req-b152949a-fbef-4e68-a5ef-96e64c3230a1 service nova] Lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:55:20 user nova-compute[72849]: DEBUG nova.compute.manager [req-bfe72ac1-3f69-42f3-b0d9-202d149ae491 req-b152949a-fbef-4e68-a5ef-96e64c3230a1 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] No waiting events found dispatching network-vif-plugged-5c2b9c43-3698-434a-8868-7391c2254764 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:55:20 user nova-compute[72849]: WARNING nova.compute.manager [req-bfe72ac1-3f69-42f3-b0d9-202d149ae491 req-b152949a-fbef-4e68-a5ef-96e64c3230a1 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Received unexpected event network-vif-plugged-5c2b9c43-3698-434a-8868-7391c2254764 for instance with vm_state active and task_state None.
Aug 15 16:55:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:55:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:55:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:55:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:55:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:49 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:55:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:55:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:55:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:55:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:55:49 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:55:49 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid b9c0e14e-2356-48b8-bcbf-adc4f2755e41 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:55:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:49 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Updating instance_info_cache with network_info: [{"id": "5c2b9c43-3698-434a-8868-7391c2254764", "address": "fa:16:3e:7f:57:04", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2b9c43-36", "ovs_interfaceid": "5c2b9c43-3698-434a-8868-7391c2254764", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:55:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:55:49 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:55:50 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:55:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:56 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:55:57 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:55:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:55:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:55:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:55:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:55:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:55:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:55:58 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:55:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:55:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:55:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:55:58 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:55:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:55:58 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:55:58 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:55:58 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8754MB free_disk=25.210586547851562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:55:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:55:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:55:58 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b9c0e14e-2356-48b8-bcbf-adc4f2755e41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:55:58 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:55:58 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:55:58 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:55:58 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:55:59 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:55:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:56:01 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:56:01 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:56:02 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:56:02 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:56:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:56:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:56:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:56:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:56:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:56:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:56:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:56:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:56:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:56:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:56:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:56:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:56:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:56:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:56:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:56:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:56:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:56:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:56:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:56:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:56:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:56:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:56:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:56:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:56:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:56:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:56:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:56:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:56:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:56:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:56:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:56:50 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:56:51 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:56:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:56:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:56:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:56:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:56:51 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:56:51 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid b9c0e14e-2356-48b8-bcbf-adc4f2755e41 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:56:51 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Updating instance_info_cache with network_info: [{"id": "5c2b9c43-3698-434a-8868-7391c2254764", "address": "fa:16:3e:7f:57:04", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2b9c43-36", "ovs_interfaceid": "5c2b9c43-3698-434a-8868-7391c2254764", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:56:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:56:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:56:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:56:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:56:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:56:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:56:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:56:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:56:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:56:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:56:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-6ac507bb-8b96-4bf9-82ef-45d183d7f83b req-e1037861-2597-462d-be67-36197da97f28 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Received event network-changed-5c2b9c43-3698-434a-8868-7391c2254764 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:56:57 user nova-compute[72849]: DEBUG nova.compute.manager [req-6ac507bb-8b96-4bf9-82ef-45d183d7f83b req-e1037861-2597-462d-be67-36197da97f28 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Refreshing instance network info cache due to event network-changed-5c2b9c43-3698-434a-8868-7391c2254764. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:56:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6ac507bb-8b96-4bf9-82ef-45d183d7f83b req-e1037861-2597-462d-be67-36197da97f28 service nova] Acquiring lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:56:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6ac507bb-8b96-4bf9-82ef-45d183d7f83b req-e1037861-2597-462d-be67-36197da97f28 service nova] Acquired lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:56:57 user nova-compute[72849]: DEBUG nova.network.neutron [req-6ac507bb-8b96-4bf9-82ef-45d183d7f83b req-e1037861-2597-462d-be67-36197da97f28 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Refreshing network info cache for port 5c2b9c43-3698-434a-8868-7391c2254764 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:56:58 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:56:58 user nova-compute[72849]: DEBUG nova.network.neutron [req-6ac507bb-8b96-4bf9-82ef-45d183d7f83b req-e1037861-2597-462d-be67-36197da97f28 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Updated VIF entry in instance network info cache for port 5c2b9c43-3698-434a-8868-7391c2254764. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:56:58 user nova-compute[72849]: DEBUG nova.network.neutron [req-6ac507bb-8b96-4bf9-82ef-45d183d7f83b req-e1037861-2597-462d-be67-36197da97f28 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Updating instance_info_cache with network_info: [{"id": "5c2b9c43-3698-434a-8868-7391c2254764", "address": "fa:16:3e:7f:57:04", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2b9c43-36", "ovs_interfaceid": "5c2b9c43-3698-434a-8868-7391c2254764", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:56:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-6ac507bb-8b96-4bf9-82ef-45d183d7f83b req-e1037861-2597-462d-be67-36197da97f28 service nova] Releasing lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:56:59 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:56:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:00 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:57:00 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:57:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:57:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:57:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:57:00 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:57:00 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:57:00 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:57:00 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:57:00 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8767MB free_disk=25.209915161132812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:57:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:57:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:57:00 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b9c0e14e-2356-48b8-bcbf-adc4f2755e41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:57:00 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:57:00 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:57:00 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:57:00 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:57:00 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:57:00 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:57:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:02 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:57:02 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:57:02 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:57:03 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:57:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:57:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "25f5bf26-4683-4c99-ae95-9080b07b0514" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:57:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "25f5bf26-4683-4c99-ae95-9080b07b0514" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:57:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 16:57:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:57:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:57:10 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 16:57:10 user nova-compute[72849]: INFO nova.compute.claims [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Claim successful on node user
Aug 15 16:57:10 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:57:10 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG nova.network.neutron [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 16:57:11 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 16:57:11 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 16:57:11 user nova-compute[72849]: INFO nova.virt.block_device [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Booting with volume 99966c5e-eec3-4c28-862e-fbdc9c8e3f83 at /dev/vda
Aug 15 16:57:11 user nova-compute[72849]: DEBUG nova.policy [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe3f48f280e54c2099e6b1db842db2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87edcbec784a4f65b99740f34ff121bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG os_brick.utils [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[601ceeb4-7f29-4e21-bb64-eb39e84f3982]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecc7ed5-99e7-48c3-922a-92b3782e5624]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e97d6e-7913-4540-87be-fa7563b4af39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3e0f31-5ef3-4ca7-aedd-79680b90968e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 16:57:11 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 16:57:11 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ea3956-8a5e-477a-ac1b-b2a29c16637d]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG os_brick.utils [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Updating existing volume attachment record: a9078745-2f05-44fc-a1f2-dff5516ca949 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 16:57:11 user nova-compute[72849]: DEBUG nova.network.neutron [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Successfully created port: abd90980-85c3-436c-8ee1-1188e2e028d3 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 16:57:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:12 user nova-compute[72849]: DEBUG nova.network.neutron [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Successfully updated port: abd90980-85c3-436c-8ee1-1188e2e028d3 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 16:57:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "refresh_cache-25f5bf26-4683-4c99-ae95-9080b07b0514" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:57:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquired lock "refresh_cache-25f5bf26-4683-4c99-ae95-9080b07b0514" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:57:12 user nova-compute[72849]: DEBUG nova.network.neutron [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 16:57:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-bd71f56d-8269-443e-9946-53b1d59b8756 req-311d2af7-8f9b-45cc-b0b2-b3b140b1d665 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Received event network-changed-abd90980-85c3-436c-8ee1-1188e2e028d3 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:57:12 user nova-compute[72849]: DEBUG nova.compute.manager [req-bd71f56d-8269-443e-9946-53b1d59b8756 req-311d2af7-8f9b-45cc-b0b2-b3b140b1d665 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Refreshing instance network info cache due to event network-changed-abd90980-85c3-436c-8ee1-1188e2e028d3. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:57:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-bd71f56d-8269-443e-9946-53b1d59b8756 req-311d2af7-8f9b-45cc-b0b2-b3b140b1d665 service nova] Acquiring lock "refresh_cache-25f5bf26-4683-4c99-ae95-9080b07b0514" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:57:12 user nova-compute[72849]: DEBUG nova.network.neutron [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 16:57:12 user nova-compute[72849]: DEBUG nova.network.neutron [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Updating instance_info_cache with network_info: [{"id": "abd90980-85c3-436c-8ee1-1188e2e028d3", "address": "fa:16:3e:f9:9f:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd90980-85", "ovs_interfaceid": "abd90980-85c3-436c-8ee1-1188e2e028d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:57:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Releasing lock "refresh_cache-25f5bf26-4683-4c99-ae95-9080b07b0514" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:57:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Instance network_info: |[{"id": "abd90980-85c3-436c-8ee1-1188e2e028d3", "address": "fa:16:3e:f9:9f:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd90980-85", "ovs_interfaceid": "abd90980-85c3-436c-8ee1-1188e2e028d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 16:57:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-bd71f56d-8269-443e-9946-53b1d59b8756 req-311d2af7-8f9b-45cc-b0b2-b3b140b1d665 service nova] Acquired lock "refresh_cache-25f5bf26-4683-4c99-ae95-9080b07b0514" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:57:12 user nova-compute[72849]: DEBUG nova.network.neutron [req-bd71f56d-8269-443e-9946-53b1d59b8756 req-311d2af7-8f9b-45cc-b0b2-b3b140b1d665 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Refreshing network info cache for port abd90980-85c3-436c-8ee1-1188e2e028d3 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:57:13 user nova-compute[72849]: DEBUG nova.network.neutron [req-bd71f56d-8269-443e-9946-53b1d59b8756 req-311d2af7-8f9b-45cc-b0b2-b3b140b1d665 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Updated VIF entry in instance network info cache for port abd90980-85c3-436c-8ee1-1188e2e028d3. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:57:13 user nova-compute[72849]: DEBUG nova.network.neutron [req-bd71f56d-8269-443e-9946-53b1d59b8756 req-311d2af7-8f9b-45cc-b0b2-b3b140b1d665 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Updating instance_info_cache with network_info: [{"id": "abd90980-85c3-436c-8ee1-1188e2e028d3", "address": "fa:16:3e:f9:9f:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd90980-85", "ovs_interfaceid": "abd90980-85c3-436c-8ee1-1188e2e028d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:57:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-bd71f56d-8269-443e-9946-53b1d59b8756 req-311d2af7-8f9b-45cc-b0b2-b3b140b1d665 service nova] Releasing lock "refresh_cache-25f5bf26-4683-4c99-ae95-9080b07b0514" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:57:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 16:57:20 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Creating image(s)
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Did not create local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Ensure instance console log exists: /opt/stack/data/nova/instances/25f5bf26-4683-4c99-ae95-9080b07b0514/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Start _get_guest_xml network_info=[{"id": "abd90980-85c3-436c-8ee1-1188e2e028d3", "address": "fa:16:3e:f9:9f:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd90980-85", "ovs_interfaceid": "abd90980-85c3-436c-8ee1-1188e2e028d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfMrTsmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '25f5bf26-4683-4c99-ae95-9080b07b0514', 'attached_at': '', 'detached_at': '', 'volume_id': '99966c5e-eec3-4c28-862e-fbdc9c8e3f83', 'serial': '99966c5e-eec3-4c28-862e-fbdc9c8e3f83'}, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'a9078745-2f05-44fc-a1f2-dff5516ca949', 'volume_type': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 16:57:20 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:57:20 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfMrTsmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:57:20 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:57:20 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:57:20 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d987e750-5393-44b0-9809-2bb28c6b6bbb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 16:57:20 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b041e9a-422d-4d9f-b844-238b9bae2c82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83] added
Aug 15 16:57:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ea3bd1-6724-41d6-8a65-4ee29725d2bd]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8eb3dca-825e-4f55-bfdb-bf388db6b921]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RfMrTsmK {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RfMrTsmK" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eef2824-85e8-4203-8e67-47af635f1f4f]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RfMrTsmK'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32b02e5-b30f-4423-a6d4-173a211d0e50]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed96acf7-df8f-469a-8a22-0d78c43711b4]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)
Aug 15 16:57:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)
Aug 15 16:57:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fc20f9-db6b-4075-b5a9-d2df4cd45bbd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83, portal: 172.16.0.220,3260]
Aug 15 16:57:20 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83, portal: 172.16.0.220,3260] successful.
Aug 15 16:57:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a09381-369b-49ec-816f-cda89ae3f538]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb50486-d72b-4b09-a9d6-70b642140ac3]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)
Aug 15 16:57:20 user nova-compute[72849]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 (non-flash)
Aug 15 16:57:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)
Aug 15 16:57:20 user nova-compute[72849]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 (non-flash)
Aug 15 16:57:20 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3ef4af-5268-46f4-9b93-d55dfba60638]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 16:57:20 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfMrTsmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23665616432383366', 'path': '/dev/sdc'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665616432383366', 'path': '/dev/sdc'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:57:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1087427373',display_name='tempest-TestVolumeBootPattern-server-1087427373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1087427373',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFwEX72mp3NUKtYVln/Z+8GBwAx+xwvd9Fh1Mp2Wo1kGDe71MixlTitg7j4YrqUQjn7OCDU06CqQdMxxXQ6ba1l/e9gv1vFv9Hg9h2krod/tMNxb2w9GPXstWzAUISHAw==',key_name='tempest-TestVolumeBootPattern-1380441197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87edcbec784a4f65b99740f34ff121bb',ramdisk_id='',reservation_id='r-0jnan23n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1900922481',owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:57:11Z,user_data=None,user_id='fe3f48f280e54c2099e6b1db842db2cd',uuid=25f5bf26-4683-4c99-ae95-9080b07b0514,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abd90980-85c3-436c-8ee1-1188e2e028d3", "address": "fa:16:3e:f9:9f:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd90980-85", "ovs_interfaceid": "abd90980-85c3-436c-8ee1-1188e2e028d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converting VIF {"id": "abd90980-85c3-436c-8ee1-1188e2e028d3", "address": "fa:16:3e:f9:9f:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd90980-85", "ovs_interfaceid": "abd90980-85c3-436c-8ee1-1188e2e028d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:9f:16,bridge_name='br-int',has_traffic_filtering=True,id=abd90980-85c3-436c-8ee1-1188e2e028d3,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd90980-85') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG nova.objects.instance [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lazy-loading 'pci_devices' on Instance uuid 25f5bf26-4683-4c99-ae95-9080b07b0514 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] End _get_guest_xml xml=<domain type="kvm">
Aug 15 16:57:21 user nova-compute[72849]:   <uuid>25f5bf26-4683-4c99-ae95-9080b07b0514</uuid>
Aug 15 16:57:21 user nova-compute[72849]:   <name>instance-00000034</name>
Aug 15 16:57:21 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 16:57:21 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 16:57:21 user nova-compute[72849]:   <metadata>
Aug 15 16:57:21 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 16:57:21 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 16:57:21 user nova-compute[72849]:       <nova:name>tempest-TestVolumeBootPattern-server-1087427373</nova:name>
Aug 15 16:57:21 user nova-compute[72849]:       <nova:creationTime>2023-08-15 16:57:20</nova:creationTime>
Aug 15 16:57:21 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 16:57:21 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 16:57:21 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 16:57:21 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 16:57:21 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 16:57:21 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 16:57:21 user nova-compute[72849]:       </nova:flavor>
Aug 15 16:57:21 user nova-compute[72849]:       <nova:owner>
Aug 15 16:57:21 user nova-compute[72849]:         <nova:user uuid="fe3f48f280e54c2099e6b1db842db2cd">tempest-TestVolumeBootPattern-1900922481-project-member</nova:user>
Aug 15 16:57:21 user nova-compute[72849]:         <nova:project uuid="87edcbec784a4f65b99740f34ff121bb">tempest-TestVolumeBootPattern-1900922481</nova:project>
Aug 15 16:57:21 user nova-compute[72849]:       </nova:owner>
Aug 15 16:57:21 user nova-compute[72849]:       <nova:ports>
Aug 15 16:57:21 user nova-compute[72849]:         <nova:port uuid="abd90980-85c3-436c-8ee1-1188e2e028d3">
Aug 15 16:57:21 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 16:57:21 user nova-compute[72849]:         </nova:port>
Aug 15 16:57:21 user nova-compute[72849]:       </nova:ports>
Aug 15 16:57:21 user nova-compute[72849]:     </nova:instance>
Aug 15 16:57:21 user nova-compute[72849]:   </metadata>
Aug 15 16:57:21 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 16:57:21 user nova-compute[72849]:     <system>
Aug 15 16:57:21 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 16:57:21 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 16:57:21 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 16:57:21 user nova-compute[72849]:       <entry name="serial">25f5bf26-4683-4c99-ae95-9080b07b0514</entry>
Aug 15 16:57:21 user nova-compute[72849]:       <entry name="uuid">25f5bf26-4683-4c99-ae95-9080b07b0514</entry>
Aug 15 16:57:21 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 16:57:21 user nova-compute[72849]:     </system>
Aug 15 16:57:21 user nova-compute[72849]:   </sysinfo>
Aug 15 16:57:21 user nova-compute[72849]:   <os>
Aug 15 16:57:21 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 16:57:21 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 16:57:21 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 16:57:21 user nova-compute[72849]:   </os>
Aug 15 16:57:21 user nova-compute[72849]:   <features>
Aug 15 16:57:21 user nova-compute[72849]:     <acpi/>
Aug 15 16:57:21 user nova-compute[72849]:     <apic/>
Aug 15 16:57:21 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 16:57:21 user nova-compute[72849]:   </features>
Aug 15 16:57:21 user nova-compute[72849]:   <clock offset="utc">
Aug 15 16:57:21 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 16:57:21 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 16:57:21 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 16:57:21 user nova-compute[72849]:   </clock>
Aug 15 16:57:21 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 16:57:21 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 16:57:21 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 16:57:21 user nova-compute[72849]:   </cpu>
Aug 15 16:57:21 user nova-compute[72849]:   <devices>
Aug 15 16:57:21 user nova-compute[72849]:     <disk type="block" device="disk">
Aug 15 16:57:21 user nova-compute[72849]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 16:57:21 user nova-compute[72849]:       <source dev="/dev/sdc"/>
Aug 15 16:57:21 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 16:57:21 user nova-compute[72849]:       <serial>99966c5e-eec3-4c28-862e-fbdc9c8e3f83</serial>
Aug 15 16:57:21 user nova-compute[72849]:     </disk>
Aug 15 16:57:21 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 16:57:21 user nova-compute[72849]:       <mac address="fa:16:3e:f9:9f:16"/>
Aug 15 16:57:21 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:57:21 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 16:57:21 user nova-compute[72849]:       <target dev="tapabd90980-85"/>
Aug 15 16:57:21 user nova-compute[72849]:     </interface>
Aug 15 16:57:21 user nova-compute[72849]:     <serial type="pty">
Aug 15 16:57:21 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/25f5bf26-4683-4c99-ae95-9080b07b0514/console.log" append="off"/>
Aug 15 16:57:21 user nova-compute[72849]:     </serial>
Aug 15 16:57:21 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 16:57:21 user nova-compute[72849]:     <video>
Aug 15 16:57:21 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 16:57:21 user nova-compute[72849]:     </video>
Aug 15 16:57:21 user nova-compute[72849]:     <rng model="virtio">
Aug 15 16:57:21 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 16:57:21 user nova-compute[72849]:     </rng>
Aug 15 16:57:21 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 16:57:21 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 16:57:21 user nova-compute[72849]:       <stats period="10"/>
Aug 15 16:57:21 user nova-compute[72849]:     </memballoon>
Aug 15 16:57:21 user nova-compute[72849]:   </devices>
Aug 15 16:57:21 user nova-compute[72849]: </domain>
Aug 15 16:57:21 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:57:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1087427373',display_name='tempest-TestVolumeBootPattern-server-1087427373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1087427373',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFwEX72mp3NUKtYVln/Z+8GBwAx+xwvd9Fh1Mp2Wo1kGDe71MixlTitg7j4YrqUQjn7OCDU06CqQdMxxXQ6ba1l/e9gv1vFv9Hg9h2krod/tMNxb2w9GPXstWzAUISHAw==',key_name='tempest-TestVolumeBootPattern-1380441197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87edcbec784a4f65b99740f34ff121bb',ramdisk_id='',reservation_id='r-0jnan23n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1900922481',owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T16:57:11Z,user_data=None,user_id='fe3f48f280e54c2099e6b1db842db2cd',uuid=25f5bf26-4683-4c99-ae95-9080b07b0514,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abd90980-85c3-436c-8ee1-1188e2e028d3", "address": "fa:16:3e:f9:9f:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd90980-85", "ovs_interfaceid": "abd90980-85c3-436c-8ee1-1188e2e028d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converting VIF {"id": "abd90980-85c3-436c-8ee1-1188e2e028d3", "address": "fa:16:3e:f9:9f:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd90980-85", "ovs_interfaceid": "abd90980-85c3-436c-8ee1-1188e2e028d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:9f:16,bridge_name='br-int',has_traffic_filtering=True,id=abd90980-85c3-436c-8ee1-1188e2e028d3,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd90980-85') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG os_vif [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:9f:16,bridge_name='br-int',has_traffic_filtering=True,id=abd90980-85c3-436c-8ee1-1188e2e028d3,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd90980-85') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabd90980-85, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapabd90980-85, col_values=(('external_ids', {'iface-id': 'abd90980-85c3-436c-8ee1-1188e2e028d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:9f:16', 'vm-uuid': '25f5bf26-4683-4c99-ae95-9080b07b0514'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:21 user nova-compute[72849]: INFO os_vif [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:9f:16,bridge_name='br-int',has_traffic_filtering=True,id=abd90980-85c3-436c-8ee1-1188e2e028d3,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd90980-85')
Aug 15 16:57:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 16:57:21 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] No VIF found with MAC fa:16:3e:f9:9f:16, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 16:57:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:23 user nova-compute[72849]: DEBUG nova.compute.manager [req-9263da4f-4c36-407f-9358-ac1e3c6bfe67 req-7df6baa8-bff5-448f-9d4f-532e83c77ded service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Received event network-vif-plugged-abd90980-85c3-436c-8ee1-1188e2e028d3 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:57:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9263da4f-4c36-407f-9358-ac1e3c6bfe67 req-7df6baa8-bff5-448f-9d4f-532e83c77ded service nova] Acquiring lock "25f5bf26-4683-4c99-ae95-9080b07b0514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:57:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9263da4f-4c36-407f-9358-ac1e3c6bfe67 req-7df6baa8-bff5-448f-9d4f-532e83c77ded service nova] Lock "25f5bf26-4683-4c99-ae95-9080b07b0514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:57:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9263da4f-4c36-407f-9358-ac1e3c6bfe67 req-7df6baa8-bff5-448f-9d4f-532e83c77ded service nova] Lock "25f5bf26-4683-4c99-ae95-9080b07b0514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:57:23 user nova-compute[72849]: DEBUG nova.compute.manager [req-9263da4f-4c36-407f-9358-ac1e3c6bfe67 req-7df6baa8-bff5-448f-9d4f-532e83c77ded service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] No waiting events found dispatching network-vif-plugged-abd90980-85c3-436c-8ee1-1188e2e028d3 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:57:23 user nova-compute[72849]: WARNING nova.compute.manager [req-9263da4f-4c36-407f-9358-ac1e3c6bfe67 req-7df6baa8-bff5-448f-9d4f-532e83c77ded service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Received unexpected event network-vif-plugged-abd90980-85c3-436c-8ee1-1188e2e028d3 for instance with vm_state building and task_state spawning.
Aug 15 16:57:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:24 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692118644.9445913, 25f5bf26-4683-4c99-ae95-9080b07b0514 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:57:24 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] VM Resumed (Lifecycle Event)
Aug 15 16:57:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 16:57:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 16:57:24 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Instance spawned successfully.
Aug 15 16:57:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 16:57:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:57:24 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:57:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:57:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:57:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:57:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:57:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:57:24 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 16:57:24 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:57:24 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692118644.947828, 25f5bf26-4683-4c99-ae95-9080b07b0514 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:57:24 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] VM Started (Lifecycle Event)
Aug 15 16:57:25 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:57:25 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 16:57:25 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 16:57:25 user nova-compute[72849]: INFO nova.compute.manager [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Took 4.87 seconds to spawn the instance on the hypervisor.
Aug 15 16:57:25 user nova-compute[72849]: DEBUG nova.compute.manager [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:57:25 user nova-compute[72849]: INFO nova.compute.manager [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Took 14.35 seconds to build instance.
Aug 15 16:57:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-794e1b49-1fdc-4c2a-96b3-cf985e74b783 req-171d87ef-4280-4658-9edb-82ad4950aca5 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Received event network-vif-plugged-abd90980-85c3-436c-8ee1-1188e2e028d3 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:57:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-794e1b49-1fdc-4c2a-96b3-cf985e74b783 req-171d87ef-4280-4658-9edb-82ad4950aca5 service nova] Acquiring lock "25f5bf26-4683-4c99-ae95-9080b07b0514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:57:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-794e1b49-1fdc-4c2a-96b3-cf985e74b783 req-171d87ef-4280-4658-9edb-82ad4950aca5 service nova] Lock "25f5bf26-4683-4c99-ae95-9080b07b0514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:57:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-794e1b49-1fdc-4c2a-96b3-cf985e74b783 req-171d87ef-4280-4658-9edb-82ad4950aca5 service nova] Lock "25f5bf26-4683-4c99-ae95-9080b07b0514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:57:25 user nova-compute[72849]: DEBUG nova.compute.manager [req-794e1b49-1fdc-4c2a-96b3-cf985e74b783 req-171d87ef-4280-4658-9edb-82ad4950aca5 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] No waiting events found dispatching network-vif-plugged-abd90980-85c3-436c-8ee1-1188e2e028d3 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:57:25 user nova-compute[72849]: WARNING nova.compute.manager [req-794e1b49-1fdc-4c2a-96b3-cf985e74b783 req-171d87ef-4280-4658-9edb-82ad4950aca5 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Received unexpected event network-vif-plugged-abd90980-85c3-436c-8ee1-1188e2e028d3 for instance with vm_state active and task_state None.
Aug 15 16:57:25 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-4ec9fb67-cced-419b-8d16-8d087183933e tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "25f5bf26-4683-4c99-ae95-9080b07b0514" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.448s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:57:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:57:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:57:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:57:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:57:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:51 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:57:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:57:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:57:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:57:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:57:51 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:57:51 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid b9c0e14e-2356-48b8-bcbf-adc4f2755e41 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:57:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:52 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Updating instance_info_cache with network_info: [{"id": "5c2b9c43-3698-434a-8868-7391c2254764", "address": "fa:16:3e:7f:57:04", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2b9c43-36", "ovs_interfaceid": "5c2b9c43-3698-434a-8868-7391c2254764", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:57:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:57:52 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:57:52 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:57:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:57:58 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:57:59 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:58:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:58:02 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:58:02 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:58:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:58:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:58:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:58:02 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:58:02 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:58:02 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:58:02 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:58:02 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:58:02 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8608MB free_disk=25.208053588867188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:58:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:58:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:58:02 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b9c0e14e-2356-48b8-bcbf-adc4f2755e41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:58:02 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 25f5bf26-4683-4c99-ae95-9080b07b0514 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:58:02 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:58:02 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:58:02 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing inventories for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 16:58:02 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating ProviderTree inventory for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 16:58:02 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating inventory in ProviderTree for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 16:58:02 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing aggregate associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, aggregates: None {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 16:58:03 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing trait associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 16:58:03 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:58:03 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:58:03 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:58:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:58:03 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:58:03 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 16:58:03 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] There are 0 instances to clean {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 16:58:04 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:58:04 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:58:04 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:58:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:58:08 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:58:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:58:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:58:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:58:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:58:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:58:11 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:58:14 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:58:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72849) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 16:58:14 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:58:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:58:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:58:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:58:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:58:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:58:16 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:58:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:58:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:58:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:58:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:58:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:58:21 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:58:26 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:58:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:58:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:58:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:58:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:58:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:58:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:58:36 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:58:41 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:58:46 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:58:51 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:58:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:58:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-25f5bf26-4683-4c99-ae95-9080b07b0514" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:58:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-25f5bf26-4683-4c99-ae95-9080b07b0514" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:58:51 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:58:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:58:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:58:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 16:58:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:58:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 16:58:51 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:58:51 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Updating instance_info_cache with network_info: [{"id": "abd90980-85c3-436c-8ee1-1188e2e028d3", "address": "fa:16:3e:f9:9f:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd90980-85", "ovs_interfaceid": "abd90980-85c3-436c-8ee1-1188e2e028d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:58:51 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-25f5bf26-4683-4c99-ae95-9080b07b0514" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:58:51 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:58:52 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:58:56 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:58:59 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:59:00 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:59:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:59:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:59:02 user nova-compute[72849]: DEBUG nova.compute.manager [req-f7d46b1c-0c9d-4065-87b1-f13817afe3ee req-494fff58-e29e-4828-ad9d-3f5536ae5e89 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Received event network-changed-abd90980-85c3-436c-8ee1-1188e2e028d3 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:59:02 user nova-compute[72849]: DEBUG nova.compute.manager [req-f7d46b1c-0c9d-4065-87b1-f13817afe3ee req-494fff58-e29e-4828-ad9d-3f5536ae5e89 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Refreshing instance network info cache due to event network-changed-abd90980-85c3-436c-8ee1-1188e2e028d3. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:59:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f7d46b1c-0c9d-4065-87b1-f13817afe3ee req-494fff58-e29e-4828-ad9d-3f5536ae5e89 service nova] Acquiring lock "refresh_cache-25f5bf26-4683-4c99-ae95-9080b07b0514" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:59:02 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f7d46b1c-0c9d-4065-87b1-f13817afe3ee req-494fff58-e29e-4828-ad9d-3f5536ae5e89 service nova] Acquired lock "refresh_cache-25f5bf26-4683-4c99-ae95-9080b07b0514" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:59:02 user nova-compute[72849]: DEBUG nova.network.neutron [req-f7d46b1c-0c9d-4065-87b1-f13817afe3ee req-494fff58-e29e-4828-ad9d-3f5536ae5e89 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Refreshing network info cache for port abd90980-85c3-436c-8ee1-1188e2e028d3 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:59:03 user nova-compute[72849]: DEBUG nova.network.neutron [req-f7d46b1c-0c9d-4065-87b1-f13817afe3ee req-494fff58-e29e-4828-ad9d-3f5536ae5e89 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Updated VIF entry in instance network info cache for port abd90980-85c3-436c-8ee1-1188e2e028d3. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:59:03 user nova-compute[72849]: DEBUG nova.network.neutron [req-f7d46b1c-0c9d-4065-87b1-f13817afe3ee req-494fff58-e29e-4828-ad9d-3f5536ae5e89 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Updating instance_info_cache with network_info: [{"id": "abd90980-85c3-436c-8ee1-1188e2e028d3", "address": "fa:16:3e:f9:9f:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd90980-85", "ovs_interfaceid": "abd90980-85c3-436c-8ee1-1188e2e028d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:59:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f7d46b1c-0c9d-4065-87b1-f13817afe3ee req-494fff58-e29e-4828-ad9d-3f5536ae5e89 service nova] Releasing lock "refresh_cache-25f5bf26-4683-4c99-ae95-9080b07b0514" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:59:03 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:59:03 user nova-compute[72849]: DEBUG nova.compute.manager [req-3d4fcb50-0377-4192-9152-e26f56d85b90 req-adb368e9-1965-42be-a8ea-fc1a370fcda3 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Received event network-changed-abd90980-85c3-436c-8ee1-1188e2e028d3 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:59:03 user nova-compute[72849]: DEBUG nova.compute.manager [req-3d4fcb50-0377-4192-9152-e26f56d85b90 req-adb368e9-1965-42be-a8ea-fc1a370fcda3 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Refreshing instance network info cache due to event network-changed-abd90980-85c3-436c-8ee1-1188e2e028d3. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 16:59:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3d4fcb50-0377-4192-9152-e26f56d85b90 req-adb368e9-1965-42be-a8ea-fc1a370fcda3 service nova] Acquiring lock "refresh_cache-25f5bf26-4683-4c99-ae95-9080b07b0514" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:59:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3d4fcb50-0377-4192-9152-e26f56d85b90 req-adb368e9-1965-42be-a8ea-fc1a370fcda3 service nova] Acquired lock "refresh_cache-25f5bf26-4683-4c99-ae95-9080b07b0514" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:59:03 user nova-compute[72849]: DEBUG nova.network.neutron [req-3d4fcb50-0377-4192-9152-e26f56d85b90 req-adb368e9-1965-42be-a8ea-fc1a370fcda3 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Refreshing network info cache for port abd90980-85c3-436c-8ee1-1188e2e028d3 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 16:59:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "25f5bf26-4683-4c99-ae95-9080b07b0514" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:59:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "25f5bf26-4683-4c99-ae95-9080b07b0514" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:59:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "25f5bf26-4683-4c99-ae95-9080b07b0514-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:59:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "25f5bf26-4683-4c99-ae95-9080b07b0514-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:59:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "25f5bf26-4683-4c99-ae95-9080b07b0514-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:59:03 user nova-compute[72849]: INFO nova.compute.manager [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Terminating instance
Aug 15 16:59:03 user nova-compute[72849]: DEBUG nova.compute.manager [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 16:59:03 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG nova.network.neutron [req-3d4fcb50-0377-4192-9152-e26f56d85b90 req-adb368e9-1965-42be-a8ea-fc1a370fcda3 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Updated VIF entry in instance network info cache for port abd90980-85c3-436c-8ee1-1188e2e028d3. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG nova.network.neutron [req-3d4fcb50-0377-4192-9152-e26f56d85b90 req-adb368e9-1965-42be-a8ea-fc1a370fcda3 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Updating instance_info_cache with network_info: [{"id": "abd90980-85c3-436c-8ee1-1188e2e028d3", "address": "fa:16:3e:f9:9f:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd90980-85", "ovs_interfaceid": "abd90980-85c3-436c-8ee1-1188e2e028d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-3d4fcb50-0377-4192-9152-e26f56d85b90 req-adb368e9-1965-42be-a8ea-fc1a370fcda3 service nova] Releasing lock "refresh_cache-25f5bf26-4683-4c99-ae95-9080b07b0514" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:59:04 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Instance destroyed successfully.
Aug 15 16:59:04 user nova-compute[72849]: DEBUG nova.objects.instance [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lazy-loading 'resources' on Instance uuid 25f5bf26-4683-4c99-ae95-9080b07b0514 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:57:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1087427373',display_name='tempest-TestVolumeBootPattern-server-1087427373',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1087427373',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFwEX72mp3NUKtYVln/Z+8GBwAx+xwvd9Fh1Mp2Wo1kGDe71MixlTitg7j4YrqUQjn7OCDU06CqQdMxxXQ6ba1l/e9gv1vFv9Hg9h2krod/tMNxb2w9GPXstWzAUISHAw==',key_name='tempest-TestVolumeBootPattern-1380441197',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:57:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87edcbec784a4f65b99740f34ff121bb',ramdisk_id='',reservation_id='r-0jnan23n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1900922481',owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:57:25Z,user_data=None,user_id='fe3f48f280e54c2099e6b1db842db2cd',uuid=25f5bf26-4683-4c99-ae95-9080b07b0514,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abd90980-85c3-436c-8ee1-1188e2e028d3", "address": "fa:16:3e:f9:9f:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd90980-85", "ovs_interfaceid": "abd90980-85c3-436c-8ee1-1188e2e028d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converting VIF {"id": "abd90980-85c3-436c-8ee1-1188e2e028d3", "address": "fa:16:3e:f9:9f:16", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd90980-85", "ovs_interfaceid": "abd90980-85c3-436c-8ee1-1188e2e028d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:9f:16,bridge_name='br-int',has_traffic_filtering=True,id=abd90980-85c3-436c-8ee1-1188e2e028d3,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd90980-85') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG os_vif [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:9f:16,bridge_name='br-int',has_traffic_filtering=True,id=abd90980-85c3-436c-8ee1-1188e2e028d3,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd90980-85') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabd90980-85, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:59:04 user nova-compute[72849]: INFO os_vif [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:9f:16,bridge_name='br-int',has_traffic_filtering=True,id=abd90980-85c3-436c-8ee1-1188e2e028d3,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd90980-85')
Aug 15 16:59:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfMrTsmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 16:59:04 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 16:59:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1f73c2-42dd-4871-be7d-723bddcb61be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0c2b2e-49a1-4684-9a0b-c95026be9495]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)
Aug 15 16:59:04 user nova-compute[72849]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 (non-flash)
Aug 15 16:59:04 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)
Aug 15 16:59:04 user nova-compute[72849]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 (non-flash)
Aug 15 16:59:04 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc358297c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83'): ({'sdc'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Removing single pathed devices sdc {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ba1587-c97f-4f05-852f-5e97f64658fc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[925cb063-0768-4953-8fce-75ead743eb0b]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Flushing IO for device /dev/sdc {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 16:59:04 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[263eea68-9dbc-4336-981f-cf96518898a6]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:59:05 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:59:05 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 16:59:05 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=25.207313537597656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4cfd62-2f00-40c1-913d-d61bcbebd4ad]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] SCSI volumes sdc have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff7e31e-e302-41aa-8105-0eddc7258b95]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b9c0e14e-2356-48b8-bcbf-adc4f2755e41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 25f5bf26-4683-4c99-ae95-9080b07b0514 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7972c2c-3243-4e91-bd0e-81ece8582a07]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83, portal: 172.16.0.220,3260]
Aug 15 16:59:05 user nova-compute[72849]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83, portal: 172.16.0.220,3260] successful.
Aug 15 16:59:05 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99966c5e-eec3-4c28-862e-fbdc9c8e3f83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c05361-0661-4ccb-8113-31de6ffe6996]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.674s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] <== disconnect_volume: return (675ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 16:59:05 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Deleting instance files /opt/stack/data/nova/instances/25f5bf26-4683-4c99-ae95-9080b07b0514_del
Aug 15 16:59:05 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Deletion of /opt/stack/data/nova/instances/25f5bf26-4683-4c99-ae95-9080b07b0514_del complete
Aug 15 16:59:05 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:59:05 user nova-compute[72849]: INFO nova.compute.manager [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Took 1.54 seconds to destroy the instance on the hypervisor.
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-65fc55ec-a5c0-4b5b-b54b-cee1e8bf7a24 req-e6a29b99-eed3-40a5-9dbb-f5c36411e670 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Received event network-vif-unplugged-abd90980-85c3-436c-8ee1-1188e2e028d3 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-65fc55ec-a5c0-4b5b-b54b-cee1e8bf7a24 req-e6a29b99-eed3-40a5-9dbb-f5c36411e670 service nova] Acquiring lock "25f5bf26-4683-4c99-ae95-9080b07b0514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-65fc55ec-a5c0-4b5b-b54b-cee1e8bf7a24 req-e6a29b99-eed3-40a5-9dbb-f5c36411e670 service nova] Lock "25f5bf26-4683-4c99-ae95-9080b07b0514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-65fc55ec-a5c0-4b5b-b54b-cee1e8bf7a24 req-e6a29b99-eed3-40a5-9dbb-f5c36411e670 service nova] Lock "25f5bf26-4683-4c99-ae95-9080b07b0514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-65fc55ec-a5c0-4b5b-b54b-cee1e8bf7a24 req-e6a29b99-eed3-40a5-9dbb-f5c36411e670 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] No waiting events found dispatching network-vif-unplugged-abd90980-85c3-436c-8ee1-1188e2e028d3 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-65fc55ec-a5c0-4b5b-b54b-cee1e8bf7a24 req-e6a29b99-eed3-40a5-9dbb-f5c36411e670 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Received event network-vif-unplugged-abd90980-85c3-436c-8ee1-1188e2e028d3 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-65fc55ec-a5c0-4b5b-b54b-cee1e8bf7a24 req-e6a29b99-eed3-40a5-9dbb-f5c36411e670 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Received event network-vif-plugged-abd90980-85c3-436c-8ee1-1188e2e028d3 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-65fc55ec-a5c0-4b5b-b54b-cee1e8bf7a24 req-e6a29b99-eed3-40a5-9dbb-f5c36411e670 service nova] Acquiring lock "25f5bf26-4683-4c99-ae95-9080b07b0514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-65fc55ec-a5c0-4b5b-b54b-cee1e8bf7a24 req-e6a29b99-eed3-40a5-9dbb-f5c36411e670 service nova] Lock "25f5bf26-4683-4c99-ae95-9080b07b0514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-65fc55ec-a5c0-4b5b-b54b-cee1e8bf7a24 req-e6a29b99-eed3-40a5-9dbb-f5c36411e670 service nova] Lock "25f5bf26-4683-4c99-ae95-9080b07b0514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:59:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-65fc55ec-a5c0-4b5b-b54b-cee1e8bf7a24 req-e6a29b99-eed3-40a5-9dbb-f5c36411e670 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] No waiting events found dispatching network-vif-plugged-abd90980-85c3-436c-8ee1-1188e2e028d3 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 16:59:05 user nova-compute[72849]: WARNING nova.compute.manager [req-65fc55ec-a5c0-4b5b-b54b-cee1e8bf7a24 req-e6a29b99-eed3-40a5-9dbb-f5c36411e670 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Received unexpected event network-vif-plugged-abd90980-85c3-436c-8ee1-1188e2e028d3 for instance with vm_state active and task_state deleting.
Aug 15 16:59:05 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:59:05 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Took 0.46 seconds to deallocate network for instance.
Aug 15 16:59:05 user nova-compute[72849]: DEBUG nova.compute.manager [req-34b244d9-79f8-4b11-b566-285c35824f8d req-3a8b46b4-78a0-402c-81a9-392e03480c20 service nova] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Received event network-vif-deleted-abd90980-85c3-436c-8ee1-1188e2e028d3 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 16:59:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:59:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:59:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 16:59:06 user nova-compute[72849]: INFO nova.compute.manager [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Took 0.75 seconds to detach 1 volumes for instance.
Aug 15 16:59:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 16:59:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 16:59:06 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 16:59:06 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 16:59:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:59:06 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Deleted allocations for instance 25f5bf26-4683-4c99-ae95-9080b07b0514
Aug 15 16:59:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-dc65ff81-3e20-4a58-b576-4dacaf21ada2 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "25f5bf26-4683-4c99-ae95-9080b07b0514" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.066s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 16:59:09 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:59:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:59:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:59:19 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692118744.6797686, 25f5bf26-4683-4c99-ae95-9080b07b0514 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 16:59:19 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] VM Stopped (Lifecycle Event)
Aug 15 16:59:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-778146cd-940a-4c1b-9283-6387d03579c5 None None] [instance: 25f5bf26-4683-4c99-ae95-9080b07b0514] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 16:59:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:59:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:59:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:59:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:59:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:59:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:59:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 16:59:52 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:59:53 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 16:59:53 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 16:59:53 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 16:59:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 16:59:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 16:59:53 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 16:59:53 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid b9c0e14e-2356-48b8-bcbf-adc4f2755e41 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 16:59:53 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Updating instance_info_cache with network_info: [{"id": "5c2b9c43-3698-434a-8868-7391c2254764", "address": "fa:16:3e:7f:57:04", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2b9c43-36", "ovs_interfaceid": "5c2b9c43-3698-434a-8868-7391c2254764", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 16:59:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 16:59:53 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 16:59:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 16:59:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:00 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:00:01 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:00:03 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:00:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:00:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:00:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:00:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:00:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:05 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:00:05 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:00:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:00:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:00:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:00:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:00:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:00:06 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:00:06 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:00:06 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:00:06 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:00:06 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8778MB free_disk=25.206497192382812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:00:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:00:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:00:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:06 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance b9c0e14e-2356-48b8-bcbf-adc4f2755e41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:00:06 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:00:06 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:00:06 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:00:06 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:00:06 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:00:06 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-165c7569-9287-4181-b632-d56449c683a3 req-7093c31b-b45d-4cea-bc41-ae297fcca923 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Received event network-changed-5c2b9c43-3698-434a-8868-7391c2254764 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-165c7569-9287-4181-b632-d56449c683a3 req-7093c31b-b45d-4cea-bc41-ae297fcca923 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Refreshing instance network info cache due to event network-changed-5c2b9c43-3698-434a-8868-7391c2254764. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-165c7569-9287-4181-b632-d56449c683a3 req-7093c31b-b45d-4cea-bc41-ae297fcca923 service nova] Acquiring lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-165c7569-9287-4181-b632-d56449c683a3 req-7093c31b-b45d-4cea-bc41-ae297fcca923 service nova] Acquired lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG nova.network.neutron [req-165c7569-9287-4181-b632-d56449c683a3 req-7093c31b-b45d-4cea-bc41-ae297fcca923 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Refreshing network info cache for port 5c2b9c43-3698-434a-8868-7391c2254764 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:00:07 user nova-compute[72849]: INFO nova.compute.manager [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Terminating instance
Aug 15 17:00:07 user nova-compute[72849]: DEBUG nova.compute.manager [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG nova.network.neutron [req-165c7569-9287-4181-b632-d56449c683a3 req-7093c31b-b45d-4cea-bc41-ae297fcca923 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Updated VIF entry in instance network info cache for port 5c2b9c43-3698-434a-8868-7391c2254764. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG nova.network.neutron [req-165c7569-9287-4181-b632-d56449c683a3 req-7093c31b-b45d-4cea-bc41-ae297fcca923 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Updating instance_info_cache with network_info: [{"id": "5c2b9c43-3698-434a-8868-7391c2254764", "address": "fa:16:3e:7f:57:04", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2b9c43-36", "ovs_interfaceid": "5c2b9c43-3698-434a-8868-7391c2254764", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-9a3f7646-922c-482a-b197-1a850c9ad45a req-5aa9595d-6e12-4161-8a35-c76d7cc24cad service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Received event network-vif-unplugged-5c2b9c43-3698-434a-8868-7391c2254764 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9a3f7646-922c-482a-b197-1a850c9ad45a req-5aa9595d-6e12-4161-8a35-c76d7cc24cad service nova] Acquiring lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9a3f7646-922c-482a-b197-1a850c9ad45a req-5aa9595d-6e12-4161-8a35-c76d7cc24cad service nova] Lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-9a3f7646-922c-482a-b197-1a850c9ad45a req-5aa9595d-6e12-4161-8a35-c76d7cc24cad service nova] Lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-9a3f7646-922c-482a-b197-1a850c9ad45a req-5aa9595d-6e12-4161-8a35-c76d7cc24cad service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] No waiting events found dispatching network-vif-unplugged-5c2b9c43-3698-434a-8868-7391c2254764 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG nova.compute.manager [req-9a3f7646-922c-482a-b197-1a850c9ad45a req-5aa9595d-6e12-4161-8a35-c76d7cc24cad service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Received event network-vif-unplugged-5c2b9c43-3698-434a-8868-7391c2254764 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-165c7569-9287-4181-b632-d56449c683a3 req-7093c31b-b45d-4cea-bc41-ae297fcca923 service nova] Releasing lock "refresh_cache-b9c0e14e-2356-48b8-bcbf-adc4f2755e41" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:00:07 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Instance destroyed successfully.
Aug 15 17:00:07 user nova-compute[72849]: DEBUG nova.objects.instance [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lazy-loading 'resources' on Instance uuid b9c0e14e-2356-48b8-bcbf-adc4f2755e41 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T16:55:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1792446250',display_name='tempest-TestVolumeBootPattern-server-1792446250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1792446250',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFwEX72mp3NUKtYVln/Z+8GBwAx+xwvd9Fh1Mp2Wo1kGDe71MixlTitg7j4YrqUQjn7OCDU06CqQdMxxXQ6ba1l/e9gv1vFv9Hg9h2krod/tMNxb2w9GPXstWzAUISHAw==',key_name='tempest-TestVolumeBootPattern-1380441197',keypairs=<?>,launch_index=0,launched_at=2023-08-15T16:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87edcbec784a4f65b99740f34ff121bb',ramdisk_id='',reservation_id='r-zcal7mzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1900922481',owner_user_name='tempest-TestVolumeBootPattern-1900922481-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T16:55:21Z,user_data=None,user_id='fe3f48f280e54c2099e6b1db842db2cd',uuid=b9c0e14e-2356-48b8-bcbf-adc4f2755e41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c2b9c43-3698-434a-8868-7391c2254764", "address": "fa:16:3e:7f:57:04", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2b9c43-36", "ovs_interfaceid": "5c2b9c43-3698-434a-8868-7391c2254764", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converting VIF {"id": "5c2b9c43-3698-434a-8868-7391c2254764", "address": "fa:16:3e:7f:57:04", "network": {"id": "7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-215532220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87edcbec784a4f65b99740f34ff121bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2b9c43-36", "ovs_interfaceid": "5c2b9c43-3698-434a-8868-7391c2254764", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:57:04,bridge_name='br-int',has_traffic_filtering=True,id=5c2b9c43-3698-434a-8868-7391c2254764,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2b9c43-36') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG os_vif [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:57:04,bridge_name='br-int',has_traffic_filtering=True,id=5c2b9c43-3698-434a-8868-7391c2254764,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2b9c43-36') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c2b9c43-36, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:00:07 user nova-compute[72849]: INFO os_vif [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:57:04,bridge_name='br-int',has_traffic_filtering=True,id=5c2b9c43-3698-434a-8868-7391c2254764,network=Network(7cfa3e8c-e0cd-429a-ac3b-8a7ccb5e6930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2b9c43-36')
Aug 15 17:00:07 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LFJDjyKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:00:07 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:00:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37ac8e3-32f3-4696-8884-d2565b64d23c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73b03ab-55fe-40ef-a969-2747d49f146b]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)
Aug 15 17:00:07 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c (non-flash)
Aug 15 17:00:07 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc33860f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe56026b-eaa5-43bd-b0e1-4bc783c2f540]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[927d9486-f480-42fc-8158-3edc4889c4d1]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e0f316-7ff8-4383-83fe-c4085ef3dd54]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:00:07 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ea6346-661a-4a2b-995a-05789b8969f9]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26637353263633036', '/dev/disk/by-id/scsi-1SCST_BIOf241c61b-f752cc06a5c75a24', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f241c61b') {{(pid=84060) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa0df42-81e7-469b-afb5-74ee35986da9]: (4, None) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[83108817-bf40-4103-adf7-52dacc14851d]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f068d7c5-5b30-47c1-8f9b-585346e5b1ac]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c, portal: 172.16.0.220,3260]
Aug 15 17:00:08 user nova-compute[72849]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c, portal: 172.16.0.220,3260] successful.
Aug 15 17:00:08 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d73236-1389-4b02-b2d8-5f397f18a05c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7bb4ae-d439-474f-8152-52770335ab9b]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] <== disconnect_volume: return (260ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:00:08 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Deleting instance files /opt/stack/data/nova/instances/b9c0e14e-2356-48b8-bcbf-adc4f2755e41_del
Aug 15 17:00:08 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Deletion of /opt/stack/data/nova/instances/b9c0e14e-2356-48b8-bcbf-adc4f2755e41_del complete
Aug 15 17:00:08 user nova-compute[72849]: INFO nova.compute.manager [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 15 17:00:08 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:00:08 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:00:08 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Took 0.50 seconds to deallocate network for instance.
Aug 15 17:00:08 user nova-compute[72849]: DEBUG nova.compute.manager [req-2db5a3e8-dc98-45e2-859d-6130c6e88f9d req-531fb98a-2fc5-4c47-94b7-50b9c0f4bfba service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Received event network-vif-deleted-5c2b9c43-3698-434a-8868-7391c2254764 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:00:09 user nova-compute[72849]: INFO nova.compute.manager [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Took 0.78 seconds to detach 1 volumes for instance.
Aug 15 17:00:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-4c70ebba-4652-41e4-a299-df651d1a7130 req-98d0664a-e3d2-4d61-a8e9-14cf3359c3a0 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Received event network-vif-plugged-5c2b9c43-3698-434a-8868-7391c2254764 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:00:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4c70ebba-4652-41e4-a299-df651d1a7130 req-98d0664a-e3d2-4d61-a8e9-14cf3359c3a0 service nova] Acquiring lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:00:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4c70ebba-4652-41e4-a299-df651d1a7130 req-98d0664a-e3d2-4d61-a8e9-14cf3359c3a0 service nova] Lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:00:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4c70ebba-4652-41e4-a299-df651d1a7130 req-98d0664a-e3d2-4d61-a8e9-14cf3359c3a0 service nova] Lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:00:09 user nova-compute[72849]: DEBUG nova.compute.manager [req-4c70ebba-4652-41e4-a299-df651d1a7130 req-98d0664a-e3d2-4d61-a8e9-14cf3359c3a0 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] No waiting events found dispatching network-vif-plugged-5c2b9c43-3698-434a-8868-7391c2254764 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:00:09 user nova-compute[72849]: WARNING nova.compute.manager [req-4c70ebba-4652-41e4-a299-df651d1a7130 req-98d0664a-e3d2-4d61-a8e9-14cf3359c3a0 service nova] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Received unexpected event network-vif-plugged-5c2b9c43-3698-434a-8868-7391c2254764 for instance with vm_state active and task_state deleting.
Aug 15 17:00:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:00:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:00:09 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:00:09 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:00:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:00:09 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Deleted allocations for instance b9c0e14e-2356-48b8-bcbf-adc4f2755e41
Aug 15 17:00:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-0ba49ea4-3616-4c5f-8c4a-866129d1d768 tempest-TestVolumeBootPattern-1900922481 tempest-TestVolumeBootPattern-1900922481-project-member] Lock "b9c0e14e-2356-48b8-bcbf-adc4f2755e41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.846s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:00:09 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:00:12 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:22 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692118807.849056, b9c0e14e-2356-48b8-bcbf-adc4f2755e41 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:00:22 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] VM Stopped (Lifecycle Event)
Aug 15 17:00:22 user nova-compute[72849]: DEBUG nova.compute.manager [None req-fa0e9cca-c3f7-4984-af17-5c7230709373 None None] [instance: b9c0e14e-2356-48b8-bcbf-adc4f2755e41] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:00:22 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:27 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:00:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:00:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:00:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:00:32 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:37 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:00:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:00:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:00:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:00:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:00:47 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:52 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:00:52 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:00:53 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:00:53 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:00:53 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 17:00:53 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Didn't find any instances for network info cache update. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 17:00:57 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:00 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:01:02 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:03 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:01:03 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:01:05 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:01:05 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:01:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:01:06 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:07 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:07 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:01:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:01:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:01:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:01:07 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:01:07 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:01:07 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:01:07 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8901MB free_disk=25.197429656982422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:01:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:01:07 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:01:08 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:01:08 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:01:08 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:08 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:01:08 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:01:08 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:01:08 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.590s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:01:10 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:01:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:11 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:01:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:18 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:23 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:28 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:33 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:38 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:42 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:43 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:48 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:53 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:53 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:01:54 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:01:54 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:01:54 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 17:01:54 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Didn't find any instances for network info cache update. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 17:01:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:01:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:01:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Starting instance... {{(pid=72849) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:01:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:01:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:01:56 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72849) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:01:56 user nova-compute[72849]: INFO nova.compute.claims [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Claim successful on node user
Aug 15 17:01:56 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:01:56 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:01:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:01:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Start building networks asynchronously for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Allocating IP information in the background. {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG nova.network.neutron [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] allocate_for_instance() {{(pid=72849) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:01:57 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:01:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Start building block device mappings for instance. {{(pid=72849) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG nova.policy [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c477b2393c34857a2bf812120b10f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008dbda477f24661b618327e725113f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Start spawning the instance on the hypervisor. {{(pid=72849) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Creating instance directory {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:01:57 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Creating image(s)
Aug 15 17:01:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "/opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "/opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.188s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.198s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk 1073741824 {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374,backing_fmt=raw /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk 1073741824" returned: 0 in 0.060s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "5a3de6adbdac338b1a14131bbbdecf29598c5374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3de6adbdac338b1a14131bbbdecf29598c5374 --force-share --output=json" returned: 0 in 0.199s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk. size=1073741824 {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:01:57 user nova-compute[72849]: DEBUG nova.network.neutron [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Successfully created port: 8673a770-b007-4e07-bdf0-dc458355a8c2 {{(pid=72849) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:01:58 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:01:58 user nova-compute[72849]: DEBUG nova.virt.disk.api [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Cannot resize image /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk to a smaller size. {{(pid=72849) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:01:58 user nova-compute[72849]: DEBUG nova.objects.instance [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lazy-loading 'migration_context' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:01:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Created local disks {{(pid=72849) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:01:58 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Ensure instance console log exists: /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/console.log {{(pid=72849) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:01:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:01:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:01:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:01:58 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:58 user nova-compute[72849]: DEBUG nova.network.neutron [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Successfully updated port: 8673a770-b007-4e07-bdf0-dc458355a8c2 {{(pid=72849) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:01:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:01:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquired lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:01:58 user nova-compute[72849]: DEBUG nova.network.neutron [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Building network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:01:58 user nova-compute[72849]: DEBUG nova.compute.manager [req-f2b6aecf-4932-48b1-97cd-7c5310df4e55 req-365b9816-47f5-415a-bf1f-795f330dbb33 service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Received event network-changed-8673a770-b007-4e07-bdf0-dc458355a8c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:01:58 user nova-compute[72849]: DEBUG nova.compute.manager [req-f2b6aecf-4932-48b1-97cd-7c5310df4e55 req-365b9816-47f5-415a-bf1f-795f330dbb33 service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Refreshing instance network info cache due to event network-changed-8673a770-b007-4e07-bdf0-dc458355a8c2. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:01:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f2b6aecf-4932-48b1-97cd-7c5310df4e55 req-365b9816-47f5-415a-bf1f-795f330dbb33 service nova] Acquiring lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:01:58 user nova-compute[72849]: DEBUG nova.network.neutron [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.network.neutron [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updating instance_info_cache with network_info: [{"id": "8673a770-b007-4e07-bdf0-dc458355a8c2", "address": "fa:16:3e:f0:21:fe", "network": {"id": "04bf90e9-c437-4411-8c4d-b3a80811c56b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-801476002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008dbda477f24661b618327e725113f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8673a770-b0", "ovs_interfaceid": "8673a770-b007-4e07-bdf0-dc458355a8c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Releasing lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.compute.manager [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Instance network_info: |[{"id": "8673a770-b007-4e07-bdf0-dc458355a8c2", "address": "fa:16:3e:f0:21:fe", "network": {"id": "04bf90e9-c437-4411-8c4d-b3a80811c56b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-801476002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008dbda477f24661b618327e725113f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8673a770-b0", "ovs_interfaceid": "8673a770-b007-4e07-bdf0-dc458355a8c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72849) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f2b6aecf-4932-48b1-97cd-7c5310df4e55 req-365b9816-47f5-415a-bf1f-795f330dbb33 service nova] Acquired lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.network.neutron [req-f2b6aecf-4932-48b1-97cd-7c5310df4e55 req-365b9816-47f5-415a-bf1f-795f330dbb33 service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Refreshing network info cache for port 8673a770-b007-4e07-bdf0-dc458355a8c2 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Start _get_guest_xml network_info=[{"id": "8673a770-b007-4e07-bdf0-dc458355a8c2", "address": "fa:16:3e:f0:21:fe", "network": {"id": "04bf90e9-c437-4411-8c4d-b3a80811c56b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-801476002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008dbda477f24661b618327e725113f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8673a770-b0", "ovs_interfaceid": "8673a770-b007-4e07-bdf0-dc458355a8c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '59265a51-1c51-4986-ae25-4fec6807c20c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:01:59 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:01:59 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] CPU controller missing on host. {{(pid=72849) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.host [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] CPU controller found on host. {{(pid=72849) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72849) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T16:12:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T16:12:41Z,direct_url=<?>,disk_format='qcow2',id=59265a51-1c51-4986-ae25-4fec6807c20c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ba67b7353904433812452ec00d567e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T16:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Got 1 possible topologies {{(pid=72849) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.hardware [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72849) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-727016478',display_name='tempest-SnapshotDataIntegrityTests-server-727016478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-727016478',id=53,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK/sKxxSecqmztkKZKNnjAxrlZy7XvZpqdSs1li1INPlisthOoKLBzz7FZD8qR/75+9k58AKYBxzOEL4/A1qDgTxVIlRPIYC/y7DoSoNyHfoJlQPcdV8fnTvF2yAPnhag==',key_name='tempest-keypair-1549315691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='008dbda477f24661b618327e725113f4',ramdisk_id='',reservation_id='r-yq780jrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1921619077',owner_user_name='tempest-SnapshotDataIntegrityTests-1921619077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:01:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c477b2393c34857a2bf812120b10f35',uuid=0b9ea013-f173-4bfc-ba60-323af89b3529,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8673a770-b007-4e07-bdf0-dc458355a8c2", "address": "fa:16:3e:f0:21:fe", "network": {"id": "04bf90e9-c437-4411-8c4d-b3a80811c56b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-801476002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008dbda477f24661b618327e725113f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8673a770-b0", "ovs_interfaceid": "8673a770-b007-4e07-bdf0-dc458355a8c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72849) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Converting VIF {"id": "8673a770-b007-4e07-bdf0-dc458355a8c2", "address": "fa:16:3e:f0:21:fe", "network": {"id": "04bf90e9-c437-4411-8c4d-b3a80811c56b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-801476002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008dbda477f24661b618327e725113f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8673a770-b0", "ovs_interfaceid": "8673a770-b007-4e07-bdf0-dc458355a8c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:21:fe,bridge_name='br-int',has_traffic_filtering=True,id=8673a770-b007-4e07-bdf0-dc458355a8c2,network=Network(04bf90e9-c437-4411-8c4d-b3a80811c56b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8673a770-b0') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.objects.instance [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:01:59 user nova-compute[72849]:   <uuid>0b9ea013-f173-4bfc-ba60-323af89b3529</uuid>
Aug 15 17:01:59 user nova-compute[72849]:   <name>instance-00000035</name>
Aug 15 17:01:59 user nova-compute[72849]:   <memory>524288</memory>
Aug 15 17:01:59 user nova-compute[72849]:   <vcpu>1</vcpu>
Aug 15 17:01:59 user nova-compute[72849]:   <metadata>
Aug 15 17:01:59 user nova-compute[72849]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:01:59 user nova-compute[72849]:       <nova:package version="0.0.0"/>
Aug 15 17:01:59 user nova-compute[72849]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-727016478</nova:name>
Aug 15 17:01:59 user nova-compute[72849]:       <nova:creationTime>2023-08-15 17:01:59</nova:creationTime>
Aug 15 17:01:59 user nova-compute[72849]:       <nova:flavor name="m1.tiny">
Aug 15 17:01:59 user nova-compute[72849]:         <nova:memory>512</nova:memory>
Aug 15 17:01:59 user nova-compute[72849]:         <nova:disk>1</nova:disk>
Aug 15 17:01:59 user nova-compute[72849]:         <nova:swap>0</nova:swap>
Aug 15 17:01:59 user nova-compute[72849]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:01:59 user nova-compute[72849]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:01:59 user nova-compute[72849]:       </nova:flavor>
Aug 15 17:01:59 user nova-compute[72849]:       <nova:owner>
Aug 15 17:01:59 user nova-compute[72849]:         <nova:user uuid="8c477b2393c34857a2bf812120b10f35">tempest-SnapshotDataIntegrityTests-1921619077-project-member</nova:user>
Aug 15 17:01:59 user nova-compute[72849]:         <nova:project uuid="008dbda477f24661b618327e725113f4">tempest-SnapshotDataIntegrityTests-1921619077</nova:project>
Aug 15 17:01:59 user nova-compute[72849]:       </nova:owner>
Aug 15 17:01:59 user nova-compute[72849]:       <nova:root type="image" uuid="59265a51-1c51-4986-ae25-4fec6807c20c"/>
Aug 15 17:01:59 user nova-compute[72849]:       <nova:ports>
Aug 15 17:01:59 user nova-compute[72849]:         <nova:port uuid="8673a770-b007-4e07-bdf0-dc458355a8c2">
Aug 15 17:01:59 user nova-compute[72849]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 17:01:59 user nova-compute[72849]:         </nova:port>
Aug 15 17:01:59 user nova-compute[72849]:       </nova:ports>
Aug 15 17:01:59 user nova-compute[72849]:     </nova:instance>
Aug 15 17:01:59 user nova-compute[72849]:   </metadata>
Aug 15 17:01:59 user nova-compute[72849]:   <sysinfo type="smbios">
Aug 15 17:01:59 user nova-compute[72849]:     <system>
Aug 15 17:01:59 user nova-compute[72849]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:01:59 user nova-compute[72849]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:01:59 user nova-compute[72849]:       <entry name="version">0.0.0</entry>
Aug 15 17:01:59 user nova-compute[72849]:       <entry name="serial">0b9ea013-f173-4bfc-ba60-323af89b3529</entry>
Aug 15 17:01:59 user nova-compute[72849]:       <entry name="uuid">0b9ea013-f173-4bfc-ba60-323af89b3529</entry>
Aug 15 17:01:59 user nova-compute[72849]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:01:59 user nova-compute[72849]:     </system>
Aug 15 17:01:59 user nova-compute[72849]:   </sysinfo>
Aug 15 17:01:59 user nova-compute[72849]:   <os>
Aug 15 17:01:59 user nova-compute[72849]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:01:59 user nova-compute[72849]:     <boot dev="hd"/>
Aug 15 17:01:59 user nova-compute[72849]:     <smbios mode="sysinfo"/>
Aug 15 17:01:59 user nova-compute[72849]:   </os>
Aug 15 17:01:59 user nova-compute[72849]:   <features>
Aug 15 17:01:59 user nova-compute[72849]:     <acpi/>
Aug 15 17:01:59 user nova-compute[72849]:     <apic/>
Aug 15 17:01:59 user nova-compute[72849]:     <vmcoreinfo/>
Aug 15 17:01:59 user nova-compute[72849]:   </features>
Aug 15 17:01:59 user nova-compute[72849]:   <clock offset="utc">
Aug 15 17:01:59 user nova-compute[72849]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:01:59 user nova-compute[72849]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:01:59 user nova-compute[72849]:     <timer name="hpet" present="no"/>
Aug 15 17:01:59 user nova-compute[72849]:   </clock>
Aug 15 17:01:59 user nova-compute[72849]:   <cpu mode="custom" match="exact">
Aug 15 17:01:59 user nova-compute[72849]:     <model>Nehalem</model>
Aug 15 17:01:59 user nova-compute[72849]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:01:59 user nova-compute[72849]:   </cpu>
Aug 15 17:01:59 user nova-compute[72849]:   <devices>
Aug 15 17:01:59 user nova-compute[72849]:     <disk type="file" device="disk">
Aug 15 17:01:59 user nova-compute[72849]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:01:59 user nova-compute[72849]:       <source file="/opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk"/>
Aug 15 17:01:59 user nova-compute[72849]:       <target dev="vda" bus="virtio"/>
Aug 15 17:01:59 user nova-compute[72849]:     </disk>
Aug 15 17:01:59 user nova-compute[72849]:     <interface type="ethernet">
Aug 15 17:01:59 user nova-compute[72849]:       <mac address="fa:16:3e:f0:21:fe"/>
Aug 15 17:01:59 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 17:01:59 user nova-compute[72849]:       <mtu size="1442"/>
Aug 15 17:01:59 user nova-compute[72849]:       <target dev="tap8673a770-b0"/>
Aug 15 17:01:59 user nova-compute[72849]:     </interface>
Aug 15 17:01:59 user nova-compute[72849]:     <serial type="pty">
Aug 15 17:01:59 user nova-compute[72849]:       <log file="/opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/console.log" append="off"/>
Aug 15 17:01:59 user nova-compute[72849]:     </serial>
Aug 15 17:01:59 user nova-compute[72849]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:01:59 user nova-compute[72849]:     <video>
Aug 15 17:01:59 user nova-compute[72849]:       <model type="virtio"/>
Aug 15 17:01:59 user nova-compute[72849]:     </video>
Aug 15 17:01:59 user nova-compute[72849]:     <rng model="virtio">
Aug 15 17:01:59 user nova-compute[72849]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:01:59 user nova-compute[72849]:     </rng>
Aug 15 17:01:59 user nova-compute[72849]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:01:59 user nova-compute[72849]:     <memballoon model="virtio">
Aug 15 17:01:59 user nova-compute[72849]:       <stats period="10"/>
Aug 15 17:01:59 user nova-compute[72849]:     </memballoon>
Aug 15 17:01:59 user nova-compute[72849]:   </devices>
Aug 15 17:01:59 user nova-compute[72849]: </domain>
Aug 15 17:01:59 user nova-compute[72849]:  {{(pid=72849) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-727016478',display_name='tempest-SnapshotDataIntegrityTests-server-727016478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-727016478',id=53,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK/sKxxSecqmztkKZKNnjAxrlZy7XvZpqdSs1li1INPlisthOoKLBzz7FZD8qR/75+9k58AKYBxzOEL4/A1qDgTxVIlRPIYC/y7DoSoNyHfoJlQPcdV8fnTvF2yAPnhag==',key_name='tempest-keypair-1549315691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='008dbda477f24661b618327e725113f4',ramdisk_id='',reservation_id='r-yq780jrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1921619077',owner_user_name='tempest-SnapshotDataIntegrityTests-1921619077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:01:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c477b2393c34857a2bf812120b10f35',uuid=0b9ea013-f173-4bfc-ba60-323af89b3529,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8673a770-b007-4e07-bdf0-dc458355a8c2", "address": "fa:16:3e:f0:21:fe", "network": {"id": "04bf90e9-c437-4411-8c4d-b3a80811c56b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-801476002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008dbda477f24661b618327e725113f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8673a770-b0", "ovs_interfaceid": "8673a770-b007-4e07-bdf0-dc458355a8c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Converting VIF {"id": "8673a770-b007-4e07-bdf0-dc458355a8c2", "address": "fa:16:3e:f0:21:fe", "network": {"id": "04bf90e9-c437-4411-8c4d-b3a80811c56b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-801476002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008dbda477f24661b618327e725113f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8673a770-b0", "ovs_interfaceid": "8673a770-b007-4e07-bdf0-dc458355a8c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:21:fe,bridge_name='br-int',has_traffic_filtering=True,id=8673a770-b007-4e07-bdf0-dc458355a8c2,network=Network(04bf90e9-c437-4411-8c4d-b3a80811c56b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8673a770-b0') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG os_vif [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:21:fe,bridge_name='br-int',has_traffic_filtering=True,id=8673a770-b007-4e07-bdf0-dc458355a8c2,network=Network(04bf90e9-c437-4411-8c4d-b3a80811c56b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8673a770-b0') {{(pid=72849) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8673a770-b0, may_exist=True, interface_attrs={}) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8673a770-b0, col_values=(('external_ids', {'iface-id': '8673a770-b007-4e07-bdf0-dc458355a8c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:21:fe', 'vm-uuid': '0b9ea013-f173-4bfc-ba60-323af89b3529'}),), if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:59 user nova-compute[72849]: INFO os_vif [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:21:fe,bridge_name='br-int',has_traffic_filtering=True,id=8673a770-b007-4e07-bdf0-dc458355a8c2,network=Network(04bf90e9-c437-4411-8c4d-b3a80811c56b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8673a770-b0')
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] No VIF found with MAC fa:16:3e:f0:21:fe, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.network.neutron [req-f2b6aecf-4932-48b1-97cd-7c5310df4e55 req-365b9816-47f5-415a-bf1f-795f330dbb33 service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updated VIF entry in instance network info cache for port 8673a770-b007-4e07-bdf0-dc458355a8c2. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG nova.network.neutron [req-f2b6aecf-4932-48b1-97cd-7c5310df4e55 req-365b9816-47f5-415a-bf1f-795f330dbb33 service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updating instance_info_cache with network_info: [{"id": "8673a770-b007-4e07-bdf0-dc458355a8c2", "address": "fa:16:3e:f0:21:fe", "network": {"id": "04bf90e9-c437-4411-8c4d-b3a80811c56b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-801476002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008dbda477f24661b618327e725113f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8673a770-b0", "ovs_interfaceid": "8673a770-b007-4e07-bdf0-dc458355a8c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:01:59 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-f2b6aecf-4932-48b1-97cd-7c5310df4e55 req-365b9816-47f5-415a-bf1f-795f330dbb33 service nova] Releasing lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:02:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:01 user nova-compute[72849]: DEBUG nova.compute.manager [req-459e6f11-4e1b-4754-8a8a-dde210161271 req-81d915c4-d4e2-4d80-b489-cfc1616bf12d service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Received event network-vif-plugged-8673a770-b007-4e07-bdf0-dc458355a8c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:02:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-459e6f11-4e1b-4754-8a8a-dde210161271 req-81d915c4-d4e2-4d80-b489-cfc1616bf12d service nova] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:02:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-459e6f11-4e1b-4754-8a8a-dde210161271 req-81d915c4-d4e2-4d80-b489-cfc1616bf12d service nova] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:02:01 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-459e6f11-4e1b-4754-8a8a-dde210161271 req-81d915c4-d4e2-4d80-b489-cfc1616bf12d service nova] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:02:01 user nova-compute[72849]: DEBUG nova.compute.manager [req-459e6f11-4e1b-4754-8a8a-dde210161271 req-81d915c4-d4e2-4d80-b489-cfc1616bf12d service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] No waiting events found dispatching network-vif-plugged-8673a770-b007-4e07-bdf0-dc458355a8c2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:02:01 user nova-compute[72849]: WARNING nova.compute.manager [req-459e6f11-4e1b-4754-8a8a-dde210161271 req-81d915c4-d4e2-4d80-b489-cfc1616bf12d service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Received unexpected event network-vif-plugged-8673a770-b007-4e07-bdf0-dc458355a8c2 for instance with vm_state building and task_state spawning.
Aug 15 17:02:01 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:02:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:01 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:03 user nova-compute[72849]: DEBUG nova.compute.manager [req-4fc540c3-345d-47f4-9c55-d0d65de772a7 req-3a343ccd-95f4-45fa-8072-9df8c7d41be7 service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Received event network-vif-plugged-8673a770-b007-4e07-bdf0-dc458355a8c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:02:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4fc540c3-345d-47f4-9c55-d0d65de772a7 req-3a343ccd-95f4-45fa-8072-9df8c7d41be7 service nova] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:02:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4fc540c3-345d-47f4-9c55-d0d65de772a7 req-3a343ccd-95f4-45fa-8072-9df8c7d41be7 service nova] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:02:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-4fc540c3-345d-47f4-9c55-d0d65de772a7 req-3a343ccd-95f4-45fa-8072-9df8c7d41be7 service nova] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:02:03 user nova-compute[72849]: DEBUG nova.compute.manager [req-4fc540c3-345d-47f4-9c55-d0d65de772a7 req-3a343ccd-95f4-45fa-8072-9df8c7d41be7 service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] No waiting events found dispatching network-vif-plugged-8673a770-b007-4e07-bdf0-dc458355a8c2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:02:03 user nova-compute[72849]: WARNING nova.compute.manager [req-4fc540c3-345d-47f4-9c55-d0d65de772a7 req-3a343ccd-95f4-45fa-8072-9df8c7d41be7 service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Received unexpected event network-vif-plugged-8673a770-b007-4e07-bdf0-dc458355a8c2 for instance with vm_state building and task_state spawning.
Aug 15 17:02:03 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692118923.1292677, 0b9ea013-f173-4bfc-ba60-323af89b3529 => Resumed> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:02:03 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] VM Resumed (Lifecycle Event)
Aug 15 17:02:03 user nova-compute[72849]: DEBUG nova.compute.manager [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Instance event wait completed in 0 seconds for  {{(pid=72849) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:02:03 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Guest created on hypervisor {{(pid=72849) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:02:03 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Instance spawned successfully.
Aug 15 17:02:03 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:02:03 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:02:03 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:02:03 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Found default for hw_cdrom_bus of ide {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:02:03 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Found default for hw_disk_bus of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:02:03 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Found default for hw_input_bus of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:02:03 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Found default for hw_pointer_model of None {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:02:03 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Found default for hw_video_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:02:03 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Found default for hw_vif_model of virtio {{(pid=72849) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:02:03 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:02:03 user nova-compute[72849]: DEBUG nova.virt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Emitting event <LifecycleEvent: 1692118923.1296334, 0b9ea013-f173-4bfc-ba60-323af89b3529 => Started> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:02:03 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] VM Started (Lifecycle Event)
Aug 15 17:02:03 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:02:03 user nova-compute[72849]: DEBUG nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72849) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:02:03 user nova-compute[72849]: INFO nova.compute.manager [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:02:03 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:02:03 user nova-compute[72849]: INFO nova.compute.manager [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 15 17:02:03 user nova-compute[72849]: DEBUG nova.compute.manager [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:02:03 user nova-compute[72849]: INFO nova.compute.manager [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Took 6.68 seconds to build instance.
Aug 15 17:02:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-59202480-b749-4ab2-9969-e06b8740a8c2 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.959s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:02:04 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:02:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:02:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:02:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:02:09 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:02:09 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:02:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:02:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:02:09 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:02:09 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:02:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:02:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:02:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:02:09 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:02:10 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:02:10 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:02:10 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8533MB free_disk=25.190013885498047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:02:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:02:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:02:10 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0b9ea013-f173-4bfc-ba60-323af89b3529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:02:10 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:02:10 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:02:10 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:02:10 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:02:10 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:02:10 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:02:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:02:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:31 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:02:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:02:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:02:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:02:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:55 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:02:55 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:02:55 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 17:02:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:02:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:02:56 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:02:56 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:02:56 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updating instance_info_cache with network_info: [{"id": "8673a770-b007-4e07-bdf0-dc458355a8c2", "address": "fa:16:3e:f0:21:fe", "network": {"id": "04bf90e9-c437-4411-8c4d-b3a80811c56b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-801476002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008dbda477f24661b618327e725113f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8673a770-b0", "ovs_interfaceid": "8673a770-b007-4e07-bdf0-dc458355a8c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:02:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:02:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:02:56 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:02:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:02:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:02:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:02:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:02:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:02:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:03:02 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:03:02 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 17:03:02 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] There are 0 instances to clean {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 17:03:03 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:03:04 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:03:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:03:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:03:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:03:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:03:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:03:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:03:05 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:03:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:03:07 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:03:07 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:03:09 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:03:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:03:11 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:03:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:03:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:03:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:03:11 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:03:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:03:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:03:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:03:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:03:12 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:03:12 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:03:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8712MB free_disk=25.151050567626953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:03:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:03:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:03:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0b9ea013-f173-4bfc-ba60-323af89b3529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:03:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:03:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:03:12 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing inventories for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 17:03:12 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating ProviderTree inventory for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 17:03:12 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating inventory in ProviderTree for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 17:03:12 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing aggregate associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, aggregates: None {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 17:03:12 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing trait associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 17:03:12 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:03:12 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:03:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:03:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:03:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:03:16 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:03:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:03:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:03:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:03:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:03:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:03:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:03:22 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:03:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:03:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:03:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:03:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:03:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:03:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:03:28 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:03:28 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72849) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 17:03:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:03:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:03:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:03:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:03:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:03:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:03:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:03:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:03:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:03:47 user nova-compute[72849]: DEBUG nova.compute.manager [req-62346214-74fc-435b-9165-d6d5470c4097 req-0dbd27d6-71d3-4a7b-8822-20f20b53c253 service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Received event network-changed-8673a770-b007-4e07-bdf0-dc458355a8c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:03:47 user nova-compute[72849]: DEBUG nova.compute.manager [req-62346214-74fc-435b-9165-d6d5470c4097 req-0dbd27d6-71d3-4a7b-8822-20f20b53c253 service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Refreshing instance network info cache due to event network-changed-8673a770-b007-4e07-bdf0-dc458355a8c2. {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:03:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-62346214-74fc-435b-9165-d6d5470c4097 req-0dbd27d6-71d3-4a7b-8822-20f20b53c253 service nova] Acquiring lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:03:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-62346214-74fc-435b-9165-d6d5470c4097 req-0dbd27d6-71d3-4a7b-8822-20f20b53c253 service nova] Acquired lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:03:47 user nova-compute[72849]: DEBUG nova.network.neutron [req-62346214-74fc-435b-9165-d6d5470c4097 req-0dbd27d6-71d3-4a7b-8822-20f20b53c253 service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Refreshing network info cache for port 8673a770-b007-4e07-bdf0-dc458355a8c2 {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:03:48 user nova-compute[72849]: DEBUG nova.network.neutron [req-62346214-74fc-435b-9165-d6d5470c4097 req-0dbd27d6-71d3-4a7b-8822-20f20b53c253 service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updated VIF entry in instance network info cache for port 8673a770-b007-4e07-bdf0-dc458355a8c2. {{(pid=72849) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:03:48 user nova-compute[72849]: DEBUG nova.network.neutron [req-62346214-74fc-435b-9165-d6d5470c4097 req-0dbd27d6-71d3-4a7b-8822-20f20b53c253 service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updating instance_info_cache with network_info: [{"id": "8673a770-b007-4e07-bdf0-dc458355a8c2", "address": "fa:16:3e:f0:21:fe", "network": {"id": "04bf90e9-c437-4411-8c4d-b3a80811c56b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-801476002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008dbda477f24661b618327e725113f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8673a770-b0", "ovs_interfaceid": "8673a770-b007-4e07-bdf0-dc458355a8c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:03:48 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-62346214-74fc-435b-9165-d6d5470c4097 req-0dbd27d6-71d3-4a7b-8822-20f20b53c253 service nova] Releasing lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:03:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:03:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:03:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:03:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:03:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:03:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:03:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:03:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:03:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:03:52 user nova-compute[72849]: DEBUG nova.objects.instance [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lazy-loading 'flavor' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:03:52 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:03:53 user nova-compute[72849]: INFO nova.compute.manager [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Attaching volume 27460302-5f8b-4f1d-b38b-1ad7a7b34c49 to /dev/vdb
Aug 15 17:03:53 user nova-compute[72849]: DEBUG os_brick.utils [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[effaa0f0-5d21-42a3-91f7-3ba138979647]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f801b8-69f5-4831-871e-c74adb72e094]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb219bd7-7f8d-4068-8419-c1fb0da2de7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa27295-f16f-4621-bf92-be21d5b87b54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:03:53 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:03:53 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad93a09-314a-4d75-bc02-468bf5dd0a41]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG os_brick.utils [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:03:53 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updating existing volume attachment record: 1071e5c4-8281-4274-bfc6-97e3ea2aba2f {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:03:54 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:03:54 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Triggering sync for uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 17:03:54 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:03:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:03:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:03:55 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:03:55 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:03:55 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 17:03:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:03:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:03:55 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:03:55 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:03:55 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updating instance_info_cache with network_info: [{"id": "8673a770-b007-4e07-bdf0-dc458355a8c2", "address": "fa:16:3e:f0:21:fe", "network": {"id": "04bf90e9-c437-4411-8c4d-b3a80811c56b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-801476002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008dbda477f24661b618327e725113f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8673a770-b0", "ovs_interfaceid": "8673a770-b007-4e07-bdf0-dc458355a8c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:03:55 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:03:55 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:03:55 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:03:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJpRSeDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:04:01 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:04:01 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:04:01 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada55076-ac58-4b8f-9ec3-7ccaa3a2cd36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:04:01 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ec388b-b446-45b0-93b0-b68aa9af23e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49] added
Aug 15 17:04:01 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0546b7-6f8c-4491-8eca-d2e0034f96a4]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9796ef1-7b4f-44b1-836d-42574c4d544c]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LJpRSeDQ {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LJpRSeDQ" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cbc1ee-b0c1-4da7-bdbb-5593940ad8c6]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LJpRSeDQ'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1154da-96ba-4fd0-ba80-738c84af3f79]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcf8dfe-bb8e-4d15-b4b2-c7a4c6bcd43c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 17:04:01 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 17:04:01 user nova-compute[72849]:  {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:04:01 user nova-compute[72849]: WARNING os_brick.initiator.connectors.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 17:04:01 user nova-compute[72849]: 
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea4ea07-93d4-4fa4-9d3d-e88e179c0e9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49, portal: 172.16.0.220,3260]
Aug 15 17:04:01 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49, portal: 172.16.0.220,3260] successful.
Aug 15 17:04:01 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[16643bc9-cf45-463c-849a-63c31c0ec760]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb86db0-0ce8-419b-b505-43401c4b4508]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 (non-flash)
Aug 15 17:04:01 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 (non-flash)
Aug 15 17:04:01 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad36eed-e220-4488-99b2-f2a1e7b996d5]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:04:01 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJpRSeDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:04:02 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:04:02 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26632353130643130', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:04:02 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632353130643130', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:04:02 user nova-compute[72849]: DEBUG nova.objects.instance [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lazy-loading 'flavor' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:04:02 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:04:02 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:04:02 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 17:04:02 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:04:02 user nova-compute[72849]:   <serial>27460302-5f8b-4f1d-b38b-1ad7a7b34c49</serial>
Aug 15 17:04:02 user nova-compute[72849]: </disk>
Aug 15 17:04:02 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:04:03 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:04:03 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:04:03 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] No VIF found with MAC fa:16:3e:f0:21:fe, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:04:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-6bf4aa9b-0603-49ce-9043-56f3e6a43072 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.188s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:04:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.847s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:04:03 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:04:03 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:04:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:04:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:04:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:04:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:04:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:05 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:04:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:04:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:04:08 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:04:08 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:04:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:11 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:04:11 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:04:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:04:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:04:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:04:11 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:04:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:11 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72849) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:04:12 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:04:12 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:04:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=25.14972686767578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:04:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:04:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:04:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0b9ea013-f173-4bfc-ba60-323af89b3529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:04:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:04:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:04:12 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:04:12 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:04:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:04:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:04:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:04:29 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:04:29 user nova-compute[72849]: INFO nova.compute.manager [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Detaching volume 27460302-5f8b-4f1d-b38b-1ad7a7b34c49
Aug 15 17:04:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:29 user nova-compute[72849]: INFO nova.virt.block_device [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Attempting to driver detach volume 27460302-5f8b-4f1d-b38b-1ad7a7b34c49 from mountpoint /dev/vdb
Aug 15 17:04:29 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Attempting to detach device vdb from instance 0b9ea013-f173-4bfc-ba60-323af89b3529 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:04:29 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:04:29 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:04:29 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 17:04:29 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:04:29 user nova-compute[72849]:   <serial>27460302-5f8b-4f1d-b38b-1ad7a7b34c49</serial>
Aug 15 17:04:29 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:04:29 user nova-compute[72849]: </disk>
Aug 15 17:04:29 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:04:29 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Successfully detached device vdb from instance 0b9ea013-f173-4bfc-ba60-323af89b3529 from the persistent domain config.
Aug 15 17:04:29 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0b9ea013-f173-4bfc-ba60-323af89b3529 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:04:29 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:04:29 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:04:29 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 17:04:29 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:04:29 user nova-compute[72849]:   <serial>27460302-5f8b-4f1d-b38b-1ad7a7b34c49</serial>
Aug 15 17:04:29 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:04:29 user nova-compute[72849]: </disk>
Aug 15 17:04:29 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:04:29 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692119069.9790046, 0b9ea013-f173-4bfc-ba60-323af89b3529 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:04:29 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:04:29 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Successfully detached device vdb from instance 0b9ea013-f173-4bfc-ba60-323af89b3529 from the live domain config.
Aug 15 17:04:29 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:04:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJpRSeDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:04:29 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:04:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:04:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:04:29 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:04:29 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ced0e5-2838-4778-b397-254ae62ac3d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47b59a9-c293-4aa1-831c-45d91077301e]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 (non-flash)
Aug 15 17:04:30 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 (non-flash)
Aug 15 17:04:30 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc37832fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0db8192-3c35-4e9b-a20f-62c2333c0eff]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[7827344a-1c49-41d2-b59d-88b9c425ec11]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8455bd0f-a5a6-44bf-9af6-8107eec4ed82]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f0a37c-4508-4bd9-8772-91fed155e3df]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a2413c-6b64-4739-b2a4-4205b66475b1]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c869687-f36e-497a-81e7-2119d732aff9]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49, portal: 172.16.0.220,3260]
Aug 15 17:04:30 user nova-compute[72849]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49, portal: 172.16.0.220,3260] successful.
Aug 15 17:04:30 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27460302-5f8b-4f1d-b38b-1ad7a7b34c49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d369d9-4076-4185-9423-539b10b30bac]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] <== disconnect_volume: return (261ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:04:30 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:04:31 user nova-compute[72849]: DEBUG nova.objects.instance [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lazy-loading 'flavor' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:04:31 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-b9f3cf67-d01b-40c0-b98a-92857a375521 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.635s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:04:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:04:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:04:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:04:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:04:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:04:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:04:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:04:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:04:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:04:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:04:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:04:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:04:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:04:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:04:57 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:04:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:04:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 17:04:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:04:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:04:57 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:04:57 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:04:57 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updating instance_info_cache with network_info: [{"id": "8673a770-b007-4e07-bdf0-dc458355a8c2", "address": "fa:16:3e:f0:21:fe", "network": {"id": "04bf90e9-c437-4411-8c4d-b3a80811c56b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-801476002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008dbda477f24661b618327e725113f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8673a770-b0", "ovs_interfaceid": "8673a770-b007-4e07-bdf0-dc458355a8c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:04:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:04:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:04:57 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:04:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:04:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:04:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:04:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:04:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:04:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:05:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:05:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:05:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:05:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:05:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:05:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:05:05 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:05:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:05:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:05:07 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:05:09 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:05:09 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:05:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:05:11 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:05:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:05:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:05:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:05:11 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:05:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:12 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:05:12 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:05:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8765MB free_disk=25.14887237548828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:05:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:05:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:05:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0b9ea013-f173-4bfc-ba60-323af89b3529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:05:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:05:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:05:12 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:05:12 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:05:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:05:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:05:14 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:05:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:05:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:05:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:05:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:05:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:05:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:05:19 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:05:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:05:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:05:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:05:23 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lazy-loading 'flavor' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:05:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:05:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:05:23 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:05:23 user nova-compute[72849]: INFO nova.compute.manager [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Attaching volume 64b9dd8f-06c3-4b72-b0df-69d42a986229 to /dev/vdb
Aug 15 17:05:23 user nova-compute[72849]: DEBUG os_brick.utils [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:05:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:23 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4405e2-5d4d-4fea-a4ce-f9a393660a4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:23 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea90372a-9a6a-4d0e-a99c-ec253378f8ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5585c20d-b660-40f0-9907-bce146fbfe00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e890b351-31ac-49a8-bb49-216e8104a541]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:05:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:05:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:24 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:05:24 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:05:24 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a996969a-ad9f-4a10-8fe1-5e16ce7479a0]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:05:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:05:24 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:05:24 user nova-compute[72849]: DEBUG os_brick.utils [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:05:24 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updating existing volume attachment record: 4c20a690-7868-4bea-945a-522f146b1d2a {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:05:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:05:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:05:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWPmaUgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:05:32 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:05:32 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:05:32 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf9b3d1-76eb-47c2-9662-f9e7b367511e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:05:32 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b179f35-6e87-426b-b9d3-34ac86209be3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229] added
Aug 15 17:05:32 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d22f40a-9e28-4dd2-aa6f-cfc8e31cc56c]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8350a8-35a2-4c8e-9f56-2106e4ac17cd]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oWPmaUgJ {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oWPmaUgJ" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9148b47-03fa-49ed-926a-4c9ba4885def]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oWPmaUgJ'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf7a54a-1220-49c0-9d15-95ea1b89c512]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[92547ba2-1634-4af8-a5a2-86d2b391c0fc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 17:05:32 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 17:05:32 user nova-compute[72849]:  {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:05:32 user nova-compute[72849]: WARNING os_brick.initiator.connectors.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 17:05:32 user nova-compute[72849]: 
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[e605d873-2902-42e0-8277-871177bcee5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229, portal: 172.16.0.220,3260]
Aug 15 17:05:32 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229, portal: 172.16.0.220,3260] successful.
Aug 15 17:05:32 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9e34f3-a323-47e0-8939-ac0819ebd6ab]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4a7263-cc15-4188-9546-f9f3bcaea65e]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 (non-flash)
Aug 15 17:05:32 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 (non-flash)
Aug 15 17:05:32 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[054d6edb-4342-4826-a4ce-4663b36d8c1c]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:32 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:05:33 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:05:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWPmaUgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:05:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:05:33 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23266613739616232', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:05:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266613739616232', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:05:33 user nova-compute[72849]: DEBUG nova.objects.instance [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lazy-loading 'flavor' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:05:33 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:05:33 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:05:33 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 17:05:33 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:05:33 user nova-compute[72849]:   <serial>64b9dd8f-06c3-4b72-b0df-69d42a986229</serial>
Aug 15 17:05:33 user nova-compute[72849]: </disk>
Aug 15 17:05:33 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:05:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:05:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:05:34 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] No VIF found with MAC fa:16:3e:f0:21:fe, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:05:34 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-7b9f5ded-8212-4477-b543-d1543c811e05 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.308s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:05:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:05:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:05:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:05:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:05:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:05:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:05:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:05:36 user nova-compute[72849]: INFO nova.compute.manager [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Detaching volume 64b9dd8f-06c3-4b72-b0df-69d42a986229
Aug 15 17:05:36 user nova-compute[72849]: INFO nova.virt.block_device [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Attempting to driver detach volume 64b9dd8f-06c3-4b72-b0df-69d42a986229 from mountpoint /dev/vdb
Aug 15 17:05:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Attempting to detach device vdb from instance 0b9ea013-f173-4bfc-ba60-323af89b3529 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:05:36 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:05:36 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 17:05:36 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:05:36 user nova-compute[72849]:   <serial>64b9dd8f-06c3-4b72-b0df-69d42a986229</serial>
Aug 15 17:05:36 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:05:36 user nova-compute[72849]: </disk>
Aug 15 17:05:36 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:05:36 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Successfully detached device vdb from instance 0b9ea013-f173-4bfc-ba60-323af89b3529 from the persistent domain config.
Aug 15 17:05:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0b9ea013-f173-4bfc-ba60-323af89b3529 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:05:36 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:05:36 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 17:05:36 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:05:36 user nova-compute[72849]:   <serial>64b9dd8f-06c3-4b72-b0df-69d42a986229</serial>
Aug 15 17:05:36 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:05:36 user nova-compute[72849]: </disk>
Aug 15 17:05:36 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692119136.634964, 0b9ea013-f173-4bfc-ba60-323af89b3529 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:05:36 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Successfully detached device vdb from instance 0b9ea013-f173-4bfc-ba60-323af89b3529 from the live domain config.
Aug 15 17:05:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWPmaUgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:05:36 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:05:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7b121f-fc53-47eb-87ac-2ad58cbaec0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[de36ca1f-f03b-4668-a1aa-499b583e8a30]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 (non-flash)
Aug 15 17:05:36 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 (non-flash)
Aug 15 17:05:36 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc358282440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f6fbf1-885e-4799-b72b-aaeb71936100]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2df882-87d3-4090-9fdc-b13701a76dff]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb360f10-c78a-4bd4-b91b-decf5d672e91]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[313c6d2a-d310-4eef-aa22-21883b131601]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2ad505-1a78-4c4a-96cf-7a95d098f908]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c8ac31-a0e5-4989-b356-f0a47e1bb43e]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229, portal: 172.16.0.220,3260]
Aug 15 17:05:36 user nova-compute[72849]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229, portal: 172.16.0.220,3260] successful.
Aug 15 17:05:36 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b9dd8f-06c3-4b72-b0df-69d42a986229 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[263c0fa4-a77d-49f0-92d0-3025e597cc61]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] <== disconnect_volume: return (255ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:05:36 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:05:37 user nova-compute[72849]: DEBUG nova.objects.instance [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lazy-loading 'flavor' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:05:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-e430cee6-fee2-44b2-a7b3-57e0e96eaa68 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.525s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:05:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:05:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:05:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:05:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:05:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:05:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:05:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:05:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:05:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:05:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:05:56 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:05:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:05:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 17:05:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:05:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:05:56 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:05:56 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:05:56 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updating instance_info_cache with network_info: [{"id": "8673a770-b007-4e07-bdf0-dc458355a8c2", "address": "fa:16:3e:f0:21:fe", "network": {"id": "04bf90e9-c437-4411-8c4d-b3a80811c56b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-801476002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008dbda477f24661b618327e725113f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8673a770-b0", "ovs_interfaceid": "8673a770-b007-4e07-bdf0-dc458355a8c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:05:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:05:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:05:57 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:05:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:06:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:06:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:06:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:06:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:06:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:06:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:06:05 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:06:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:06:08 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:06:09 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:06:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:06:10 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:06:10 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:06:11 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:06:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:06:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:06:11 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:06:11 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:06:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:11 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:12 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:06:12 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:06:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8768MB free_disk=25.147830963134766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:06:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:06:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:06:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0b9ea013-f173-4bfc-ba60-323af89b3529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:06:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:06:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:06:12 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:06:12 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:06:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:06:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:06:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:06:16 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:06:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:06:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:06:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:06:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:06:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:06:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:06:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:06:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:06:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:06:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:06:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:06:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:06:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:06:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:06:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:06:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:06:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:06:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG nova.objects.instance [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lazy-loading 'flavor' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:06:30 user nova-compute[72849]: INFO nova.compute.manager [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Attaching volume a1115761-5f4d-41f9-a7f3-2cdce6346d13 to /dev/vdb
Aug 15 17:06:30 user nova-compute[72849]: DEBUG os_brick.utils [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad5b9e9-de54-4029-a5a3-c52c9e88e764]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[df79e23a-ecd8-40cc-9069-977207eac97f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0b663d-c48b-4afb-bc7c-8e903cdb6c62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba12fbb-3a4a-409d-923a-60e4ccd2f501]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:06:30 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:06:30 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6f2008-dd8a-408e-8536-9cc40b6bc888]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG os_brick.utils [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:06:30 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updating existing volume attachment record: 6034929e-2175-4577-bf6b-29dead432e37 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:06:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:06:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nJvgwzCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:06:38 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:06:38 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:06:38 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ec30cc-7057-4c6f-b85a-cd5970f3ca33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:06:38 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d56f726-70fe-41c4-865a-cdcb449ba42f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13] added
Aug 15 17:06:38 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8d2f08-df35-46f6-b270-21d7dd28bf65]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bfe0cd-9589-4070-9e16-1ac0e407d772]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nJvgwzCS {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nJvgwzCS" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c535db-6dc8-423d-9468-70de8f660b20]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nJvgwzCS'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd32f428-88e1-4cfb-a93d-e4b8ddef3e44]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a247fa8a-2b14-4701-8c66-3f83bc91df09]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 17:06:38 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 17:06:38 user nova-compute[72849]:  {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:06:38 user nova-compute[72849]: WARNING os_brick.initiator.connectors.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 17:06:38 user nova-compute[72849]: 
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[689e1764-f1b3-47bf-b428-627ac67ed617]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13, portal: 172.16.0.220,3260]
Aug 15 17:06:38 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13, portal: 172.16.0.220,3260] successful.
Aug 15 17:06:38 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d4e1f7-0d98-4392-98c6-7d54ca2a6f8d]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[737ba80d-69f4-43a3-bd08-736190a9288e]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 (non-flash)
Aug 15 17:06:38 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 (non-flash)
Aug 15 17:06:38 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:38 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2416d1-b2d3-4aac-82a7-3dbbda4fdf43]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:39 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:06:39 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nJvgwzCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:06:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:06:40 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:06:40 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23737353036646666', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:06:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737353036646666', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:06:40 user nova-compute[72849]: DEBUG nova.objects.instance [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lazy-loading 'flavor' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:06:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:06:40 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:06:40 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 17:06:40 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:06:40 user nova-compute[72849]:   <serial>a1115761-5f4d-41f9-a7f3-2cdce6346d13</serial>
Aug 15 17:06:40 user nova-compute[72849]: </disk>
Aug 15 17:06:40 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:06:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:06:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:06:40 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] No VIF found with MAC fa:16:3e:f0:21:fe, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:06:40 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bf286ae5-0858-4ce8-82fc-735154425822 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.181s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:06:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:06:42 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:06:42 user nova-compute[72849]: INFO nova.compute.manager [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Detaching volume a1115761-5f4d-41f9-a7f3-2cdce6346d13
Aug 15 17:06:42 user nova-compute[72849]: INFO nova.virt.block_device [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Attempting to driver detach volume a1115761-5f4d-41f9-a7f3-2cdce6346d13 from mountpoint /dev/vdb
Aug 15 17:06:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Attempting to detach device vdb from instance 0b9ea013-f173-4bfc-ba60-323af89b3529 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:06:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:06:42 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:06:42 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 17:06:42 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:06:42 user nova-compute[72849]:   <serial>a1115761-5f4d-41f9-a7f3-2cdce6346d13</serial>
Aug 15 17:06:42 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:06:42 user nova-compute[72849]: </disk>
Aug 15 17:06:42 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:06:42 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Successfully detached device vdb from instance 0b9ea013-f173-4bfc-ba60-323af89b3529 from the persistent domain config.
Aug 15 17:06:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0b9ea013-f173-4bfc-ba60-323af89b3529 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:06:42 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:06:42 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:06:42 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 17:06:42 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:06:42 user nova-compute[72849]:   <serial>a1115761-5f4d-41f9-a7f3-2cdce6346d13</serial>
Aug 15 17:06:42 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:06:42 user nova-compute[72849]: </disk>
Aug 15 17:06:42 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692119203.1229072, 0b9ea013-f173-4bfc-ba60-323af89b3529 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:06:43 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Successfully detached device vdb from instance 0b9ea013-f173-4bfc-ba60-323af89b3529 from the live domain config.
Aug 15 17:06:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nJvgwzCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:06:43 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:06:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f710be2a-d721-467f-898f-5a562a22e9d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[6347fb5d-70a4-4105-b1c2-f8d6e6508acc]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 (non-flash)
Aug 15 17:06:43 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 (non-flash)
Aug 15 17:06:43 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3581a6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9b5c0c-8822-45d7-a5e4-6dcb4722a873]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1902a106-bfcc-4a96-a3c7-1ff176c9cff8]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdad364d-3b70-4142-a498-3a5f9ad68634]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4c383f-d6a7-4af8-aaa4-2b8b03ae5f17]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b81f6c9-879f-46cd-ac02-16cac341645e]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[68143fb5-e288-4397-92fa-16b77c943de5]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13, portal: 172.16.0.220,3260]
Aug 15 17:06:43 user nova-compute[72849]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13, portal: 172.16.0.220,3260] successful.
Aug 15 17:06:43 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1115761-5f4d-41f9-a7f3-2cdce6346d13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da2390e-c63b-4796-ab33-cf5e60efc24d]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] <== disconnect_volume: return (255ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:06:43 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:06:44 user nova-compute[72849]: DEBUG nova.objects.instance [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lazy-loading 'flavor' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:06:44 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-cc66107c-de68-4ccc-a9ef-eb6d58ff7397 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.548s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:06:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:06:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:06:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:06:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:06:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:06:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:06:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:06:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:06:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:06:56 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:06:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:06:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 17:06:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:06:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:06:56 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:06:56 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:06:56 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updating instance_info_cache with network_info: [{"id": "8673a770-b007-4e07-bdf0-dc458355a8c2", "address": "fa:16:3e:f0:21:fe", "network": {"id": "04bf90e9-c437-4411-8c4d-b3a80811c56b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-801476002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008dbda477f24661b618327e725113f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8673a770-b0", "ovs_interfaceid": "8673a770-b007-4e07-bdf0-dc458355a8c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:06:56 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:06:56 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:06:58 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:06:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:06:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:06:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:06:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:06:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:06:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:07:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:07:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:07:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:07:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:07:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:07:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:07:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:07:07 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:07:08 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:07:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:07:10 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:07:12 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:07:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:07:12 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:07:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:07:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:07:12 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:07:12 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:07:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:12 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:13 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:07:13 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:07:13 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=25.146869659423828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:07:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:07:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:07:13 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0b9ea013-f173-4bfc-ba60-323af89b3529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:07:13 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:07:13 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:07:13 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:07:13 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:07:13 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:07:13 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:07:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:07:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:07:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:07:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:07:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:07:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:07:18 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:07:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:07:20 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:07:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:07:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:07:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:07:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:07:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:07:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:07:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:07:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:07:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:07:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:07:36 user nova-compute[72849]: DEBUG nova.objects.instance [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lazy-loading 'flavor' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:07:36 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:07:37 user nova-compute[72849]: INFO nova.compute.manager [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Attaching volume 51dd9e4f-ce35-4485-a5d0-95922b2313df to /dev/vdb
Aug 15 17:07:37 user nova-compute[72849]: DEBUG os_brick.utils [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d322f4-01e6-42b5-a5ee-47267569ba31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dfc5df625c3\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04a4e81-b571-493f-93b5-6f2ccf26d83a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fc24e1-ebd2-42eb-b4bd-c9bdd72ed8a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d5d43d-d413-49fc-a0ca-915df9974ce0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Running cmd (subprocess): nvme version {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] 'nvme version' failed. Not Retrying. {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] nvme not present on system {{(pid=72849) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:07:37 user nova-compute[72849]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:07:37 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdee4e1-c63a-450e-bb55-b1908530f7fe]: (4, '') {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72849) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.lightos [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] LIGHTOS: no hostnqn found. {{(pid=72849) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG os_brick.utils [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dfc5df625c3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:07:37 user nova-compute[72849]: DEBUG nova.virt.block_device [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updating existing volume attachment record: 2e91c6e3-a52a-4011-aa2e-a9de50166a03 {{(pid=72849) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:07:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:07:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:07:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Calling os-brick to attach iSCSI Volume {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXtHdfTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:07:45 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:07:45 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:07:45 user nova-compute[72849]: INFO os_brick.initiator.connectors.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee12c9a-da6b-48ba-a607-0c297953f9b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:07:45 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --interface default --op new {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3502c4-66d7-4d7b-8272-f6224546c3b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df] added\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df] added
Aug 15 17:07:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad873d9-6556-4cce-973d-e72ef61f56de]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f096351-efa2-42e9-b6ec-c34d59d706d3]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aXtHdfTl {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aXtHdfTl" returned: 0 in 0.021s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5730569e-eb38-4dad-8900-d263883c3df0]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aXtHdfTl'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7dac1a-d5ac-4d4e-9f09-d30996423eff]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed6defb-edd1-436e-a142-f503b410887d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 17:07:45 user nova-compute[72849]:  {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 17:07:45 user nova-compute[72849]:  {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:07:45 user nova-compute[72849]: WARNING os_brick.initiator.connectors.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 17:07:45 user nova-compute[72849]: 
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --login {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[66db4191-6e39-4800-9946-1bd7d0bbce12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df, portal: 172.16.0.220,3260]
Aug 15 17:07:45 user nova-compute[72849]: Login to [iface: default, target: iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df, portal: 172.16.0.220,3260] successful.
Aug 15 17:07:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc24b479-d06d-4c70-8c31-e331eaf9bf8d]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[31779df8-9d79-4135-ba4b-04bb3fc9512b]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df (non-flash)
Aug 15 17:07:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df (non-flash)
Aug 15 17:07:45 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Connected to 172.16.0.220:3260 {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=72849) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72849) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4fd2c3-624e-4b11-be53-f5df163817bf]: (4, ('- - 0', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:45 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:07:46 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72849) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:07:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXtHdfTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72849) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:07:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:07:46 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26334653434626430', 'path': '/dev/sdb'} {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:07:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334653434626430', 'path': '/dev/sdb'} {{(pid=72849) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:07:46 user nova-compute[72849]: DEBUG nova.objects.instance [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lazy-loading 'flavor' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:07:46 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:07:46 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:07:46 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 17:07:46 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:07:46 user nova-compute[72849]:   <serial>51dd9e4f-ce35-4485-a5d0-95922b2313df</serial>
Aug 15 17:07:46 user nova-compute[72849]: </disk>
Aug 15 17:07:46 user nova-compute[72849]:  {{(pid=72849) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:07:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] No BDM found with device name vda, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:07:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72849) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:07:47 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] No VIF found with MAC fa:16:3e:f0:21:fe, not building metadata {{(pid=72849) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:07:47 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-bfa1989b-88b3-4c1d-9c53-37737bf7ab9a tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.443s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:07:49 user nova-compute[72849]: INFO nova.compute.manager [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Detaching volume 51dd9e4f-ce35-4485-a5d0-95922b2313df
Aug 15 17:07:49 user nova-compute[72849]: INFO nova.virt.block_device [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Attempting to driver detach volume 51dd9e4f-ce35-4485-a5d0-95922b2313df from mountpoint /dev/vdb
Aug 15 17:07:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Attempting to detach device vdb from instance 0b9ea013-f173-4bfc-ba60-323af89b3529 from the persistent domain config. {{(pid=72849) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:07:49 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:07:49 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 17:07:49 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:07:49 user nova-compute[72849]:   <serial>51dd9e4f-ce35-4485-a5d0-95922b2313df</serial>
Aug 15 17:07:49 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:07:49 user nova-compute[72849]: </disk>
Aug 15 17:07:49 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:07:49 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Successfully detached device vdb from instance 0b9ea013-f173-4bfc-ba60-323af89b3529 from the persistent domain config.
Aug 15 17:07:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0b9ea013-f173-4bfc-ba60-323af89b3529 from the live domain config. {{(pid=72849) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.guest [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:07:49 user nova-compute[72849]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:07:49 user nova-compute[72849]:   <source dev="/dev/sdb"/>
Aug 15 17:07:49 user nova-compute[72849]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:07:49 user nova-compute[72849]:   <serial>51dd9e4f-ce35-4485-a5d0-95922b2313df</serial>
Aug 15 17:07:49 user nova-compute[72849]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:07:49 user nova-compute[72849]: </disk>
Aug 15 17:07:49 user nova-compute[72849]:  {{(pid=72849) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-de6601a7-90ce-4247-bbab-6af2b93938b5 None None] Received event <DeviceRemovedEvent: 1692119269.7863686, 0b9ea013-f173-4bfc-ba60-323af89b3529 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72849) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.driver [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:07:49 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Successfully detached device vdb from instance 0b9ea013-f173-4bfc-ba60-323af89b3529 from the live domain config.
Aug 15 17:07:49 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] calling os-brick to detach iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3587f7a30>, {'target_iqns': ['iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXtHdfTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:07:49 user nova-compute[72849]: WARNING os_brick.initiator.connectors.base [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:07:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df', 0)] {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b3eebc-208f-4660-a47a-b141713a0c8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dddf248-972f-45cd-bdbd-fa75ce58924c]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df (non-flash)\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df (non-flash)
Aug 15 17:07:49 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df (non-flash)
Aug 15 17:07:49 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc35827c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df'): ({'sdb'}, set())}) {{(pid=72849) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Removing single pathed devices sdb {{(pid=72849) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fcef44-0f71-4b19-92d8-582c30eb9c0e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7b188b-ca4d-4ecb-9e30-c39c81a85bdd]: (4, ('ok\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Flushing IO for device /dev/sdb {{(pid=72849) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2463e6-3e55-45ee-a907-8c2fbc9adc89]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72849) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f19d038-f2ed-4c2c-a99b-6bf0ad7ad8b9]: (4, ('1', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG os_brick.initiator.linuxscsi [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] SCSI volumes sdb have been removed. {{(pid=72849) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df')] {{(pid=72849) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a99b2b-3e32-4e49-893a-b2ef4c927391]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:07:49 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --logout {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:50 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[728fe878-b942-4351-945e-0557a4c06dcf]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df, portal: 172.16.0.220,3260]
Aug 15 17:07:50 user nova-compute[72849]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df, portal: 172.16.0.220,3260] successful.
Aug 15 17:07:50 user nova-compute[72849]:  stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:07:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --op delete {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:07:50 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dd9e4f-ce35-4485-a5d0-95922b2313df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:07:50 user nova-compute[72849]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b7438e-07b9-4ba2-9255-dfb0ab5b8cc6]: (4, ('', '')) {{(pid=84060) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:07:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72849) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:07:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.base [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:07:50 user nova-compute[72849]: DEBUG os_brick.initiator.connectors.iscsi [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] <== disconnect_volume: return (265ms) None {{(pid=72849) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:07:50 user nova-compute[72849]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Disconnected iSCSI Volume {{(pid=72849) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:07:50 user nova-compute[72849]: DEBUG nova.objects.instance [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lazy-loading 'flavor' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:07:50 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-08180682-7fd7-4058-a2b9-e37a8153b318 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.576s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:07:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:07:57 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:07:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:07:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 17:07:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:07:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:07:57 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:07:57 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:07:58 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updating instance_info_cache with network_info: [{"id": "8673a770-b007-4e07-bdf0-dc458355a8c2", "address": "fa:16:3e:f0:21:fe", "network": {"id": "04bf90e9-c437-4411-8c4d-b3a80811c56b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-801476002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008dbda477f24661b618327e725113f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8673a770-b0", "ovs_interfaceid": "8673a770-b007-4e07-bdf0-dc458355a8c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:07:58 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:07:58 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:07:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:07:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:07:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:07:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:07:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:07:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:08:00 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:08:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:08:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:08:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:08:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 17:08:06 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] There are 0 instances to clean {{(pid=72849) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 17:08:07 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:08:09 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:08:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:08:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:08:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:08:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:08:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:08:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:08:12 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:08:12 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:08:12 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:08:14 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:08:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:08:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:08:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:08:14 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:08:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:08:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:08:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:08:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:08:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:08:15 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:08:15 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:08:15 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8759MB free_disk=25.145824432373047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:08:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:08:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:08:15 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0b9ea013-f173-4bfc-ba60-323af89b3529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:08:15 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:08:15 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:08:15 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing inventories for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 17:08:15 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating ProviderTree inventory for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 17:08:15 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Updating inventory in ProviderTree for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 17:08:15 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing aggregate associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, aggregates: None {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 17:08:15 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Refreshing trait associations for resource provider 2d8a3c24-a12f-4e34-9906-d3707a50726d, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI {{(pid=72849) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 17:08:15 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:08:15 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:08:15 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:08:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:08:19 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:08:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:08:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:08:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:08:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:08:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:08:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:08:24 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:08:29 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:08:29 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72849) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 17:08:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:08:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:08:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:08:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:08:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:08:29 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:08:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:08:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:08:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:08:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:08:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:08:34 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:08:36 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:08:39 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:08:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:08:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:08:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:08:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:08:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:08:44 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:08:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:08:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:08:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:08:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:08:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:08:49 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:08:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:08:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:08:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:08:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:08:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:08:54 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:08:57 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:08:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:08:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 17:08:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:08:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquired lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:08:57 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Forcefully refreshing network info cache for instance {{(pid=72849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:08:57 user nova-compute[72849]: DEBUG nova.objects.instance [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lazy-loading 'info_cache' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:08:57 user nova-compute[72849]: DEBUG nova.network.neutron [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updating instance_info_cache with network_info: [{"id": "8673a770-b007-4e07-bdf0-dc458355a8c2", "address": "fa:16:3e:f0:21:fe", "network": {"id": "04bf90e9-c437-4411-8c4d-b3a80811c56b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-801476002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008dbda477f24661b618327e725113f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8673a770-b0", "ovs_interfaceid": "8673a770-b007-4e07-bdf0-dc458355a8c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:08:57 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Releasing lock "refresh_cache-0b9ea013-f173-4bfc-ba60-323af89b3529" {{(pid=72849) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:08:57 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updated the network info_cache for instance {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:08:59 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:00 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:09:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:09:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:09:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:09:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:09:04 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:06 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:09:08 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:09:09 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:09:09 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:09:14 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:09:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:09:14 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:09:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:09:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:09:14 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:09:14 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:09:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:09:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:09:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:09:14 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:09:14 user nova-compute[72849]: DEBUG oslo_concurrency.processutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72849) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:09:15 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:09:15 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:09:15 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=25.144847869873047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:09:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:09:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:09:15 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Instance 0b9ea013-f173-4bfc-ba60-323af89b3529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72849) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:09:15 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:09:15 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:09:15 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:09:15 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:09:15 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:09:15 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:09:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:09:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:09:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:09:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:09:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:09:19 user nova-compute[72849]: INFO nova.compute.manager [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Terminating instance
Aug 15 17:09:19 user nova-compute[72849]: DEBUG nova.compute.manager [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Start destroying the instance on the hypervisor. {{(pid=72849) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:09:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:19 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-33c2fbb6-f43c-470a-a08f-40203433be32 req-c15f19be-ba7b-47df-9567-26ac9c85185b service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Received event network-vif-unplugged-8673a770-b007-4e07-bdf0-dc458355a8c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:09:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-33c2fbb6-f43c-470a-a08f-40203433be32 req-c15f19be-ba7b-47df-9567-26ac9c85185b service nova] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:09:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-33c2fbb6-f43c-470a-a08f-40203433be32 req-c15f19be-ba7b-47df-9567-26ac9c85185b service nova] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:09:19 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-33c2fbb6-f43c-470a-a08f-40203433be32 req-c15f19be-ba7b-47df-9567-26ac9c85185b service nova] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:09:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-33c2fbb6-f43c-470a-a08f-40203433be32 req-c15f19be-ba7b-47df-9567-26ac9c85185b service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] No waiting events found dispatching network-vif-unplugged-8673a770-b007-4e07-bdf0-dc458355a8c2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:09:19 user nova-compute[72849]: DEBUG nova.compute.manager [req-33c2fbb6-f43c-470a-a08f-40203433be32 req-c15f19be-ba7b-47df-9567-26ac9c85185b service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Received event network-vif-unplugged-8673a770-b007-4e07-bdf0-dc458355a8c2 for instance with task_state deleting. {{(pid=72849) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:09:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:20 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:09:20 user nova-compute[72849]: INFO nova.virt.libvirt.driver [-] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Instance destroyed successfully.
Aug 15 17:09:20 user nova-compute[72849]: DEBUG nova.objects.instance [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lazy-loading 'resources' on Instance uuid 0b9ea013-f173-4bfc-ba60-323af89b3529 {{(pid=72849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:09:20 user nova-compute[72849]: DEBUG nova.virt.libvirt.vif [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-727016478',display_name='tempest-SnapshotDataIntegrityTests-server-727016478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-727016478',id=53,image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK/sKxxSecqmztkKZKNnjAxrlZy7XvZpqdSs1li1INPlisthOoKLBzz7FZD8qR/75+9k58AKYBxzOEL4/A1qDgTxVIlRPIYC/y7DoSoNyHfoJlQPcdV8fnTvF2yAPnhag==',key_name='tempest-keypair-1549315691',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:02:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='008dbda477f24661b618327e725113f4',ramdisk_id='',reservation_id='r-yq780jrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='59265a51-1c51-4986-ae25-4fec6807c20c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1921619077',owner_user_name='tempest-SnapshotDataIntegrityTests-1921619077-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:02:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c477b2393c34857a2bf812120b10f35',uuid=0b9ea013-f173-4bfc-ba60-323af89b3529,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8673a770-b007-4e07-bdf0-dc458355a8c2", "address": "fa:16:3e:f0:21:fe", "network": {"id": "04bf90e9-c437-4411-8c4d-b3a80811c56b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-801476002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008dbda477f24661b618327e725113f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8673a770-b0", "ovs_interfaceid": "8673a770-b007-4e07-bdf0-dc458355a8c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:09:20 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Converting VIF {"id": "8673a770-b007-4e07-bdf0-dc458355a8c2", "address": "fa:16:3e:f0:21:fe", "network": {"id": "04bf90e9-c437-4411-8c4d-b3a80811c56b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-801476002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008dbda477f24661b618327e725113f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8673a770-b0", "ovs_interfaceid": "8673a770-b007-4e07-bdf0-dc458355a8c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:09:20 user nova-compute[72849]: DEBUG nova.network.os_vif_util [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:21:fe,bridge_name='br-int',has_traffic_filtering=True,id=8673a770-b007-4e07-bdf0-dc458355a8c2,network=Network(04bf90e9-c437-4411-8c4d-b3a80811c56b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8673a770-b0') {{(pid=72849) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:09:20 user nova-compute[72849]: DEBUG os_vif [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:21:fe,bridge_name='br-int',has_traffic_filtering=True,id=8673a770-b007-4e07-bdf0-dc458355a8c2,network=Network(04bf90e9-c437-4411-8c4d-b3a80811c56b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8673a770-b0') {{(pid=72849) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:09:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8673a770-b0, bridge=br-int, if_exists=True) {{(pid=72849) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:09:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:09:20 user nova-compute[72849]: INFO os_vif [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:21:fe,bridge_name='br-int',has_traffic_filtering=True,id=8673a770-b007-4e07-bdf0-dc458355a8c2,network=Network(04bf90e9-c437-4411-8c4d-b3a80811c56b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8673a770-b0')
Aug 15 17:09:20 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Deleting instance files /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529_del
Aug 15 17:09:20 user nova-compute[72849]: INFO nova.virt.libvirt.driver [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Deletion of /opt/stack/data/nova/instances/0b9ea013-f173-4bfc-ba60-323af89b3529_del complete
Aug 15 17:09:20 user nova-compute[72849]: INFO nova.compute.manager [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 15 17:09:20 user nova-compute[72849]: DEBUG oslo.service.loopingcall [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72849) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:09:20 user nova-compute[72849]: DEBUG nova.compute.manager [-] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Deallocating network for instance {{(pid=72849) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:09:20 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:09:21 user nova-compute[72849]: DEBUG nova.network.neutron [-] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:09:21 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Took 0.71 seconds to deallocate network for instance.
Aug 15 17:09:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:09:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:09:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-c7d6ba42-d0f5-4c0a-b9c4-09a9d50dba47 req-e3b99f77-b53b-424e-ad81-0b5b5361b650 service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Received event network-vif-deleted-8673a770-b007-4e07-bdf0-dc458355a8c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:09:21 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:09:21 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:09:21 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:09:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:09:21 user nova-compute[72849]: INFO nova.scheduler.client.report [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Deleted allocations for instance 0b9ea013-f173-4bfc-ba60-323af89b3529
Aug 15 17:09:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-43a3aeec-37ae-4446-9e06-ad98c0558339 tempest-SnapshotDataIntegrityTests-1921619077 tempest-SnapshotDataIntegrityTests-1921619077-project-member] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.996s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:09:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-d842f6c4-bc3b-42d4-983f-fe003d9ce848 req-2fec3133-751b-4fdd-9197-0e44c2a37c3a service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Received event network-vif-plugged-8673a770-b007-4e07-bdf0-dc458355a8c2 {{(pid=72849) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:09:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d842f6c4-bc3b-42d4-983f-fe003d9ce848 req-2fec3133-751b-4fdd-9197-0e44c2a37c3a service nova] Acquiring lock "0b9ea013-f173-4bfc-ba60-323af89b3529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:09:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d842f6c4-bc3b-42d4-983f-fe003d9ce848 req-2fec3133-751b-4fdd-9197-0e44c2a37c3a service nova] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:09:21 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [req-d842f6c4-bc3b-42d4-983f-fe003d9ce848 req-2fec3133-751b-4fdd-9197-0e44c2a37c3a service nova] Lock "0b9ea013-f173-4bfc-ba60-323af89b3529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:09:21 user nova-compute[72849]: DEBUG nova.compute.manager [req-d842f6c4-bc3b-42d4-983f-fe003d9ce848 req-2fec3133-751b-4fdd-9197-0e44c2a37c3a service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] No waiting events found dispatching network-vif-plugged-8673a770-b007-4e07-bdf0-dc458355a8c2 {{(pid=72849) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:09:21 user nova-compute[72849]: WARNING nova.compute.manager [req-d842f6c4-bc3b-42d4-983f-fe003d9ce848 req-2fec3133-751b-4fdd-9197-0e44c2a37c3a service nova] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Received unexpected event network-vif-plugged-8673a770-b007-4e07-bdf0-dc458355a8c2 for instance with vm_state deleted and task_state None.
Aug 15 17:09:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:09:35 user nova-compute[72849]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692119360.3602698, 0b9ea013-f173-4bfc-ba60-323af89b3529 => Stopped> {{(pid=72849) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:09:35 user nova-compute[72849]: INFO nova.compute.manager [-] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] VM Stopped (Lifecycle Event)
Aug 15 17:09:35 user nova-compute[72849]: DEBUG nova.compute.manager [None req-6c976a2b-5963-4cf4-ad16-32271d1b7301 None None] [instance: 0b9ea013-f173-4bfc-ba60-323af89b3529] Checking state {{(pid=72849) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:09:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:09:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:09:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:09:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:09:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:40 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:09:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:09:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:09:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:09:45 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:50 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:09:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:09:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:09:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:09:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:09:55 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:09:59 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:09:59 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Starting heal instance info cache {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:09:59 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Rebuilding the list of instances to heal {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 17:09:59 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] Didn't find any instances for network info cache update. {{(pid=72849) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 17:10:00 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:10:00 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:10:05 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:10:07 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:10:09 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:10:10 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:10:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:10:10 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:10:13 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:10:13 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:10:14 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:10:14 user nova-compute[72849]: DEBUG nova.compute.manager [None req-73033403-2388-433c-826a-1227b87393f7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72849) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:10:15 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:10:16 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:10:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:10:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:10:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:10:16 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72849) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:10:16 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:10:16 user nova-compute[72849]: WARNING nova.virt.libvirt.driver [None req-73033403-2388-433c-826a-1227b87393f7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:10:16 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Hypervisor/Node resource view: name=user free_ram=8907MB free_disk=25.171688079833984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72849) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:10:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:10:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:10:16 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:10:16 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72849) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:10:16 user nova-compute[72849]: DEBUG nova.compute.provider_tree [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed in ProviderTree for provider: 2d8a3c24-a12f-4e34-9906-d3707a50726d {{(pid=72849) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:10:16 user nova-compute[72849]: DEBUG nova.scheduler.client.report [None req-73033403-2388-433c-826a-1227b87393f7 None None] Inventory has not changed for provider 2d8a3c24-a12f-4e34-9906-d3707a50726d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72849) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:10:16 user nova-compute[72849]: DEBUG nova.compute.resource_tracker [None req-73033403-2388-433c-826a-1227b87393f7 None None] Compute_service record updated for user:user {{(pid=72849) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:10:16 user nova-compute[72849]: DEBUG oslo_concurrency.lockutils [None req-73033403-2388-433c-826a-1227b87393f7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=72849) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:10:17 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:10:20 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:10:21 user nova-compute[72849]: DEBUG oslo_service.periodic_task [None req-73033403-2388-433c-826a-1227b87393f7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72849) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:10:25 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:10:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:10:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:10:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72849) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:10:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:10:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72849) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:10:30 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:10:35 user nova-compute[72849]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72849) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}